AWS 重大故障! - V2EX
V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
sailors
V2EX    Amazon Web Services

AWS 重大故障!

  • &nsp;
  •   sailors 5 小时 44 分钟前 2330 次点击
    大家一睡醒就会看到这个大新闻,等待大佬们分析原因。

    https://health.aws.amazon.com/health/status
    第 1 条附言    2 小时 11 分钟前
    官方宣布故障解决,整体耗时 15 小时!
    22 条回复    2025-10-21 09:28:53 +08:00
    levelworm
        1
    levelworm  
       5 小时 5 分钟前
    这下只有两个 9 了。。。
    Amex
        2
    Amex  
       4 小时 37 分钟前 via iPhone
    都挂了十几个小时了吧
    xiaket
        3
    xiaket  
       3 小时 18 分钟前
    是啊昨天晚饭后就开始围观... 到现在都好久了
    levelworm
        4
    levelworm  
       2 小时 16 分钟前 via iPhone
    好像算是结束了
    edak
        5
    edak  
       1 小时 33 分钟前 via iPhone
    aws 依旧是不错的选择,中心化的力量
    zx9481
        6
    zx9481  
       1 小时 21 分钟前
    为什么连故障分析都没有
    mapleleaf2023
        7
    mapleleaf2023  
       1 小时 13 分钟前
    这次影响非常大,北美很多券商今天交易系统都登录不进去。
    stinkytofux
        8
    stinkytofux  
       1 小时 7 分钟前
    越来越多的企业会下云了, 用云服务平时不出事, 一出事全部玩完.
    Dragonish3600
        9
    Dragonish3600  
       1 小时 2 分钟前   1
    @stinkytofux 平时不出事,一出事全玩完。。这句话适用于所有的服务,不管你用不用云。
    greensea
        10
    greensea  
       1 小时 1 分钟前
    我记得昨天就看到消息了,不过以为只是一次日常的崩溃,没想到这次居然玩这么大
    MacTavish123
        11
    MacTavish123  
       56 分钟前
    @Dragonish3600 一些地方政府都是非工作时间点断电
    skull
        12
    skull  
       56 分钟前 via iPhone
    @stinkytofux 难道自己就不会炸吗
    ne6rd
        13
    ne6rd  
       54 分钟前
    感觉没上次微软杀毒软件蓝屏影响大。
    opengps
        14
    opengps  
       53 分钟前
    @stinkytofux #8 下云是不是因为不出事,而是因为出事没什么可做的。自建机房可靠性很难达到云的效果。更多大型企业是在调整方案多云并行
    IDAEngine
    nbsp;   15
    IDAEngine  
       53 分钟前
    昨天下午 3 点多开始崩,说是美东内部的 dns 配置错误
    realpg
        16
    realpg  
    PRO
       50 分钟前
    这要是阿里腾讯不得 15 天啊

    :狗头:
    HTravel
        17
    HTravel  
       50 分钟前
    AWS 为什么连两地三活都不会建?

    别说它有。这时候不起作用,那还什么时候起作用?
    Amex
        18
    Amex  
       45 分钟前 via iPhone
    看上去一开始是 dynamo dns endpoint 解析出问题 修好以后变成经典 circular dependency

    aws 你这 system design 做的也不行啊
    Between 11:49 PM PDT on October 19 and 2:24 AM PDT on October 20, we experienced increased error rates and latencies for AWS Services in the US-EAST-1 Region. Additionally, services or features that rely on US-EAST-1 endpoints such as IAM and DynamoDB Global Tables also experienced issues during this time. At 12:26 AM on October 20, we identified the trigger of the event as DNS resolution issues for the regional DynamoDB service endpoints. After resolving the DynamoDB DNS issue at 2:24 AM, services began recovering but we had a subsequent impairment in the internal subsystem of EC2 that is responsible for launching EC2 instances due to its dependency on DynamoDB. As we continued to work through EC2 instance launch impairments, Network Load Balancer health checks also became impaired, resulting in network connectivity issues in multiple services such as Lambda, DynamoDB, and CloudWatch. We recovered the Network Load Balancer health checks at 9:38 AM. As part of the recovery effort, we temporarily throttled some operations such as EC2 instance launches, processing of SQS queues via Lambda Event Source Mappings, and asynchronous Lambda invocations. Over time we reduced throttling of operations and worked in parallel to resolve network connectivity issues until the services fully recovered. By 3:01 PM, all AWS services returned to normal operations.
    wxw752
        19
    wxw752  
       42 分钟前
    @stinkytofux #8 整体稳定性远高于自建,所以还是会上云的
    mytsing520
        20
    mytsing520  
    PRO
       32 分钟前
    AWS 这个故障目前已经结束了,表示稍后会分享详细的事故总结。
    94
        21
    94  
       30 分钟前
    @stinkytofux #8 ,下不下云都一样。昨天才经历某一个自建机房停电。很多服务都没必要做多活或者容灾。对比上云,自建机房成本明显高太多了。
    bitmin
        22
    bitmin  
       17 分钟前
    好几年前去听一个中小公司的分享,他们老早就阿里云和 AWS 一起用了
    关于     帮助文档     自助推广系统     博客     API     FAQ     Solana     5980 人在线   最高记录 6679       Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 21ms UTC 01:46 PVG 09:46 LAX 18:46 JFK 21:46
    Do have faith in what you're doing.
    ubao msn snddm index pchome yahoo rakuten mypaper meadowduck bidyahoo youbao zxmzxm asda bnvcg cvbfg dfscv mmhjk xxddc yybgb zznbn ccubao uaitu acv GXCV ET GDG YH FG BCVB FJFH CBRE CBC GDG ET54 WRWR RWER WREW WRWER RWER SDG EW SF DSFSF fbbs ubao fhd dfg ewr dg df ewwr ewwr et ruyut utut dfg fgd gdfgt etg dfgt dfgd ert4 gd fgg wr 235 wer3 we vsdf sdf gdf ert xcv sdf rwer hfd dfg cvb rwf afb dfh jgh bmn lgh rty gfds cxv xcv xcs vdas fdf fgd cv sdf tert sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf shasha9178 shasha9178 shasha9178 shasha9178 shasha9178 liflif2 liflif2 liflif2 liflif2 liflif2 liblib3 liblib3 liblib3 liblib3 liblib3 zhazha444 zhazha444 zhazha444 zhazha444 zhazha444 dende5 dende denden denden2 denden21 fenfen9 fenf619 fen619 fenfe9 fe619 sdf sdf sdf sdf sdf zhazh90 zhazh0 zhaa50 zha90 zh590 zho zhoz zhozh zhozho zhozho2 lislis lls95 lili95 lils5 liss9 sdf0ty987 sdft876 sdft9876 sdf09876 sd0t9876 sdf0ty98 sdf0976 sdf0ty986 sdf0ty96 sdf0t76 sdf0876 df0ty98 sf0t876 sd0ty76 sdy76 sdf76 sdf0t76 sdf0ty9 sdf0ty98 sdf0ty987 sdf0ty98 sdf6676 sdf876 sd876 sd876 sdf6 sdf6 sdf9876 sdf0t sdf06 sdf0ty9776 sdf0ty9776 sdf0ty76 sdf8876 sdf0t sd6 sdf06 s688876 sd688 sdf86