Microsoft outage saw 80% of servers fail
Key Points:
- Microsoft 365 experienced a major outage last week, with over 80% of its servers becoming unresponsive, severely impacting users' ability to send and receive emails.
- The root cause was traced back to a latent defect introduced in a July update, which caused servers to become overwhelmed under certain load conditions due to lock contention in an internal process.
- The outage was triggered when one of Microsoft’s two independent network gateway systems failed, causing the remaining gateway to handle all traffic and exacerbate the defect.
- Microsoft confirmed the issue was a technical failure, not a cyberattack, and denied any connection to recent layoffs, though some remain skeptical about the company's staffing and testing practices.
- The defect went undetected for over three months because load testing was conducted on hardware configurations that did not replicate the conditions leading to failure, particularly newer, more powerful machines.