The Catch-22 that broke the Internet
Found on Ars Technica on Monday, 10 June 2019
The disruptions all stemmed from Google Cloud, which suffered a prolonged outage—an outage which also prevented Google engineers from pushing a fix. And so, for an entire afternoon and into the night, the Internet was stuck in a crippling ouroboros: Google couldn’t fix its cloud, because Google’s cloud was broken.
Google says its engineers were aware of the problem within two minutes. And yet! “Debugging the problem was significantly hampered by failure of tools competing over use of the now-congested network,” the company wrote in a detailed postmortem.
A friendly reminder that everything can and will go down. "The cloud" is in no way special there; it makes it just more spectacular by affecting way more people.