There are times when cloud computing must seem like a pretty sweet option. I would imagine that the folks at Wordpress were pondering something to that effect today. Earlier today they had an outage that lasted 110 minutes. Their worst outage in 4 years apparently.
From Wordpress.com
What Happened: We are still gathering details, but it appears an unscheduled change to a core router by one of our datacenter providers messed up our network in a way we haven’t experienced before, and broke the site. It also broke all the mechanisms for failover between our locations in San Antonio and Chicago. All of your data was safe and secure, we just couldn’t serve it.
I imagine that a LOT of coffee was downed while they scrambled to fix the outage. Change control is there for a reason. Which can only mean that as soon as the dust settles that someone will be looking for a new job. And that single point of failure will surely haunt them.
(Image used under CC from bitzcelt)
