We have successfully completed all three elements of our previously announced infrastructure maintenance. This should permanently alleviate the network issues we saw earlier this week.
Cumulative service downtime was 25 minutes (one 20 minute interruption, one 5 minute interruption), which was much better than the 45 minutes anticipated. We also learned a lot about what happens when we bisect all of our product and infrastructure networks at the same time, which we can turn around to make more resilient services. All told: Very productive night! And a big thanks to each of the teams who worked in a small (virtual) workspace without tripping each other up.
Thank you for bearing with us, and sorry for the trouble this week. But things are looking up!
We're going to let the current set up bake for a few hours, and we will be turning the Joel On Software discussion forums back on in the morning, assuming all is well.
If you have any questions about this maintenance, please don't hesitate to contact us!