Tonight's maintenance has been completed. Due to scheduling issues, the load balancer move is postponed until next week. The database shuffle, on the other hand, is finished and all monitors are green.
I'm going to move another batch of databases between servers this weekend, so some customers will experience brief outages during the maintenance window. Again, downtime will vary with the size of the database, but should generally be under five minutes.
I'll also be moving FogBugz and Kiln On Demand to new load balancers. This will incur a very brief service outage (only a few seconds), but should improve performance and reliability across the board.
Our Internet Service Provider will be performing network
maintenance this Friday, May 21, between 06:30 GMT and 07:00 GMT. Service interruption is expected to last only a couple of minutes, but may occur at any time during the maintenance window.
I'll be shuffling databases around on our backend this weekend to ensure that our servers are evenly loaded. As a result, a portion of our FogBugz and Kiln On Demand customers will experience brief, individual service outages. Total downtime per account will depend on the size of the database, but will generally be less than five minutes.
Tonight's Kiln Maintenance was completed without drama and only a second or two of service downtime.
Tonight's Network Maintenance also went perfectly according to plan, with zero service impact. As a result, our redundant gateways are in two separate cabinets fed by two totally independent UPSs.
This Sunday, we will be coordinating with our Internet Service Provider to move our passive gateway node to a new cabinet. If everything goes according to plan, this will incur no outage or service impact. Things rarely go according to plan, though, so please be aware that we may experience interruptions to all services during this period.
I apologize for the short notice but scheduling was only confirmed by our ISP a few minutes ago. If this weren't such a high priority change, I'd put it off for another week.
This Sunday I'll be upgrading Kiln's Mercurial servers. Only in-progress Mercurial requests will be affected and the service interruption should last only a few seconds.
Our Internet Service Provider will be performing network maintenance on Tuesday, May 18, between 06:00 GMT and 10:00 GMT. The impact should be
minimal, but some customers may experience two brief windows of
latency and packet loss. These windows may occur at any time during the
maintenance period.