Fog Creek Network Status

Fixed Now: Credit Card Payment Failures

Attempts to enter credit card information at our online shop or on your FogBugz On Demand account may have reacted with a server error over the last few hours. This was due to a faulty setting on our credit card processor, and has been corrected. If you were affected by this, you will need to re-enter your credit card information for your payment to actually go through.

This appears to have begun this afternoon (GMT -5), but we did not notice it until just a short time ago. I'm working to fill this hole in our monitoring system, so next time we'll catch it as it happens.

All services are up, maintenance complete

The swap to our alternate drop is complete. Our provider is rebuilding our primary, so this should not be an issue in the future.

Intermittent New York network instability, and emergency maintenance

Our provider's ethernet drop has flapped a couple of times today. Customers may have experienced this as a few seconds' unresponsiveness or a timeout in FogBugz On Demand or Copilot. I'm headed down to our facility right now to move us over to an alternate drop. Total downtime is expected to be less than a minute.

All Services Are Up, FogBugz On Demand Maintenance Complete

Our FogBugz On Demand maintenance was a success, and there was not any more than a few seconds of downtime.  

At this time, all services are up and running as expected.

FogBugz On Demand Maintenance Begins in 15 Minutes

As previously mentioned, we will begin our network maintenance in our LA data center in 15 minutes or so.   

I will post a final update when the maintenance is complete.

FogBugz On Demand Weekend Maintenance

Emails have gone out to the customers that will be impacted, but just in case we didn't have yours:

In order to improve performance, we will be performing some network maintenance in our LA data center on February 8th at 07:00 AM UTC. During this time, your FogBugz On Demand account may be unavailable.  We expect our maintenance to be completed within the hour.  

I will post a new blog entry as soon as we are done.   

3 Minutes of FogBugz On Demand Downtime / All Services are Back

During a routine deployment of a new version of FogBugz On Demand this evening, we encountered a bug that caused our web server to return an 'Invalid Server Name' error for about 3 minutes before services were restored.

We apologize for the blip, and are investigating to see if the error lies in the automated deployment script or in the internals of our web server.

As of now, all servers are back to normal and we do not foresee any other issues.