Announcement

Collapse

Downtime Report: Wednesday Night

We had an abrupt and unannounced downtime for all games and services starting sometime after 9pm PT on Wednesday evening. This was due to a massive power outage at our cloud computing facility of the sort that redundant systems are supposed to ensure never happen. After about an hour they were able to diagnose that the power was out. It took a few more hours for them to start restoring service.

At this moment, everything is back up except for Ironclaw and TEC. At the rate they're restoring things, I hope those will be back up in the next 15-30 minutes, but it's entirely in their hands.

As is typically the case with a sudden reboot, TEC and GR have to be rolled back. This is already done with GR. The TEC rollback should be just a few hours due to the more recent backups recently instituted, but I need to get the machine back before I can verify that.

Update: Ironclaw and TEC are now back too. The TEC rollback was 2.5 hours, from 9.30pm PT (when everything crashed) to 7.00 pm PT.
See more
See less

StoryBuilders

Collapse
Forums Topics Posts Last Post
No forums found.
  • Filter
  • Time
  • Show
  • New Topics
Clear All
new posts
There are no conversations in this channel.
  • Filter
  • Time
  • Show
Clear All
new posts
Please log in to your account to view your subscribed posts.
  • Filter
  • Time
  • Show
  • Sort By
  • Order
Clear All
new posts
Topics Statistics Last Post
Started by OriginalSin, 11-14-2006, 07:31 PM
23 responses
11,569 views
0 likes
Last Post OriginalSin  
Started by Ameko, 10-15-2008, 01:33 PM
1 response
4,088 views
0 likes
Last Post Ameko
by Ameko
 
Started by bootsycollins, 07-14-2008, 07:39 PM
5 responses
7,558 views
0 likes
Last Post Usuichii  
Started by LadyDark, 12-06-2004, 05:16 PM
30 responses
10,916 views
0 likes
Last Post chasity_x  
Started by Summercat, 03-27-2007, 02:42 AM
0 responses
1,495 views
0 likes
Last Post Summercat  
Started by Lenander, 01-06-2007, 10:34 PM
4 responses
2,053 views
0 likes
Last Post SHAzrael  
Started by Marcus'sMadness, 03-15-2007, 06:27 PM
1 response
1,629 views
0 likes
Last Post SHAzrael  
Started by Ser_Arikon, 03-05-2007, 06:10 PM
0 responses
1,911 views
0 likes
Last Post Ser_Arikon  
Started by Rithu, 10-22-2006, 06:20 PM
1 response
1,679 views
0 likes
Last Post TonyD
by TonyD
 
Started by Geist, 06-15-2006, 08:15 AM
3 responses
2,488 views
0 likes
Last Post Gareth
by Gareth
 
No topics found.
Working...
X