Downtime Report: Wednesday Night

We had an abrupt and unannounced downtime for all games and services starting sometime after 9pm PT on Wednesday evening. This was due to a massive power outage at our cloud computing facility of the sort that redundant systems are supposed to ensure never happen. After about an hour they were able to diagnose that the power was out. It took a few more hours for them to start restoring service.

At this moment, everything is back up except for Ironclaw and TEC. At the rate they're restoring things, I hope those will be back up in the next 15-30 minutes, but it's entirely in their hands.

As is typically the case with a sudden reboot, TEC and GR have to be rolled back. This is already done with GR. The TEC rollback should be just a few hours due to the more recent backups recently instituted, but I need to get the machine back before I can verify that.

Update: Ironclaw and TEC are now back too. The TEC rollback was 2.5 hours, from 9.30pm PT (when everything crashed) to 7.00 pm PT.
See more
See less

Change to @rumor volume and frequency

  • Filter
  • Time
  • Show
Clear All
new posts

  • Change to @rumor volume and frequency

    Hey folk,

    We're going to try something a little different with @rumors for a bit. From now on, Rumors will be posted every Wednesday, but in smaller batches.

    Why? A couple reasons. Firstly to keep them more relevant, the every-two-weeks standard just wasn't keeping a lot of the rumors present and up to speed with the latest castle politics and plot information. But also because posting them more frequently acts as a more frequent reminder for people to submit them, where we've not been getting many submitted lately despite lots happening in game. And finally because sometimes the big batches of 20 - 30 rumors becomes too much to bother reading at once.

    We'll try it out a bit and see how it goes. Remember, every wednesday.

    Thanks and happy gaming.
    StoryHost Kurzon
    Castle Marrach Staff

    The destiny of the world is determined less by the battles that are lost and won than by the stories it loves and believes in.