Downtime Report: Wednesday Night

We had an abrupt and unannounced downtime for all games and services starting sometime after 9pm PT on Wednesday evening. This was due to a massive power outage at our cloud computing facility of the sort that redundant systems are supposed to ensure never happen. After about an hour they were able to diagnose that the power was out. It took a few more hours for them to start restoring service.

At this moment, everything is back up except for Ironclaw and TEC. At the rate they're restoring things, I hope those will be back up in the next 15-30 minutes, but it's entirely in their hands.

As is typically the case with a sudden reboot, TEC and GR have to be rolled back. This is already done with GR. The TEC rollback should be just a few hours due to the more recent backups recently instituted, but I need to get the machine back before I can verify that.

Update: Ironclaw and TEC are now back too. The TEC rollback was 2.5 hours, from 9.30pm PT (when everything crashed) to 7.00 pm PT.
See more
See less

Concerning Maintenance

  • Filter
  • Time
  • Show
Clear All
new posts

  • Concerning Maintenance

    Alpha Colony,

    This is your friendly, helpful Maintenance Technician, Tela.

    As I have received no word on any request by any Administrator, or from Engineer Kiernan himself, in any capacity... I make the following announcement:

    If you have any requests for Maintenance, feel free to e-mail me or let me know over the Com, and I shall respond as soon as I can. While I have a phone, I rarely carry it these days.

    At this time, I cannot hire staff, but if I need help with a task, I would monetarily compensate on a per-hour basis.

    Thank you,

    -Tela, Maintenance Technician
    LP: Tela - phone number: Teelah

    CM: Motsumoto Raharu

  • #2
    Hello Tela, I'm Fionnghuala, I go by a couple nicknames, Fionn, and Nell. I was not available for some time due to participating in an experiment by Dr. Wei. I ho I will be allooe, I mean able to talk with you in person soon.