Co-Lo Stability Problems

Unfortunately, our co-lo had some stability problems Friday morning.

First up, they lost all of their connectivity to the facility that holds all of our games. This took them about 40 minutes to diagnose and a bit longer to restore.

Much more astonishingly, they rebooted all of their machines (which means all of our machines) while they were fixing the problem, with no notice. This probably had minimal repercussions on the SkotOS games (Marrach, Ironclaw, Lazarus, and Lovecraft). There may have been a rollback of an hour or two.

TEC and Grendel's Revenge are more troublesome. TEC will suffer a rollback of 10 hours, to midnight (PT) last night, since the unannounced reboot happened one hour before the next backups. GR suffered a more complete failure. We're being forced to restore the entire machine from its backups, then we'll need to restore the game from the backups stored within that backup. The lineup of dates look promising (which is how we laid them out, 'lo these many years ago), so the hope is that we'll only suffer a 7 hour rollback, to the 3am (PT) game backup, but it's a bit dicey at the moment.

Apologies for the inconvenience; we're now making sure everything is stable, and we're looking into whether our most recent upgrades to TEC will support increasing the backups to every 6 hours.

Edit: The GR problem is proving even more intractable than hoped. As best I can tell, our colo is still having some issues because I can't boot the first restore I made of GR and I can't build a new node either. I expect this will just clear when they get their act together, but in the meantime I'm not able to get GR back online until they fix these problems.
See more
See less

The Wonderful Tent of Master Ali

  • Filter
  • Time
  • Show
Clear All
new posts

  • The Wonderful Tent of Master Ali

    Time has come yet again - Master Trader Ali-Jahib has arrived in Castle Marrach!

    The Master Trader is very excited to be here. This year he boasts his largest collection ever, over one hundred one-of-a-kind custom/unique items and hundreds more rare and difficult-to-obtain items in the Master's wares. Rare, exotic and unique trinkets, toys, clothing, jewelry, furniture, drinks, decor, weapons, armour, crafting resources and an array of mysterious magical artifacts.

    The Master Trader's tent is currently set up for viewing, all potential patrons are welcomed inside the Master's brand new tent, freshly stitched from Araby. Window shopping only! No trading has been scheduled yet, but please take your time, explore the Master's wares and select a few items of note for potential purchase when trade opens.

    Feast your eyes on the wonderous tent of Master Ali-Jahib!
    StoryHost Kurzon
    Castle Marrach Staff

    The destiny of the world is determined less by the battles that are lost and won than by the stories it loves and believes in.

  • #2
    Really looking forward to trading with Master Ali. Hopefully we hear soon about that schedule so we can adjust our RL schedule in time to be able to attend one of the sessions.
    ~ Initiate Kaori Zaihou ~
    Arcanist for Lord Vestio
    OOC: Signature last changed on 5/10/2015


    • #3
      Hey, can you guys and gals please schedule another OB early (before noon) trading day for morning players? You only have one day on the schedule. Thank you a lot!