Co-Lo Stability Problems

Unfortunately, our co-lo had some stability problems Friday morning.

First up, they lost all of their connectivity to the facility that holds all of our games. This took them about 40 minutes to diagnose and a bit longer to restore.

Much more astonishingly, they rebooted all of their machines (which means all of our machines) while they were fixing the problem, with no notice. This probably had minimal repercussions on the SkotOS games (Marrach, Ironclaw, Lazarus, and Lovecraft). There may have been a rollback of an hour or two.

TEC and Grendel's Revenge are more troublesome. TEC will suffer a rollback of 10 hours, to midnight (PT) last night, since the unannounced reboot happened one hour before the next backups. GR suffered a more complete failure. We're being forced to restore the entire machine from its backups, then we'll need to restore the game from the backups stored within that backup. The lineup of dates look promising (which is how we laid them out, 'lo these many years ago), so the hope is that we'll only suffer a 7 hour rollback, to the 3am (PT) game backup, but it's a bit dicey at the moment.

Apologies for the inconvenience; we're now making sure everything is stable, and we're looking into whether our most recent upgrades to TEC will support increasing the backups to every 6 hours.

Edit: The GR problem is proving even more intractable than hoped. As best I can tell, our colo is still having some issues because I can't boot the first restore I made of GR and I can't build a new node either. I expect this will just clear when they get their act together, but in the meantime I'm not able to get GR back online until they fix these problems.
See more
See less

Funny Moments Of Marrach

  • Filter
  • Time
  • Show
Clear All
new posts

  • Taite says, "Elmer. Do you want to go to the outer dining hall with me? Maybe they have something that you'd like."
    A small hound hungrily looks about for a cat.
    Tiel tells a small hound, "I've seen cats there as well."
    A small hound salivates needfully.


    • A young page boy murmurs, in Teanga, "Trouble's coming, I can smell it on the wind..."
      Dame Hannah glares at a young page boy.
      A young page boy announces, in Teanga, "Oops..."

      >.> hee. Dame hannah the evileye.


      • <.< I forgot to copy it so it's not exact but still soo funny.

        Vasilisa consider her iron tray, "I suppose this can still be used as a weapon."
        Dame Galatea agrees, "No one likes hot liquid in their face."
        Dame Galatea supposes, "Unless it's a shadow or mechanical spider who is not bothered by it."
        Blodwen says "Whores do."
        Dame Galatea turns her gaze to Blodwen
        Vasilisa snorts at Blodwen's words "Likely."


        • You extend your painter's palette to Erindrin, "We should definitely do this more often."

          Erindrin eyes your oxblood muslin handkerchief, "M-hm..."

          Erindrin takes a painter's palette from Yolanda.

          Erindrin places her three painter's palettes in her natural paper package.

          You offer your oxblood muslin handkerchief to Erindrin.

          You remark about your oxblood muslin handkerchief, "It wasn't always this color..."

          Erindrin takes an oxblood muslin handkerchief from Yolanda.

          Erindrin gooily rubs her paint-stained hands with her oxblood muslin handkerchief, "What colour was it?"

          You impishly twinkle your heavy lidded sloe eyes, "Not until I had to staunch someone's spurting artery with it."

          You possibly jest.

          Erindrin actually squeaks.

          Erindrin throws an oxblood muslin handkerchief away.

          Erindrin accidentally aims at you.

          You catch an oxblood muslin handkerchief.

          You reassuringly smile at Erindrin, "I'm kidding. It was alway that color."

          Erindrin squints at you.


          • Odjit's here! It's business time.

            StoryPlotter Odjit approaches the eastern ascending stairs.

            A bald guard salutatorily welcomes StoryPlotter Odjit.

            StoryPlotter Odjit leaves through the eastern ascending stairs.

            A bald guard chortles helplessly.
            Meoris Rousseau

            Bodyservant to His Excellency, Lord Boreas

            Junior Steward of the Treasury


            • Dame Umichan counts on her fingers, "Erm..."
              Dame Umichan recites, "Elmer is a dog."
              Dame Umichan adds, "Who leaves his half-chewed meatballs."
              Dame Umichan tries, "Lying on the ground. Wasteful."
              A small hound yaps jovially.
              Dame Umichan shrugs, "Poetry was never a strength of mine."
              A small hound yaps happily.
              A small hound pants brightly.
              Adeline also giggles at Dame Umichan, "I'm sure he loves the attention."
              A small hound dances spritely.
              A small hound leaps into the air happily.
              A small hound playfully scampers about.
              A small hound bounces mirthfully around Adeline.
              Elora grins at Dame Umichan, "In few words you have summed up the truth of our fine canine friend."
              A small hound yaps whiningly at Jerisa.
              Dame Umichan says, "Oh, I didn't know about the love part."
              A small hound moves from Merrynn to Dame Umichan.
              A small hound pads playfully to Dame Umichan.
              You suggest to Dame Umichan, "Elmer does love meatballs."
              Dame Umichan moves from Lady Amoret to one of the central dark marble benches.
              Dame Umichan pets a small hound, "That is true."
              A small hound whines approvingly to Dame Umichan.

              [a few moment later]

              A small hound yaps happily.
              You hush a small hound, "Shh, this is a gathering for art."
              A small hound skips gladly.
              You tilt your head at a small hound, "Do you speak of your love for meatballs?"
              A small hound barks at you naturally.
              You smile softly at a small hound, "I do nay speak Dog, I am afraid."
              A small hound barks at you happily.
              Dame Umichan says, "I believe that is a yes."
              A small hound chases after his tail endlessly.


              • > exa josie's snowflake
                You begin to examine Josie's a pale-blue stellar dendrite snowflake.
                This describes just how pretty This is a small snowflake ornament that is able to be hung up for display.
                OOC -- Josie says, "Don't look at my aberration ><"
                > look josie's snowflake
                I'm very pretty


                • A small hound spots a calico cat calculatingly.

                  You distract a small hound playfully with your battered meatball in Northern, "He's not on the menu, Elmer."

                  A small hound pauses dreamily.
                  Meoris Rousseau

                  Bodyservant to His Excellency, Lord Boreas

                  Junior Steward of the Treasury


                  • OOC -- Adeline says, "I had a weird cm dream >.>"

                    OOC -- Adeline says, "Queen V told Boreas time was up and all the women went on a march through the castle."

                    OOC -- You say, "CM WOMEN'S MARCH!"
                    Natasha Danaher
                    Courtier in Her Majesty's Court
                    Squire to Dame Galatea
                    Lieutenant in the Regular Army
                    Cosmetic Consultant
                    Apprentice in the Healers
                    Apprentice in the Clothiers