Co-Lo Stability Problems

Unfortunately, our co-lo had some stability problems Friday morning.

First up, they lost all of their connectivity to the facility that holds all of our games. This took them about 40 minutes to diagnose and a bit longer to restore.

Much more astonishingly, they rebooted all of their machines (which means all of our machines) while they were fixing the problem, with no notice. This probably had minimal repercussions on the SkotOS games (Marrach, Ironclaw, Lazarus, and Lovecraft). There may have been a rollback of an hour or two.

TEC and Grendel's Revenge are more troublesome. TEC will suffer a rollback of 10 hours, to midnight (PT) last night, since the unannounced reboot happened one hour before the next backups. GR suffered a more complete failure. We're being forced to restore the entire machine from its backups, then we'll need to restore the game from the backups stored within that backup. The lineup of dates look promising (which is how we laid them out, 'lo these many years ago), so the hope is that we'll only suffer a 7 hour rollback, to the 3am (PT) game backup, but it's a bit dicey at the moment.

Apologies for the inconvenience; we're now making sure everything is stable, and we're looking into whether our most recent upgrades to TEC will support increasing the backups to every 6 hours.

Edit: The GR problem is proving even more intractable than hoped. As best I can tell, our colo is still having some issues because I can't boot the first restore I made of GR and I can't build a new node either. I expect this will just clear when they get their act together, but in the meantime I'm not able to get GR back online until they fix these problems.
See more
See less


  • Filter
  • Time
  • Show
Clear All
new posts

  • Error?

    I got an email saying the trial game has started, go to game portal, click Game under Play and all I get is

    Content-Type: text/html
      <title>Galactic Emperor: Hegemony 1074: Trackn</title>
      <META HTTP-EQUIV="Pragma" CONTENT="no-cache">
    <style type="text/css">
    TD {font-size: 9pt; font-family: verdana,arial,helvetica}
    <body bgcolor="000000" text="000000" link="OOCC33" alink="OOCC33" vlink="OOCC33">
    <center><table border=0 cellpadding=0 cellspacing=10 width=770>
    <tr><td align=center colspan=2><a href=""><img src="../images/freebanner.gif" width=750 height=60 border=0 alt="Galactic Emperor: Hegemony"></a></td></tr>
    <tr><td colspan=2 align="center"><font color="red"><b>Game 1074 has not started yet!</b><br>Game starts in 1 day, 4 hours, 14 minutes.</font><br>
    <tr><td valign=top bgcolor="999999">
    <table width="100%" border=0 cellpadding=10 cellspacing=0>
      <tr bgcolor="666666">
        <td align=center><img src="../images/commandbuttons3.gif" width="196" height="171" border="0" usemap="#buttons">
    <map name="buttons">
    <area shape="rect" coords="0,0,196,38" href="" title="Refresh this page" alt="Refresh this page" >
    <area shape="rect" coords="0,38,98,60" href="" target="_blank" onClick="'','Dispatch','menubar=no,scrollbars=yes,screenX=50,screenY=0,left=50,top=10');return false">
    <area shape="rect" coords="98,38,196,60" href="" target="_blank" onClick="'','Orders','menubar=no,scrollbars=yes,screenX=50,screenY=0,left=50,top=10');return false">
    <area shape="rect" coords="0,60,98,83" href="" title="Purchase items" alt="Purchase items" onClick="'','PurchaseItems','toolbar=no,width=675,height=525,status=n
    refreshed and refreshed again...

    <Morphius thinks aloud: Would Aelavius, Jacie, Reever, Atre, Sarian, Anaya,
    Dracuul, Psilac, Bobith, Jepta, Ryback, Coppernicus, or Agnus be available?>

  • #2
    I got the same error when I tried to play in Firefox 3. Internet Explorer works fine, though.

    Since the last time I was able to actually play was before Firefox 3 came out, I'd speculate that some new standard it recognizes is interfering with the game code. Well, that's my best guess at least, but take it for what it's worth. (The guess of an amateur.)