1 of 2 < >

Co-Lo Stability Problems

Unfortunately, our co-lo had some stability problems Friday morning.

First up, they lost all of their connectivity to the facility that holds all of our games. This took them about 40 minutes to diagnose and a bit longer to restore.

Much more astonishingly, they rebooted all of their machines (which means all of our machines) while they were fixing the problem, with no notice. This probably had minimal repercussions on the SkotOS games (Marrach, Ironclaw, Lazarus, and Lovecraft). There may have been a rollback of an hour or two.

TEC and Grendel's Revenge are more troublesome. TEC will suffer a rollback of 10 hours, to midnight (PT) last night, since the unannounced reboot happened one hour before the next backups. GR suffered a more complete failure. We're being forced to restore the entire machine from its backups, then we'll need to restore the game from the backups stored within that backup. The lineup of dates look promising (which is how we laid them out, 'lo these many years ago), so the hope is that we'll only suffer a 7 hour rollback, to the 3am (PT) game backup, but it's a bit dicey at the moment.

Apologies for the inconvenience; we're now making sure everything is stable, and we're looking into whether our most recent upgrades to TEC will support increasing the backups to every 6 hours.

Edit: The GR problem is proving even more intractable than hoped. As best I can tell, our colo is still having some issues because I can't boot the first restore I made of GR and I can't build a new node either. I expect this will just clear when they get their act together, but in the meantime I'm not able to get GR back online until they fix these problems.
2 of 2 < >

Grendel's Revenge Free Accounts

On December 15th of 2012, Grendel's Revenge enabled free accounts for play. This announcement is following in the suit of TEC's own free account announcement, serving as a reminder to any new or returning players that are browsing the forums.

For all the details about what free accounts are, look no further than here:

In order to log into GR for free, simply visit this page to sign into your Skotos account (ignoring any subscription notices it may give):

Then click the following link for Zealotry/Firefox:

Or this link for Alice/Internet Explorer:

Problems? Questions? You can email the GR staff group at
See more
See less

[UPDATED x2] Grendel's Revenge Downtime: Friday, 12.30-8.30 pm PT

  • Filter
  • Time
  • Show
Clear All
new posts

  • [UPDATED x2] Grendel's Revenge Downtime: Friday, 12.30-8.30 pm PT

    (Copied from the Announcements.)

    Update 2: Unfortunately I was unable to complete the move because I couldn't get the clients working right on the new server, due to some incompatibilities caused by upgraded server software. I've restarted the classic server and it should be available again soon, when DNS catches up. In the meantime, I'll be working to figure out how to make the clients run. There will need to be some future downtime when I try this again.

    Update: I've been having some problems with transferring GR because of the very large size of its files. (It has larger files than any of our other games.) At this point I think I have a process in place that's going to successfully move the files over, but it's looking like it's going to take a few more hours to complete. So, rather than starting over at some later time (and having to do the last 2 hours or so of work again), I've gone ahead and extended the window to 8.30pm PT. Sorry for the inconvenience!

    We are scheduling a maintenance window for Grendel's Revenge this Friday, from 12.30pm to 5pm PT. We will be moving Grendel's Revenge to new hardware within this window.

    We've already tested out the hardware on Lazarus Project, Lovecraft Country, our test version of TEC, and our RPGnet site and we've been very pleased with the results. Speed has been faster and the network generally appears more reliable, so we're looking forward to some of these same improvements on Grendel's Revenge. However, GR is our one game with a codebase that is somewhat untested on the new platforms, so there is some chance for upset.

    In the coming weeks we'll be moving the rest of our games and other services to our new computing platforms, so expect some other disruptions. I'm hoping to move the major elements to the new platforms by the 31st, with minor stuff to catch up in the weeks that follow. I'll post updates on the precise schedules for next week's moves on Monday.