Tomorrow, Saturday April 11 2009, at approximately 1 a.m. ET the server running Settler IV will be taken down for maintenance. The process is expected to take a couple of hours. During most of the maintenance all services hosted on Settler IV will be unavailable. This includes all hosted sites and all site sections.
During the downtime status updates will be posted at our off site service interruption log: https://apolyton.wordpress.com/
HTTPD stopped working sometime this morning (was not working as of 10am ET). Did not come back up after repeated attempts to restart it, so Settler4 is being rebooted and further troubleshooting is underway.
The Apolyton Server, Settler IV, will reboot today at 1:30 AM. (In about 3 minutes.) The expected downtime is 10 minutes.
Gramphos took down Apolyton 2.0 due to issues with HTTPD and MYSQL. The post table in MYSQL got corrupted, and he is attempting to repair it (OT showed no posts on the first page at the time). It is going slowly.
Separately, HTTPD/Apache is causing huge memory leaks, to the point that after about 20 minutes of runtime, 2GB RAM and 2GB Swap are taken up, at which point the server crashes. He took down HTTPD to ensure that the server wouldn’t crash while attempting to rebuild the post table.
Once it is done rebuilding, if someone notices please restart HTTPD.
Just to follow-up on what you probably already knew: the problem seems to have gone away, the site has been continuously reachable since shortly after my previous post. All services have been fully restored. If you’re still having problems, please let us know in the comments.
The purpose of this blog is to keep the Apolyton Civilization Site community informed of what’s going on during (planned or unplanned) server downtime — which is hopefully rare but from time to time unavoidable. By maintaining this blog off-site we can keep the lines of communication open when everything else fails. It does not replace our Maintenance and Service Interruption Log but rather supplements it when the forums are unreachable.
Whenever the site is down we will let you know what’s happening here as soon as we find out ourselves (which will be in advance of the outage if it’s planned, as soon as possible afterwards if not) and keep you up-to-date as we work to bring the site back online.
If you cannot get to the site but see no update here, feel free post a comment to this entry to ask what’s going on. If it’s an issue on our end we will post a new blog entry to provide details and allow for further discussion as soon as possible, if not we will try to help you figure out the problem if we can.
You can subscribe to the RSS feeds at the bottom of the page to be automatically notified of updates to this blog through your news reader, or use it in combination with a service like RSS FWD to receive email notifications.
Apolyton Off-Site Service Log 