Outage – December 5 – Resolved

Hello,

We experienced a server failure on December 5, 2017 at around 2pm UTC on our primary server (SRV1).  Our secondary services such as TeamSpeak were affected as the Database is hosted on the server that failed.

We had contacted the host to perform a hard reset, while this did bring up most of the services our database wouldn’t come back online. We performed a database reset and were able to get it successfully restarted. All services are now operational again. If you’re unable to connect to our TeamSpeak, or are getting an error message “database error” please close and re-open your TeamSpeak, this will allow you to reconnect.

Update 2:53pm UTC – The issue was caused by a automatic migration as the host was being updated. However there was a kernel update in progress while the migration was being performed, doing this caused the migrated system to freeze and crash, as the kernel was “incomplete” there was then a boot loop issue as a result. The kernel was automatically restored to a working version, and the server was able to be restarted. I will be keeping a close eye on the system just in case.

Sorry for any inconvenience!