[2021] Cluster Failure - 2021/04/02

We became aware of mutliple node failures due to a database issue at 15:37. We are currently investigating the cause and working to restore the game servers. More information will be made available regarding this issue as it is uncovered.

Update 15:50: Cluster is being brought fully offline with a 5 minute timer to be restarted.

Update 15:55: Database issues have been resolved, nodes are coming offline for restart. Expected return to service shortly.

Update 15:58: Currently attempting to restart cluster.

Update: 16:01: Cluster is back online, currently in VIP mode for final tests.

Update: 16:03: VIP disabled, cluster is now open once again. We will continue to monitor it for stability.

Huh, that explains why the error log buffer is filled with 86TB of “SERED HAS RETURNED, THE MACHINE GODS TREMBLE” print commands.

Server team: Points to network team

Network team: Sleeping in a wire closet somewhere, blissfully unaware of any issues

I’d try restarting your client and giving it 10 minutes or so to update the database. If you still have things missing, put in a ticket to support.