almost 3 years ago - Tosch - Direct link

Hello there,

while we are investigating the currently ongoing coin compenation for players we are putting all worlds for the EU Central region into maintenance mode. Once we have an update we will post it here.

We apologize for the inconvenience.

almost 3 years ago - Tosch - Direct link

Update:
We are still investigating the incorrect player coin compensation and working on a rollback for all affected characters in the EU Central region.

Unfortunately we don’t have an ETA when the rollbacks are finished, but we will keep you updated once we have additional news.

almost 3 years ago - Lane - Direct link

Hello,

First and foremost, the servers are coming back up shortly.

I’d like to take a moment to explain what happened. After our patch early this morning, a separate database modification in EU was executed to grant catch up funds for players affected by in-game tax losses since the November feature release. This database change mistakenly granted very large sums not reflective of the intended amounts. Many players then spent that money, often buying large amounts of items off the trading post. As soon as we realized the error we took the EU worlds offline at 3:00PM CET to diagnose what could be done to correct it. Upon examination, it was clear that there was no clean path to reversing only the players who were granted money, as the secondary effects were widespread and involved many more players and systems. We therefore made the decision to roll back characters, companies and the trading post to 12:45PM CET, which is just before the database modification was implemented.

The trading post contracts take longer to address than character or company data. In the interest of time, while the trading post database is being restored we have made the trading post unavailable until that operation is complete. This change impacts only the trading post, and other forms of wealth transfer such as player to player transfers, house payments and company income are available and unaffected by this temporary change. While this is in progress the trading post listings will not reflect their final restored state. We are already in progress on this work but don’t yet know the full time required. Once complete, all of the contracts will be restored and the trading post will reopen. This will not require a patch but may need a brief restart.

While testing, we discovered an issue where a small number of players who transferred between 12:45PM and 3:00PM CET are stuck in a “character_restore_failure” state. We are aware of the exact players affected and working to correct this state. We will have an update here once it has been resolved.

I know the downtime is frustrating and I apologize for it. The time was spent working on the least rollback impact we could have, and finding the path where no loss of data would occur.

Lane

almost 3 years ago - Luxendra - Direct link

To be clear, no items will be lost from the trading post being disabled. Any items that appear to be missing will be restored after this data operation on the trading post.

almost 3 years ago - Lane - Direct link

Quick update – We believe we have found and resolved the players who transferred being stuck issue due to the rollback. If you encounter this, please let us know.

Lane

almost 3 years ago - Lane - Direct link

Hello,

I have another quick update. We have continued to work to resolve the trading post contracts issue, we now know this will some take time and then we’ll need to test and verify the results. This will not be resolved today. We will update you when we have more information. I apologize for the delay.

Lane

almost 3 years ago - Lane - Direct link

Tonight we will attempt to restore the trading post to its state on November 24th at 12:45PM CET (the rollback point for the affected servers). There is a significant amount data involved and the scripts will take several hours to complete. You may notice items starting to appear in the trading post (even though you can’t purchase, sell or remove them). Once the script is completed and validated through testing, we will unlock the trading post. Turning the trading post back on will require a restart.

Lane