CCP_Explorer

Tranquility proper is in a datacenter just outside London.

Probably never. This is a safeguard that all the all nodes involved have finished their work in moving you; this is the timeout when the other nodes can move ahead if there is no confirmation.

No.

Inserting more characters here since evidently a reply must be 5 characters or more.

Every time we have upgraded hardware or optimized software, then players have brought more pilots for the next fleet fight.

I wrote this with input from @CCP_DeNormalized and others.

There is only one VM in Tranquility proper, and that is a proxy for internal use only. Everything player-facing is running directly in top of hardware. We have tested using VMs for some of the smaller player-facing services and it worked fine run-time but we had issues starting the cluster since the nodes running on the VMs would lag behind the nodes running on hardware.

There are many VMs and pods running in the Tranquility Ecosystem, inside AWS. None of them existed at the time of Tranquility Tech III but have added since then, outside the simulation/game cluster.

The game cluster runs an intra-cluster heartbeat for all the nodes and then there are other tools that monitor the machines themselves, the operating system, and the SQL Server.

I’m not sure I understand the question; but all the machines run Windows Server as their operating system.

Difficult to say without knowing more details. I just tested logging in and opening a non-Jita market and it opened in a subsecond and everything was very responsive as I clicked around. This could be client-side because it needs to process your orders to highlight them but could be something else. Does the client halt, does it spin up to 100% CPU, does it log while this is happening?

There are specific nodes that handle the mapping requests that are sent via https://community.eveonline.com/support/fleet-fight/ but those are (currently) running on the same type of hardware as the TQ Tech IV “rank-and-file” machines as those machines perform better than the dedicated hardware in TQ Tech III.

The benefit of sending in Fleet Fight Notifications is that the solarsystem will be i...

We looked at many options and these choices were the best ones. You will note from the database blog https://www.eveonline.com/news/view/a-history-of-eve-database-server-hardware that I linked in this devblog that we looked at AMD choices is great detail and tested them.

We have verifiable metrics that the DB upgrade has worked well. We are still gathering data on the performance of the new solarsystem simulation hardware, it has only been a month and half in the cluster; but so far, so good.

Re. the issues you describe: Chat is not hosted in the London datacenter at all; rather it is in AWS Ireland and the EVE Client connects directly to it. Same goes for Search, and then Contrac...

No and perhaps yes. The deprecated hardware of TQ Tech III is headed for our other datacenter, where test servers are hosted. Ultimately then some of the hardware that will be deprecated there (which is then TQ Tech II or older) might get auctioned off.

I can’t stress enough that CCP didn’t do anything to fix the issues, except to complain repeatedly (and bitterly) to Deutsche Telekom for weeks, both directly and through our internal and external network partners and our carriers. Eventually Deutsche Telekom fixed the issue. If the issue is back then Deutsche Telekom has to fix it again. Please contact them, refer them to the previous incident, and ask that they look into the matter.

Hey both, can I ask where do you live (which country or state) and what ISP do you use? If you open https://eveonline.com/cdn-cgi/trace in a browser, what does the colo= reply say?

“Unexpectedly went offline” would be better phrasing as we don’t know at this time how it happened. A later investigation may possibly include discussing the incident with AWS Support.

And this year’s Winter Nexus has now been announced: Winter Nexus Returns! | EVE Online.

Last year the Winter Nexus Winter Nexus Holiday Season Returns! | EVE Online ran from 9 December.

Australian connections today (in blue) compared to week before:

image1288×567 102 KB

Starts at around 11:40 EVE Time and has recovered at 12:40.

I’m guessing Prolexic/Akamai had some issues; it matches with the timeframe:

If you hover over Melbourne in Internet Outages Map | ThousandEyes then you also see Prolexic.

That would be most welcome news if Deutsche Telekom and Cloudflare resolved this issue; a direct reciprocal peering is what we at CCP first and foremost suggested. This here still looks like it’s via Level3/Lumen but hopefully a more stable and less congested path.