devtrackers.gg
over 2 years
ago -
rocket2guns
-
Direct link
Will keep you updated. apologies.
I will post live updated here. Please try keep the memes in this thread, so that we don't clutter up the forum too much.
3:26 AM Seeing a lot of errors in the logs. No clear idea of what cause is yet. SQL showed a sudden spike preceeding event. Then returned to normal. Not outright down, but degraded to the point everything times out. More to follow.
3:33 AM Im giving the engineer space to work, but he told me he has restarted everything and that might help things while he investigates the problem. I'll give him the space he needs, report to you when I can. I have now loaded successfully into a prospect.
3:38 AM okay im kicked from the prospect, like others, after loosing connection. Engineer is investigating. Restart didn't fix it, so needs to take a close look at it. Tough work for him so I'm giving him space - sorry folks - only can be patient now I know thats not easy.
3:41 AM investigating why the queries are timing out. let's get some F paying respects in the thread for the engineer who's working hard
3:44 AM yep - I agree with the comments from some we should have caught this kind of stuff in the beta, but didn't. will be plenty of time to kick ourselves later - right now we focused on getting you all back in and running as fast as we can. i am very sorry for the outage now. working hard as we can
3:51 AM SQL server is restarting. engineer didnt tell me im just watchin it on the monitor. is that a good sign? maybe. im goin got say it is. okay he just told me hes restarting it. ill act surprised
3:53 AM Okay SQL says available. trying to resist the urge to ask eng for an update. But I been there myself. He needs space to work. I'll send all the F's his way in a screenshot!. Thanks all for you patience - this is very crappy I know.
3:59 AM now its the engs turn to wait as I try and load in to test some stuff for him. oh how the tables have turned.
4:01 AM worked for a bit, connection issue again - sorry folks we're still trying to find the reason for this.
4:03 AM from the eng ok the issue is definety seems to be timing out connecting to sql but we don't know why and we can't see specific queries timing out. im too 3am. wait its 4am.
4:05 AM deleted some ascii penises in chat on discord while i wait. living the ceo high life.
4:07 AM the sql server seems just fine. its barely under load. in fact, its less under load that it was before this happened. not by much. we're normally only touching like 6-10%. its been stable the whole way through. so curious.
4:15 AM okay this might have helped, cant say the changes we have made opsec and all that. but we have a theory, and its possible maybe working perhaps.
POSSIBLY BACK WORKING - WE WILL KEEP LOOKING INTO IT. EXTREMELY SORRY FOR THE OUTAGE.
I will post live updated here. Please try keep the memes in this thread, so that we don't clutter up the forum too much.
3:26 AM Seeing a lot of errors in the logs. No clear idea of what cause is yet. SQL showed a sudden spike preceeding event. Then returned to normal. Not outright down, but degraded to the point everything times out. More to follow.
3:33 AM Im giving the engineer space to work, but he told me he has restarted everything and that might help things while he investigates the problem. I'll give him the space he needs, report to you when I can. I have now loaded successfully into a prospect.
3:38 AM okay im kicked from the prospect, like others, after loosing connection. Engineer is investigating. Restart didn't fix it, so needs to take a close look at it. Tough work for him so I'm giving him space - sorry folks - only can be patient now I know thats not easy.
3:41 AM investigating why the queries are timing out. let's get some F paying respects in the thread for the engineer who's working hard
3:44 AM yep - I agree with the comments from some we should have caught this kind of stuff in the beta, but didn't. will be plenty of time to kick ourselves later - right now we focused on getting you all back in and running as fast as we can. i am very sorry for the outage now. working hard as we can
3:51 AM SQL server is restarting. engineer didnt tell me im just watchin it on the monitor. is that a good sign? maybe. im goin got say it is. okay he just told me hes restarting it. ill act surprised
3:53 AM Okay SQL says available. trying to resist the urge to ask eng for an update. But I been there myself. He needs space to work. I'll send all the F's his way in a screenshot!. Thanks all for you patience - this is very crappy I know.
3:59 AM now its the engs turn to wait as I try and load in to test some stuff for him. oh how the tables have turned.
4:01 AM worked for a bit, connection issue again - sorry folks we're still trying to find the reason for this.
4:03 AM from the eng ok the issue is definety seems to be timing out connecting to sql but we don't know why and we can't see specific queries timing out. im too 3am. wait its 4am.
4:05 AM deleted some ascii penises in chat on discord while i wait. living the ceo high life.
4:07 AM the sql server seems just fine. its barely under load. in fact, its less under load that it was before this happened. not by much. we're normally only touching like 6-10%. its been stable the whole way through. so curious.
4:15 AM okay this might have helped, cant say the changes we have made opsec and all that. but we have a theory, and its possible maybe working perhaps.
POSSIBLY BACK WORKING - WE WILL KEEP LOOKING INTO IT. EXTREMELY SORRY FOR THE OUTAGE.