I don't think they test it 3 times (online, offline and true offline), and sometimes the latency also matters
I just went back and tested all 3 right now. I can't repro this to save my life. I'm not sure what I'm doing right or wrong to make this not happen but it's definitely intermittent. We have ways to artificially inject latency with our staging client that they will check this on. I just wanted to see if I could see it on the live client because I haven't noticed it in editor at all recently and this change has been done internally for much longer.