[2021] Can i not reconnect without restarting the game?

No, you should be able to reconnect if you disconnect randomly. It is possible that if your internet goes out for a particular amount of time, you may have to restart since it'll load you back in as offline when you reach the main menu.