[2020] How can I avoid the “Lobby is not joinable” issue when playing with my friends??

I have experienced this issue most often when trying to party up with my roommate. Last night i tried having one of my online friends host it and we were able to join on him but the second that we both got into the party it would bug out and my online friends host would fail. I am wondering if this is happening because of some issue with out internet or if the servers are bugging out because we have similar IP addresses. If anyone has had experience with this specific issue, please let me know what has worked for you! Thanks in advance and for reading this all the way through 💯 edit: im playing on ps4, hardwired ethernet connection