[2022] The game is almost unplayable in VR, any tips ?

After months of playing "vanilla" Phasmophobia, I decided to give the VR a go. Things were fun in the lobby but when my friends and I tried to play, oh my GOD !

Everytime I left or entered the truck the game would load for 3 seconds, same things when going in a room with a window. The game runs fine most of the time but it just asks me to wait 3 to 5 seconds EVERYTIME it has to load something and it's incredibly infuriating. Do you guys have some tips to make it stop ?

My specs :
Oculus Quest 2, via Airlink
Nvidia RTX 2060 6gb
16gb ram
CPU Ryzen 5 3600