[2020] Game is a stutter fest on 5700 XT GPU

So the game runs smooth in lobby and pre-game but when I get in the game, I get mini freezes constantly. It's basically unplayable. Even though my FPS shows high fps!

I play a ton of other similar games and maintain 144+ FPS, Apex legends, COD, WoW, Valorant, BL3, and a few other games with no stuttering.

I've tried Freesync on and off, Low Settings in game and ultra and neither fix anything. I've DDU'd my GPU drivers and installed fresh and latest AMD drivers. I dont run any overlays, no microsoft game bar, Windows 10 basically fresh.

This is the only game that stutters for me!

My specs:
6700k i7
5700 XT GPU
32GB Gskill Ram
MSI Tomahawk mobo
Game is on m.2 nvme drive.

I'm assuming it's my GPU? I've had issues like this in the past in certain games like Apex Legends until Respawn patched for my card.

Any ideas UBISOFT?

Thanks!