[2020] GPU usage drops from ~60% to >30% causing low FPS

After long break I've decided to play EFT again but I have a problem. After 2 minutes in raid the GPU usage drops causing my FPS to drop from over 100 to 42. Never had this type of problem in any game before so I really need help here. GPU temperature is 50-60 C while in game.

Link to screenshots in game + settings (PostFX is disabled) : https://imgur.com/a/6ivkPTs

My specs :

CPU : i5-7600k

GPU : GIGABYTE 1060 6gb OC

32 GB of RAM

I do have SSD ofc

Edit: This happened in offline mode but in online everything runs fine