Hey NO_TOWER, welcome to the forums!
In windowed or borderless mode, the game is part of your desktop, and so needs to use your desktop refresh rate. You'll be able to change this in Windows itself, and
here's Microsoft's guide showing how this is done.
Let me know if that resolves this for you