So what's the line of thinking here. Does the game magically become a space sim every time my dampeners get shot out? Does it revert back to whatever once I fix it? lol
It's just a general term.
The procedural generation of levels isn't designed around a realistic portrayal of space, but rather a clustered variety of obstacles and enemies. When your inertia dampeners are damaged, aiming is far more challenging and movement is restricted in a way that makes exploring tight points of interest really difficult, thus removing your ability to gain resources quickly and carefully. The game doesn't "magically become" something else, but rather hinders mobility until the component is repaired.
Sure, some players can deal with the component damage. Which is the same with other components being damaged (i.e. an evasive player doesn't mind their shields being damaged because they rarely get hit anyway).
You should be proud you're skilled with drifting to where this handicap doesn't affect you as badly as it does other players.