Swapping factions is not something you’re intended to regularly interact with. Rather it’s a failsafe. If you chose a faction, find that faction really doesn’t match your playstyle, you don’t have to re-start from scratch with a new character, you ‘can’ swap. You’re not intended to go back and forth.