[2022] Should I retrain my 15 point Benson Captain to Fletcher?

Commanders can only be "Trained" for one Tech Tree ship at a time. So moving him off the Benson to the Fletcher does mean he'll be strictly a Fletcher Captain.

Premium Ships don't have to be "trained" for, so he'd be able to helm your Arizona regardless of which DD he's trained for.