[2021] Use base spec to ulock all elite traits or use elite spec from level 80?

Casual player here. I recently bought PoF and just levelled a new character to 80 (not boosted). I'm keen to try my profession's elite spec but I'm worried that I might be hamstringing myself by using it in my build before I've collected all the hero points needed to unlock the full potential of the spec. Is it recommended to use one's basic / classic spec with 3 fully-unlocked trait lines to earn the hp necessary to unlock the elite spec(s) and then switch? Thanks

Edit: Summarizing responses: stick with base spec if playing instanced group content or soloing harder content e.g. HP sites in HoT where champions spawn. Play the elite spec as you unlock it if you can join a HP train or plan on soloing the commune-only HP spots