This is intended. Clicking on another player's name should only present options relevant to that player. Having the "Leave Party" option there was not sensible and caused accidental misclicks. You can still trivially leave parties by clicking elsewhere.