It definitely seems to be working correctly. I got the Fragments of the Shattered Lance after my 6th attempt which is in line with a 15% drop rate.
Are you doing anything wonky after you see the boss loot drop like quickly closing the game or exiting the client?