It can be hard to handle such cases given the weird stuff players can do in the game.
Think of an exploit where we 1 colonist and 8 slaves, and a resurrector serum. We can kill the solitary colonist, all slaves become colonists, then we resurrect the colonist. What happens?
Similar questions with cryptosleep.
There's also the notion that they might not be allied with each other at all, having been enslaved from mutually-hating factions.
Not saying there's nothing we could do better here, but it can be trickier than it looks!