If there are no Code of Conduct violations then it shouldn’t matter how many reports they received. A human moderator reviews the reports and makes the decisions on how to suspend or ban based on the behavior. There certainly are cases of human error, and you should appeal those.
Typically what happens is two rival groups bait each other into violations then report each other, the volume of votes means it moves up the queue for review, but does not impact the moderation decision.
Another point of confusion is that the notice of ban is too vague, so you might not realize it was for something you did hours earlier or something that in the heat of the moment you forgot you said/did.