Read moreI am a programmer. How about a kind of recommender system policed by the players themselves? Wouldn't that be more effective and easier to build?
Players get nominated for mod status at random initially then two mods review each case presented. When both agree the issue were founded, then reporter gains credibility and reportee loses status.
These are separate measures. Higher credibility flags players for increased responsibility in the system, such as reviewing a set of two mods' decisions for possible collusion, or reviewing a mod being upgraded to a higher tier or downgraded to a lower tier. Status works as the player from the CN server stated with the important part being that those below a certain status can not queue or are restricted on voice, all, or team chat. Then, status is gained passively over time while credibility only goes up by making founded reports, and reviewing the system and its participants.
Anything that requires a decision to be mad...
We used to have a similar system in League called the Tribunal where players could look at reported cases and render a judgement. The key challenge was that the time lag between offense and penalty was very long because of the time needed to get player reviews. When a penalty is issued days after the offense the reform rate was not great. Another problem was scale, there was a mismatch between the amount of cases players were willing to review and the cases that were available, too many cases and not enough reviewers.
So in general our approach has been to use heuristics and machine learning to do much faster detection. WR is lagging behind in this area and is my primary focus on the team right now. We had several internal attempts to bring back the Tribunal on League PC in different ways, but were not able to overcome the problems with the original system at the time.