Original Post — Direct link

Going on the information we have so far, The leagues system lacks most of the important features of a skill-based rating system, instead allowing people to constantly increase in rank by simply grinding the game, and will fail to actually represent a player's skill.

To see this let's look at the 'entry fees' for for each rank. At legend it's 1500 crowns, decreasing in steps of 500, to 250 at gold. We can then compare this to the average crown earnings as reported by Jesse: 650 for a poor game, 2500 for a good game and 1500 for an average game. The implication here is that anyone playing 'average' games will be able to climb to legend eventually, as the crown loss for diamond and below will always be less than the average earnings. One could even climb all the way though gold and probably plat by performing below average. While playing well will speed up the process, the need to play well can be overcome by just playing more games.

https://preview.redd.it/ryic6m4kbrp61.jpg?width=283&format=pjpg&auto=webp&s=b11dead7110e35a4485c87e238927fbe163dcb8c

https://preview.redd.it/bnr92tynbrp61.jpg?width=723&format=pjpg&auto=webp&s=57c6be6a2dde8e364068d183c6ccb27d455dd8f9

Okay but surely it will be harder to get an 'average' score at higher ranks, as you will be matched with better and better players, right? Unfortunately, I don't think so. The problem is, the system will never be able to actually work out your skill. It doesn't pay attention to your win rate; it doesn't care about the rank of who you win or lose to - it only knows your crowns. And since crowns can be earned regardless of your performance, the system cannot tell the difference between playing well and playing a lot.

For example, let's take two players in gold. The first, nayV, is a fantastically skilled player. He plays 20 games and wins them all convincingly, earning an average of 3250 crowns. The second is Jaysshan - he's not bad, but needs to work on his movement. He wins a bit under half of his games and earns an average of 1250 crowns. Luckily for him though, it's the school holidays and so he can play 60 games in the same time. Who is the more skilled player here? Who should be ranked higher? Surely nayV, with his 100% win rate, should be ranked above Jaysshan, who is playing below average. You've probably guessed where this is going, but taking into account the 250 crown fee for gold, nayV earns 3000 per match for a total gain of 60000 over his 20 matches. Jaysshan earns 1000 per match and so also manages to earn 60000 after his 60 games. So despite the apparent skill difference, both players are awarded the same rank. Worse, the system will consider them the same skill for the purposes of matchmaking.

Another issue is how skill disparity in matches is handled. This is especially important as, given the game's low population, imbalanced matches are inevitable. Most skill rating systems adjust the amount of rank gained or lost depending on the skill gap: a higher skilled player is expected to beat a lower skilled one and so in that case the change in rank is reduced, and vice versa. But let's see how this plays out in sb's leagues.

A third player, Skunklee, hasn't bothered to play the game much and so is sitting in bronze. One night, there's not many players on and so he gets matched against nayV and his 5 stack of skilled players, ranked in gold and plat. skunk's a bit rusty himself and his team are newer players also in bronze and silver. Predictably, Skunklee's team gets demolished by nayV's. Surely skunk shouldn't be punished for getting a hard match - he was 'supposed' to lose and it only proves he's ranked where he needs to be. Similarly, nayV shouldn't be rewarded for stomping weaker players. What would actually happen, however, is that skunk would earn far less crowns than normal, as he wouldn't be able to do much damage or earn many accolades against the high skilled players. On the other hand, nayV is able to earn extra crowns by earning as many accolades as possible and padding damage on the weaker players. This is the exact opposite of what should happen and further compromises the system's ability to assess skill. It also encourages stomping noobs like this and could incentivise players to play at off hours in order to find unbalanced matches, or to avoid queueing when good players are playing - neither of which is good for a healthy competitive environment.

One final thing I'll mention is exactly how grindy the system seems to be. This video from OSK goes over some estimations of how long it will take to get to certain ranks. He calculated that it would take 300-400 hours to get to legend, even assuming a 100% win rate, i.e. a 'good' game worth 2500 crowns. This worked out to be 3.5-5 hours a day, playing every day from the start, and always winning, to reach legend by the end of the chapter. It really seems that leagues is set up to be a slow grind masquerading as a skill-based ranking system. The ranks are even set up to need more and more points as you go. In this way it might seem like you're slowing down as you reach your skill level - but it's all artificial. A good ranking system should try to get you to your actual rank as fast as possible.

I think the goal of a ranking system should be solely to try and determine players' skill and rank them accordingly. There are plenty of other ways to work on adding progression, either through new systems or existing ones (chapter pass, mage rank, class rank etc.), such that progression doesn't need to be included in the ranked mode.

I understand that a lot of these numbers might be subject to change, but I think it's going to need a lot more than number tweaks to improve this system. I very much hope that leagues aren't going to be as bad as they look, so I'd be more than happy if anyone could point out where I might be mistaken or if there's something I'm missing.

External link →
over 3 years ago - /u/ogles_proletariat - Direct link

I won't pretend that we got all the numbers exactly right first try with Accolades/Leagues - we'll be watching how it plays out and can adjust many things dynamically without requiring a new patch. That said, we did a lot of real-world data analysis to determine the initial numbers.

In terms of our goals, Bronze/Silver can be thought of as introductory (since you can't lose Crowns), and Gold+ is where skill becomes the main differentiator.

A few clarifications:
* It is definitely not "just a grind" once you hit Gold+. Probably more accurate to say "you have to grind and do consistently well" if you want to hit higher tiers. You will lose crowns if you do poorly (and if we find that to not be the case, we'll adjust entry fees and accolade values to fix it!).
* The amount of crowns awarded by accolades varies by League. Some accolades (e.g. around exiling Vowguard) stop awarding Crowns altogether at higher leagues.
* Matchmaking is something we'll be talking about soon, but safe to say that the current plan is that a Bronze-tier player isn't ever going to be in the same match as a Plat player, even in the middle of the night. [[One potential exception here is due to the fact that e.g. a Legend-tier player can still party with a Bronze-tier player. We haven't finalized plans here but it's likely that higher-tier league players will be given more weight than low-tier. It won't be a simple average.]]
* Very few people are expected to hit Legend tier. It requires both a lot of time and a lot of skill. That seems entirely appropriate to me.

over 3 years ago - /u/ogles_proletariat - Direct link

Originally posted by xdrvgy

No, hitting Legend does not require a lot of skill. It requires a lot of time, but skill is optional. Skill does help reaching it faster, but you only need skill worth more than 1250 crowns per match (match cost in Diamond) to eventually reach Legend, that's the problem.

Current proposal is more like a race to rank up, not a ranked system where top leagues are exclusive to most skilled players.

Making these kind of pronouncements about skill not mattering before it's even released cracks me up haha.

The question is, what does it take to get more than 1250 crowns per match at Diamond? Once you are at Diamond it's going to be very hard to get that many crowns if your team loses, so by definition _at least half_ of players in a Diamond-ranked match are typically losing Crowns instead of gaining them.

If your issue is that the ranked system rewards players who both play more and win more, well...yeah. That's by design.