Read moreIn a game where skill matters, our most skilled designers are going to crush me with weaker decks and skew the numbers. ;)
Sheesh, what a way to call out Rubin! :P
Edit: Hijacking my own comment to add something slightly more insightful! You got me thinking just how much heterogenous skill distribution among devs is an issue during balance testing: Different skill levels of the playtesters make it hard to say if a deck has a high win rate because it is skill expressive or because it is too strong. (1)
To confidently filter that factor out instead of trying to estimate it, a huge population of testers would be needed to get a somewhat representative sample size of skill matched opponents. And all of that for every reasonable possible champ and region combination that got new cards or balance changes. Sounds unfeasible and like a massive waste of developer resources since all the time and money spent on such rigorous playtesting coul...
Frank, Aaron, and Reuben all definitely come to mind for that yeah. They’re crazy good players. :)
You’re very right that definitive balance testing is hard to get until you see it live with a big population of players, and you’re also right to call out that even then some thing s stay undiscovered for years / like the fascinating reinvention of StarCraft’s Zerg vs Terran matchup by the player Savior many years after blizzard has stopped updating the game (and pros had been calling for balance patches to solve the unwinnable matchup before Savior found the answer). Great article on that is called “god of the battlefield” if you’re interested.
This is one reason designers often focus on how a deck feels to play against and play with, because ultimately that’s what matters the most. Some strategies might be technically balanced but still feel terrible to play against, or feel totally overpowered even when the data insists they’re not. Like that time they ...
Read more