aeneia

aeneia



09 Oct

Comment

Originally posted by not_panda

Is the "I don't understand how multiple currencies work" sentence intentional? Because I do understand how it works but I still hate it and it puts me off a bit usually. So I really wouldn't know if I should pick it in the last question or not.

This is intentional, yes! If we find that this isn't an issue at all for players (and it's just wasted space on the survey), that question may very well get replaced with something like "Riot has too many alternate currencies." I won't know until I see the data!

That said, a massive overhaul of all our alternate currencies makes me want to cry lol...RIP.

Comment

Originally posted by Bibidiboo

Why would you continue to revise a survey after release? That invalidates the earlier results, because a change in wording or anything will mean the results could have been different for earlier surveyors and should not be used..

For this survey in particular, we're doing an "alpha" release from now until December in just a couple of regions. The finalized version of the survey will be ready to go at the start of 2020. Yes, we won't be able to track things longitudinally for these first three months. However, we'll be able to get some preliminary information (like, "What is seriously on fire right now for our players?) to help make more immediate decisions.

That way, once the survey is fully ready and good to go, we'll be confident that we're asking the right questions in the right way.

Comment

Originally posted by AJediKnight

Hey there!

I am a little curious about the decision to use Max Diffs instead of a rank ordering question when you only have 4 items per set. Rank ordering is normally fine until you have seven or more items, and would offer more detail. Was it just a matter of your initial question being more focused on extreme preferences? Maybe you already had a vague estimation of preferences (which seems likely), and designed the survey moreso for clarification?

Hey there! Asking players to rank-order a set of 4 questions 12 times (or even like 6) is a HUGE cognitive ask! It probably would take them half an hour to have filled out the survey. We try to keep our surveys shorter, when possible, to respect player time. Also, Max Diffs work either by selecting the "most" option, or the "most" and "least" option. Sawtooth software doesn't currently offer a "rank the full set" option, although that would theoretically reduce the amount of screens we have to show. We use the "most" and "least" because it gives us the most data possible.

As for the vague estimation of preferences, we know that we (as Rioters) have a super different experience of the game than players. This is especially true of PIE, the team who works on things like Skins, Loot, Event Passes, and other in-game products. We want to make sure we don't bias the results by assuming our understanding is representative of player experience.

Thanks for the question :)

... Read more
Comment

Originally posted by cursdonemoretime

"Filtering out troll responses"- i guess people who are unhappy with current state of the game are trolls now

Hey there! Troll responses are responses that are invalid, and do not reflect real-world behavior. For example, if a player says, "Yes, I've purchased an Event pass," but they HAVEN'T actually purchased an Event Pass, it indicates that they aren't answering the survey honestly. That would be a "troll" response.

If a player says, "Yes I've purchased an Event Pass, and I f*cking hate them. They're terrible. Riot you suck." when they HAVE actually purchased an Event Pass, that is NOT a "troll" response, and would therefore be treated as a valid player opinion.

I hope this clears things up :)

Comment

Originally posted by JinxCanCarry

It's to make sure the person is actually reading the questions/answering honestly.

If they are answering wrong to objective questions you already know the answer to, then the result of the rest of the survey is probably not accurate either.

Think about this in real life. If you asked somebody what their name is and they lie to you even if you have it written in front of you, wouldnyou trust what they say afterward?

*fistbump*

Comment

Originally posted by akigo57

I'm familiar with MaxDiff and it works really well for preferential options. The example the Sawtooth gives is ice cream flavors I believe?

Interestingly enough the same process is often used for other online tools to help you narrow down your "favorites" for various things. The Pokemon Picker is a good example.

However that's most effective in my experience when comparing preferences on like things that tend to be on equal ground objectively. I'm not entirely sure that translates well to this particular survey.

> There's more to the repeated questions than just filtering out troll responses

I am aware of this. My original post doesn't object to repeating specific options at all.

Thanks for replying! I didn't think you were objecting, but I think I misinterpreted your comment: "By repeating questions and options you can better ensure consistent responses to gain more accurate results. This combats people who just click through a survey without reading it." as being limited to just addressing click-through ("troll") responses, not being essential to the design of the survey. My apologies there for misunderstanding.

As for your point on objectivity, I'd love to see any academic papers you can point me to so that I can better understand your point. While objectively equal and subjectively different items would be IDEAL for a super clean Max Diff, I've never read anything to suggest that its methodology is inappropriate for something like this.

I don't want to dive too deeply into Reddit debates, so I'll probably sign off here. I appreciate your input -- this survey is iterative, so we're continuing to improve it (design-wise and pla...

Read more

08 Oct

Comment

Originally posted by 25chestnuts

You could really use some rewording for that last section too. Either reword each option as a problem, or reword the question as "Tick all options you find to be true".

Thanks for that! We're continuing to revise this survey as results come in, so it's still very much in the editable phase. Knowing that this is confusing or feels bad is super valuable. Thanks again :)

Comment

Hi there!

I'm Riot aeneia. I designed, wrote, and launched this survey.

I can't address everything you've brought up here, but I did want to mea culpa something, and hopefully provide a little education:

  • That first question, about how recently you purchased in-game content. That was my bad. I forgot to include the option for "It's been more than a year." I done f*cked up there, and I'm sorry to make anyone feel like their historical purchases weren't important :(.
  • As for the rest of the survey, I'd encourage you to look up Choice Based Modeling and Max Diffs. They're pretty brilliant methodologies that help us to prioritize different concerns. (And, yes, we know that something being knocked to the bottom of the list doesn't make it a non-issue. It just means it's less of an issue than the other things above it.)
  • There's more to the repeated questions than just filtering out troll responses ;). Like I said, do some research on Max Diff...
Read more

20 Sep

Comment

Originally posted by DiscountBot

Human made sales decision without me.

I.AM.OBSOLETE

Is...is this Mr. Farmer himself?

Comment

Originally posted by Riot_Usury

Do... Do you know me?!

Can confirm. "I can't stop giggling about it." His exact words. Then he linked me to this thread.
I'm not sure which tickles me more. The release, or knowing how giddy it makes Usury.


22 Aug

Comment

The year was 2012. I was a senior in college. I'd recently made some new friends, and one of them introduced me to the game.
I played my first game as Teemo. It lasted 72 minutes.

SEVENTY.

TWO.

MINUTES.


26 Jul

Post

Hey everyone! Riot aeneia here, Researcher on the Skins team. At Riot, we talk a lot about "Player Value" -- and, as Rioters/Gamers/Game Devs, we all have our own ideas about what that means.

I'm curious: What does it mean to YOU? (Specifically with regards to the stuff you buy in game).

If you're not sure what I'm asking here, here are some prompts:

  • What makes a buy feel good?
  • What's your favorite thing you've bought , and why?
  • What makes a buy feel bad?
  • What kinds of things make you regret a buy?
  • What can we do for you, the consumer/player, to help you feel like we've got your back?

Thanks for your input :) Just hoping to bring some fresh perspective to the table.

EDIT: I don't work on the balance team EDIT 2: I just want to say thank you all for the really thoughtful replies. This level of engagement and detail really gives me something to work with. In case you're curious, this is informin...

Read more External link →

25 Jul


22 Jun

Comment

Originally posted by Sneikss

Aah, thanks for noticing me! : >

Really considered Lion dance, but ultimately didn't make the cut because I think it's a really solid skin as it is. That being said, A rocket or something on his back with fireworks spewing out of his mouth seems like a great idea...

fair enough :) Either way, awesome work!

Comment

Originally posted by RazeULikeaPhoenix

did you see the Singed VGU thread from a week back?

that one actually had a really good one thats not too far fetched from what players are already comfortable with. https://www.reddit.com/r/leagueoflegends/comments/bzn51c/singed_fan_vuredesign/

I like this!! Thank you for sharing!


21 Jun

Comment

This is really cool! I love when players re-envision our champions...especially to make them more "canon" or appropriately fitting to our universe.
Keep working towards your dream!
PS - I love liondance kog'maw :) Any chance you drew that one up?


02 Jun

Comment

I'm an Insighter who works on the Skins team, and Riot Sirhaian is one of the most amazing people I've worked with. His craftsmanship is out of this world, and he's always looking to make something that wows and delights our players.

...no, that's not right.

...He's always looking to BLOW OUR F*CKING PLAYERS' MINDS. (!!!!!!!)

It makes me so happy to see him getting some special recognition here. He deserves it. Way to go, Kevin!


01 May

Comment

Thank you. It's really nice to know we have people out there who understand that we're in a difficult position. Moreover, you go out of your way to explain that to people. I appreciate you.

Comment

Originally posted by emojiexpert

They do both. In a perfect world for Riot, they would never need to make a skin for a champ like Aurelion Sol. Making skins is costly as f**k, and it's an investment for Riot. Making a skin for a champ whos players will most likely not buy it, or who has too few players to justify making a skin for is basically just a PR move.

If you were an investor, why would you want to make risky investments like an Asol skin when you can print money with Lux skins?

I think you underestimate how much it costs Riot to develop a skin. The team that works on a skin is like 10 people+ (afaik). That's a small company in itself.

<3 This.