Originally posted by
ElvisT
Your response is the epitome of what is called survivor bias.
That's exactly what I would expect the data to show. The people who use it to travel wouldn't be in that area of the map as much as the people who travel through it.
I feel like before you guys continue to use data to back up what you want to see, you should look at what you're not seeing.
Take a look at where this survivor bias comes from.
https://www.trevorbragdon.com/blog/when-data-gives-the-wrong-solution
I feel like even when you guys think you get it right, and you use data to back it up, the general feedback is what really matters.
There is a lot of assumption here. Yes, if the data is really limited and for example just a heat map, you might be right, but we very much can see the difference between movement, stationary, stance, combat, kills, deaths, etc. So I can only show locations of stationary people killing with certain weapons on certain ranges and in contrast compare to people moving along and so on. The fault is rarely with the data, but how you use it.
Btw, I love that story of the WW2 planes. It's such a great example and makes for a great story, but it also known since WW2 and therefore considered. As much as someone might like to think we are a bunch of amateurs looking into data not knowing what we are doing cause it fits their narrative. I assure you we have people that do this full time and are well educated in the topic. If one believes that humans generally can't read statistical data successfully then I won't be able to change that opinion here and now.
On a last note I would like too add that we are working "data-informed" and not "data-driven". There is a huge difference and I feel it's important for game development to utilize the first form as we otherwise might lose the human factor. This is also why we are considering general feedback, but such feedback also needs to be of volume and representable.