As a member of the ten percent who plays Shepard as a Renegade, it was with some degree of disappointment that choice had been stripped back so much in Mass Effect: Andromeda, which was unpopular enough to plunge the franchise into a years-long hiatus.
I can’t help but wonder if EA sat down with Bioware in some sterile-looking board room, explaining that telemetry data suggested that most people didn’t care for, or want, a Renegade playthrough for Mass Effect, and that they should just focus on more simplistic, ultimately cheaper choices instead. I have to wonder if the same telemetry data led to choices being deprioritized in Fallout 4 as well, and other games that have removed flavor in recent years in favor of trends and “data.”
Is telemetry data making our games, well, duller?
Flexing creative muscles
Source: Windows CentralThis Twin Peaks Easter egg from Mass Effect 2’s Lair of the Shadow Broker DLC is one of my favorites.
I often think about some of the stealth features in Metal Gear Solid. Hideo Kojima games in general are a great example of games that feel intentionally filled with interactive curiosities that are there for the sole purpose of intriguing the player, and aren’t core to the experience, or even necessary. The iconic cardboard box from Metal Gear Solid is often an inconsistent tool to actually use to stealth through the game. But it’s fun, and hilarious, seeing guards react with confusion to a random box that appeared within their patrol path. The cardboard box is now synonymous with the franchise’s wider legend, and it could just as well have not been in the game at all.
Source: Windows CentralIn Monster Hunter World, you can dress up a poogie pig in various costumes. For no reason. It’s awesome.
Gears of War is a franchise I hold near and dear to my heart and remains one of the best Xbox games, but it feels fairly thin on interactivity outside of the core gameplay loop. Gears 5 began to break the mold a bit with its skiff vehicular exploration gameplay, light narrative-oriented side quests, and human hub areas. The fish market sequence from Gears 5 felt like one of the more lived-in and memorable areas in the whole franchise. Knowing Microsoft as I do, I wonder if there were arguments to scrap some of these non-combat segments, using telemetry engagement as evidence.
Engagement telemetry is biased
Source: Windows Central
I’ve written about telemetry driving Microsoft’s decision making before, watching as features get removed from Xbox Live due to “underuse,” leading to a narrower experience. We lost picture-in-picture, Kinect, TV integration, and various other features that made Xbox a richer experience, owing to “low usage.” I’m by no means suggesting features should be offered on a charitable basis. Microsoft and other big companies are businesses, and allocating resources where people are is, of course, important. However, when this mentality slips into gaming, I feel like the results can be unintentionally negative for the player, leading to games that feel lifeless and uncreative.
As a game developer, I imagine it’s not fun to hear that only ten percent of players chose one of the content paths you’d worked on through the game. But when your game sells millions of copies, that’s still hundreds of thousands of people who enjoyed those details. It goes beyond that, though.
Even for those players who chose not to experience the Renegade playthrough, it was still their choice to be a Paragon. The fact that it was a choice elevated the impact of those decisions, making the game more memorable and more evocative. If you were railroaded into playing Paragon by default, then it’s ultimately less of a role-playing game. I felt far more connected to my Mass Effect Shephard than I did to my Witcher 3 Geralt of Rivia, because the choices in Mass Effect were so much more divergent.
Source: BioWareI’m pretty sure I’m one of the only people in the world who shot Mordin in Mass Effect 2.
In some ways, perhaps social media can help eliminate the data bias that arises from using binary engagement or non-engagement data of a feature. The popularity of the Twitter account CanYouPetTheDog really proves the point I’m trying to make. This account catalogs games that allow you to pet the dog in games. As a result, being able to pet animals in games has become almost universal as a given feature of recent games that feature animals and pets.
I’m sure there’s telemetry data to suggest most people may not even notice the fact you can pet the dog, or at the very least, perhaps they only use it once or twice. From a telemetry point of view, that might not be a worthwhile feature to add — but how can telemetry measure the way a player feels as a result of engaging with some of these “pointless” details?
More pointless details, please
I’m sympathetic to dev’s time and budgetary priorities when it comes to this stuff. But when I think about “publisher meddling” and the developers I’ve spoken to, oft-frustrated by telemetry used as evidence to contradict artistic choices, I wish more publishers would adopt a more old-fashioned approach, and just trust the artist.
I wish more publishers would adopt a more old-fashioned approach, and just trust the artist.
I think telemetry is useful and important too, of course, but it shouldn’t be the be-all and end-all when it comes to making artistic choices. Telemetry based on a binary “did they use this or not” eliminates so much human nuance from the equation, and eliminates the value by virtue of a feature’s mere existence.
Xbox backward compatibility is a good example. I don’t use it all that often, but Microsoft’s efforts in this space make me feel more comfortable about buying games digitally. They make me feel like Xbox as a platform has additional value. It makes me feel like my purchase decisions will carry to future generations. I would hope data scientists at Microsoft and other companies do take some of this stuff into account, but the results often don’t seem to suggest that’s always the case.
In any case, I want to shoutout every developer that pushed to add fun little mini-games, side objectives, easter eggs, or small video game details. It’s in the minutia that we often overlook that make video game worlds feel more alive. It’s the choices we didn’t engage with that made our choices more impactful.
I am of the ten percent of Mass Effect Renegades out there, and while we may be few, my appreciation to all of the devs that contributed to those memories cannot be measured by a spreadsheet.