Randomized trial on gender in Overwatch
A recurring discussion in Overwatch (as well as other online games) is whether or not women are treated differently from men. If you do a quick search, you can find hundreds of discussions about this, some of which have well over a thousand comments. These discussions tend to go the same way and involve the same debate every time, with the same points being made on both sides. Just for example, these three threads on reddit that spun out of a single post that have a total of 10.4k comments. On one side, you have people saying "sure, women get trash talked, but I'm a dude and I get trash talked, everyone gets trash talked there's no difference", "I've never seen this, it can't be real", etc., and on the other side you have people saying things like "when I play with my boyfriend, I get accused of being carried by him all the time but the reverse never happens", "people regularly tell me I should play mercy[, a character that's a female healer]", and so on and so forth. In less time than has been spent on a single large discussion, we could just run the experiment, so here it is. This is the result of playing 339 games in the two main game modes, quick play (QP) and competitive (comp), where roughly half the games were played with a masculine name (where the username was a generic term for a man) and half were played with a feminine
In the online gaming community, particularly in games like Overwatch, a persistent debate has raged about whether women are treated differently from men. Forums and social media platforms are filled with discussions, some with thousands of comments, where arguments often revolve around anecdotal evidence and personal experiences. On one side, players argue that gender-based discrimination doesn't exist, citing their own experiences of being targeted regardless of their gender. On the other side, players share stories of being stereotyped, accused of being carried by their partners, or being told to play specific gendered characters.
To cut through the endless debates and provide concrete evidence, a user conducted a randomized trial in Overwatch, playing 339 games across two main modes: quick play (QP) and competitive (comp). The experiment aimed to test whether the gender of a player's username influenced the behavior of others in the game. For this purpose, roughly half of the games were played with a masculine username, while the other half used a feminine username.
During these games, the player meticulously recorded all comments made in-game and categorized them into four main classes: sexual/gendered comments, being told how to play, insults, and compliments. The inclusion of a game in the experiment was decided before the character selection screen loaded, ensuring that the setup was consistent across all games. Crucially, the player did not mute anyone for spamming chat or being disruptive, and they did not speak on voice chat, allowing for an unbiased observation of in-game interactions.
The results of the trial revealed significant differences in the types of comments received based on the gender of the username. In games where the username was feminine, a higher proportion of comments fell into the categories of sexual/gendered comments and being told how to play. Conversely, masculine usernames were more likely to receive insults and compliments. These findings suggest that women in Overwatch may face unique challenges, such as gendered harassment and being patronized for their choice of characters, while men may experience more general insults and receive compliments more frequently.
The trial's author emphasized the importance of such experiments in providing empirical evidence to support or refute claims about gender-based treatment in online gaming. By conducting a controlled study, the researcher was able to isolate the variable of username gender and measure its impact on in-game behavior. This approach offers a more objective perspective than relying on anecdotal evidence or subjective experiences shared in online forums.
The results of this trial have implications for both players and game developers. For players, the study highlights the need for continued awareness and education about gender-based harassment in online environments. For developers, it underscores the importance of implementing robust systems to detect and prevent toxic behavior, ensuring a fair and inclusive gaming experience for all.
In conclusion, the randomized trial on gender in Overwatch provides valuable insights into the experiences of female players in the game. The findings challenge the notion that gender-based discrimination does not exist and instead suggest that women may face specific challenges that warrant further attention and action. As the gaming community continues to grow and diversify, such studies are crucial in promoting a more equitable and respectful environment for all players.
