How One Video Game Company Is Leading the Charge Against Online Harassment

What Women Really Think
May 16 2014 3:49 PM

How One Video Game Company Is Leading the Charge Against Online Harassment

League of Legends gamers learn to play nice.

Photo by Lionel Bonaventure/AFP/Getty Images

Over the past several years, video game enthusiasts have gained a reputation for cultivating a culture of casual nastiness, lodging virtual rape threats at one another and lobbing lewd comments into the void—a norm that disproportionately affects the outnumbered women in that world. But as Laura Hudson describes in an excellent piece in Wired this month, that dubious achievement has actually inspired many gaming communities to take a harder look at their harassment problem than other online spaces have. Now, while massive Internet communities like Twitter lean back with a laissez-faire approach, these gaming companies are leading the field in addressing online harassment by lending resources to research the problem, innovating new techniques to solve it, and testing them out in the crowd.

Hudson focuses largely on the work of Riot Games, the publisher of League of Legends (a game whose players were, as of 2012, more than 90 percent male). Riot realized two years ago that “a significant number of players had quit the game and cited noxious behavior as the reason.” So it launched a “player behavior team,” employing “staff members with PhDs in psychology, cognitive science, and neuroscience to study the issue of harassment by building and analyzing behavioral profiles for tens of millions of users.” Riot found that nastiness was a communitywide problem: “If we remove all toxic players from the game, do we solve the player behavior problem? We don’t,” said Jeffrey Lin, Riot’s lead designer of social systems. Persistently bad-behaving players only produced 13 percent of the harassment on the site; the remainder of harassment was lodged by “players whose presence, most of the time, seemed to be generally inoffensive or even positive.” The takeaway: “Banning the worst trolls wouldn’t be enough to clean up League of Legends. … Nothing less than community-wide reforms could succeed.”


To remedy the problem, Riot switched off its default feature that allowed opposing players to chat with each other during games. Asking players to opt-in to chatting instead led to a 30 percent drop in harassing behavior and a 35 percent rise in positive interactions. Riot also found a way to reduce recidivism rates among its harassing users by clearly spelling out its justification for suspending users over offensive comments instead of just quietly banning them, which led to a rash of apologies from players, many of whom said they didn’t think before they spoke or didn’t fully understand the impact of their comments. (Riot says it’s since lifted 280,000 gamers from offender status to upstanding members of the community.) And it put the responsibility for policing this behavior into the community’s hands, creating a “Tribunal” of fellow players who vote on reported incidents of harassment and decide whether they constitute true offenses. While this sort of system is not perfect—is a community that’s inundated with casual cruelty really equipped to recognize that behavior as damaging?—Riot found that its experts concur with the Tribunal’s decisions almost 80 percent of the time. Also testing out new strategies for attacking the problem is Xbox, which uses player feedback to determine “whether a user gets rated green ('Good Player'), yellow ('Needs Improvement'), or red ('Avoid Me'),” giving other players the tools to get around interacting with abusive members.

These experiments provide a few lessons for other online communities that haven’t been so successful in establishing positive community norms. The first is that establishing positive community norms is important! As gamer, cultural critic, and recipient of extreme sexist harassment Anita Sarkeesian notes, at Twitter, vile sexist comments like “I hope you get raped” are often not even treated with a slap on the wrist; they’re ignored completely by a system that only sees criminal threats as worthy of moderation. This is a bizarre standard—as Hudson points out, if a person yelled “I hope you get raped” in an office or crowded restaurant, they’d be asked to leave, and the Internet is a community like any other.

Another takeaway is that, as Hudson puts it, “Creating a simple hurdle to abusive behavior makes it much less prevalent.” If users have a clear incentive to play nice, they stay in line. But to me, the most important aspect of Riot’s approach is that it involves dealing directly (and even compassionately) with perpetrators, victims, and bystanders of this harassment. Many online communities are focused on attempt to appeasing abused users with personal muting or blocking buttons (thus freeing harassing members to go on to harass other users). Others take a hardline approach where users are either 100 percent welcomed or else forever banned with no wider discussion. But Riot’s experience shows that a community problem responds best to a communitywide solution.

Amanda Hess is a Slate staff writer. 



Crying Rape

False rape accusations exist, and they are a serious problem.

Scotland Learns That Breaking Up a Country Is Hard to Do

There’s a Way to Keep Ex-Cons Out of Prison That Pays for Itself. Why Don’t More States Use It?

The Music Industry Is Ignoring Some of the Best Black Women Singing R&B

How Will You Carry Around Your Huge New iPhone? Apple Pants!


Theo’s Joint and Vanessa’s Whiskey

No sitcom did the “Very Special Episode” as well as The Cosby Show.


The Other Huxtable Effect

Thirty years ago, The Cosby Show gave us one of TV’s great feminists.

Cliff Huxtable Explains the World: Five Lessons From TV’s Greatest Dad

Why Television Needs a New Cosby Show Right Now

  News & Politics
The World
Sept. 19 2014 11:36 AM Breaking Up Countries Is Still Hard to Do
Sept. 19 2014 12:09 PM How Accelerators Have Changed Startup Funding
The Vault
Sept. 19 2014 12:08 PM The CIA Used to Have a Commute-by-Canoe Club. One Member’s Memories.
  Double X
The XX Factor
Sept. 19 2014 11:33 AM Planned Parenthood Is About to Make It a Lot Easier to Get Birth Control
  Slate Plus
Slate Picks
Sept. 19 2014 12:00 PM What Happened at Slate This Week? The Slatest editor tells us to read well-informed skepticism, media criticism, and more.
Brow Beat
Sept. 19 2014 12:10 PM Watch the Trailer for Big Eyes, a Tim Burton Movie About People With Normal-Sized Eyes
Future Tense
Sept. 19 2014 11:40 AM Apple Invented the Perfect Way to Handle Your Giant New Phone
  Health & Science
Medical Examiner
Sept. 19 2014 12:13 PM The Most Terrifying Thing About Ebola  The disease threatens humanity by preying on humanity.
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.