Your Video-Game Console Knows a Lot More About You Than You Thought

The art of play.
March 7 2012 6:40 AM

Your Kinect Is Watching You

The amazing, disturbing things your gaming console can learn about you.

(Continued from Page 1)

And over the past eight years, in experiments my colleagues and I conducted for car companies like Toyota and Nissan, we used tracking software to detect hundreds of subjects’ facial movements as they cruised through virtual streets in a simulator. We then built mathematical formulas to predict what we called “the pre-accident face”—the nonverbal pattern that occurs seconds before the driver exhibits bad behavior, including swerving, lane violations, and even collisions. The two most predictive facial features for major accidents: the center of the lower lip and the center of the upper lip.

The automobile companies funded this research in the hopes of incorporating in-car solutions that can prevent crashes. For all the potential benefits of this research, though, it would also be possible to use it in more controversial ways. Just imagine the debate that would ensue if insurance companies were granted access to our nonverbal driving histories, allowing them to charge higher rates to drivers who made telltale expressions. Also consider a project we worked on at the behest of Kyoto-based factory automation company OMRON. With a single camera, we demonstrated that some workplace mistakes can be detected before they occur simply by examining the workers’ facial movements. Again, while tracking nonverbal behavior may help prevent accidents, it could also clue in employers about personal habits that workers might not want to share.

I believe that we’ll see many wonderful applications of this technology, ranging from safety systems to educational tools for struggling students. At the same time, gamers need to be informed that they can be watched, and that how you interact with a game system like the Kinect can potentially reveal a lot about you. As technology becomes more immersive, your video-game persona is not just a character. It’s you.



The Self-Made Man

The story of America’s most pliable, pernicious, irrepressible myth.

The GOP Senate Candidate in Iowa Doesn’t Want Voters to Know Just How Conservative She Really Is

Does Your Child Have “Sluggish Cognitive Tempo”? Or Is That Just a Disorder Made Up to Scare You?

The Supreme Court, Throughout Its History, Has Been a Massive Disappointment

Why Indians in America Are Mad for India’s New Prime Minister

Damned Spot

Now Stare. Don’t Stop.

The perfect political wife’s loving gaze in campaign ads.

Building a Better Workplace

You Deserve a Pre-cation

The smartest job perk you’ve never heard of.

Rehtaeh Parsons Was the Most Famous Victim in Canada. Now, Journalists Can’t Even Say Her Name.

Parents, Get Your Teenage Daughters the IUD

The XX Factor
Sept. 30 2014 12:34 PM Parents, Get Your Teenage Daughters the IUD
Sept. 30 2014 12:04 PM John Hodgman on Why He Wore a Blue Dress to Impersonate Ayn Rand
  News & Politics
Sept. 30 2014 2:36 PM This Court Erred The Supreme Court has almost always sided with the wealthy, the privileged, and the powerful.
Building a Better Workplace
Sept. 30 2014 1:16 PM You Deserve a Pre-cation The smartest job perk you’ve never heard of.
Sept. 30 2014 1:48 PM Thrashed Florida State’s new president is underqualified and mistrusted. But here’s how he can turn it around.
  Double X
The XX Factor
Sept. 30 2014 12:34 PM Parents, Get Your Teenage Daughters the IUD
  Slate Plus
Behind the Scenes
Sept. 30 2014 3:21 PM Meet Jordan Weissmann Five questions with Slate’s senior business and economics correspondent.
Brow Beat
Sept. 30 2014 3:59 PM The Trailer for Taken 3 Is Here, and Guess Who’s on His Phone Again
Future Tense
Sept. 30 2014 2:38 PM Scientists Use Electrical Impulses to Help Paralyzed Rats Walk Again
  Health & Science
Bad Astronomy
Sept. 30 2014 7:30 AM What Lurks Beneath the Methane Lakes of Titan?
Sports Nut
Sept. 28 2014 8:30 PM NFL Players Die Young. Or Maybe They Live Long Lives. Why it’s so hard to pin down the effects of football on players’ lives.