What Can a Phone Do If it Knows Where It Is in 3D Space?

Future Tense
The Citizen's Guide to the Future
Feb. 20 2014 6:12 PM

What Can a Phone Do If it Knows Where It Is in 3D Space?

Project Tango's prototype looks normal, but it's watching in a way your smartphone never has.

Photo by Project Tango.

The thing about building IKEA furniture is that sometimes you just get stuck. You can't seem to orient the bookcase parts so it looks like the figure in the directions. Out of habit you pick up your smartphone, beacon of all knowledge, and unlock it. And then you just stare at the home screen for a second because there's nothing your smartphone can do to help you. Google is trying to change that.

Lily Hay Newman Lily Hay Newman

Lily Hay Newman is lead blogger for Future Tense.

Project Tango is a collaboration between researchers at multiple companies and institutions to produce a smartphone that gives "mobile devices a human-scale understanding of space and motion." And it's led by the Advanced Technology and Projects group at Google, which is the one Motorola devision that Google didn't sell to Lenovo. Basically Project Tango's prototype is a 5-inch phone that's loaded with sensors and processing power to interpret the environment and objects in it in three-dimensions.


That could allow the phone to, say, dynamically deliver audio directions and detailed information to a vision-impaired person no matter where she goes and whether or not she has been there before. The phone can assess its surroundings and figure out exactly where it is in human space. And it could scan the two pieces of a bookcase that you have left and then use an IKEA database to show you a customized animation of how they fit together.

The possibilites seem limitless. Video games that utilize the physical space around you! Body-position monitoring to check how well you're working the room at networking events! But if the potential of the device isn't immediately clear to you that's OK, too. The Project Tango website explains,

While we may believe we know where this technology will take us, history suggests we that should be humble in our predictions. We are excited to see the effort take shape with each step forward.

You don't need Google Translate to know what that means: No one knows what Project Tango can achieve—or what negative consequences lurk unforeseen. This is real research and only 200 developers are going to get to try the first generation of prototypes. (Google will choose the lucky 200 by March 14 based on applications.) The future of this technology is totally up in the air, which feels kind of uncomfortable, but also awesome.

The sensors in Project Tango's prototype include a compass and gyroscopes, but go far beyond.

Photo by Project Tango.

Future Tense is a partnership of SlateNew America, and Arizona State University.



Smash and Grab

Will competitive Senate contests in Kansas and South Dakota lead to more late-breaking races in future elections?

Even When They Go to College, the Poor Sometimes Stay Poor

Here’s Just How Far a Southern Woman May Have to Drive to Get an Abortion

The Most Ingenious Teaching Device Ever Invented

Marvel’s Civil War Is a Far-Right Paranoid Fantasy

It’s also a mess. Can the movies do better?


Sprawl, Decadence, and Environmental Ruin in Nevada

Space: The Next Generation

An All-Female Mission to Mars

As a NASA guinea pig, I verified that women would be cheaper to launch than men.

Watching Netflix in Bed. Hanging Bananas. Is There Anything These Hooks Can’t Solve?

The Procedural Rule That Could Prevent Gay Marriage From Reaching SCOTUS Again

  News & Politics
Oct. 20 2014 6:49 PM God’s Oligarch One of Vladimir Putin’s favorite businessmen wants to start an Orthodox Christian Fox News and return Russia to its glorious czarist past.
Oct. 20 2014 6:48 PM Apple: Still Enormously Profitable
Oct. 20 2014 3:16 PM The Catholic Church Is Changing, and Celibate Gays Are Leading the Way
  Double X
The XX Factor
Oct. 20 2014 6:17 PM I Am 25. I Don't Work at Facebook. My Doctors Want Me to Freeze My Eggs.
  Slate Plus
Tv Club
Oct. 20 2014 7:15 AM The Slate Doctor Who Podcast: Episode 9 A spoiler-filled discussion of "Flatline."
Brow Beat
Oct. 20 2014 6:32 PM Taylor Swift’s Pro-Gay “Welcome to New York” Takes Her Further Than Ever From Nashville 
Future Tense
Oct. 20 2014 4:59 PM Canadian Town Cancels Outdoor Halloween Because Polar Bears
  Health & Science
Medical Examiner
Oct. 20 2014 11:46 AM Is Anybody Watching My Do-Gooding? The difference between being a hero and being an altruist.
Sports Nut
Oct. 20 2014 5:09 PM Keepaway, on Three. Ready—Break! On his record-breaking touchdown pass, Peyton Manning couldn’t even leave the celebration to chance.