What Can a Phone Do If it Knows Where It Is in 3D Space?

The Citizen's Guide to the Future
Feb. 20 2014 6:12 PM

What Can a Phone Do If it Knows Where It Is in 3D Space?

Project Tango's prototype looks normal, but it's watching in a way your smartphone never has.

Photo by Project Tango.

The thing about building IKEA furniture is that sometimes you just get stuck. You can't seem to orient the bookcase parts so it looks like the figure in the directions. Out of habit you pick up your smartphone, beacon of all knowledge, and unlock it. And then you just stare at the home screen for a second because there's nothing your smartphone can do to help you. Google is trying to change that.

Project Tango is a collaboration between researchers at multiple companies and institutions to produce a smartphone that gives "mobile devices a human-scale understanding of space and motion." And it's led by the Advanced Technology and Projects group at Google, which is the one Motorola devision that Google didn't sell to Lenovo. Basically Project Tango's prototype is a 5-inch phone that's loaded with sensors and processing power to interpret the environment and objects in it in three-dimensions.


That could allow the phone to, say, dynamically deliver audio directions and detailed information to a vision-impaired person no matter where she goes and whether or not she has been there before. The phone can assess its surroundings and figure out exactly where it is in human space. And it could scan the two pieces of a bookcase that you have left and then use an IKEA database to show you a customized animation of how they fit together.

The possibilites seem limitless. Video games that utilize the physical space around you! Body-position monitoring to check how well you're working the room at networking events! But if the potential of the device isn't immediately clear to you that's OK, too. The Project Tango website explains,

While we may believe we know where this technology will take us, history suggests we that should be humble in our predictions. We are excited to see the effort take shape with each step forward.

You don't need Google Translate to know what that means: No one knows what Project Tango can achieve—or what negative consequences lurk unforeseen. This is real research and only 200 developers are going to get to try the first generation of prototypes. (Google will choose the lucky 200 by March 14 based on applications.) The future of this technology is totally up in the air, which feels kind of uncomfortable, but also awesome.

The sensors in Project Tango's prototype include a compass and gyroscopes, but go far beyond.

Photo by Project Tango.

Future Tense is a partnership of SlateNew America, and Arizona State University.

Lily Hay Newman is lead blogger for Future Tense.



Scalia’s Liberal Streak

The conservative justice’s most brilliant—and surprisingly progressive—moments on the bench.

Colorado Is Ground Zero for the Fight Over Female Voters

There’s a Way to Keep Ex-Cons Out of Prison That Pays for Itself. Why Don’t More States Use It?

The NFL Explains How It Sees “the Role of the Female”

The Music Industry Is Ignoring Some of the Best Black Women Singing R&B


Theo’s Joint and Vanessa’s Whiskey

No sitcom did the “Very Special Episode” as well as The Cosby Show.


The Other Huxtable Effect

Thirty years ago, The Cosby Show gave us one of TV’s great feminists.

Cliff Huxtable Explains the World: Five Lessons From TV’s Greatest Dad

Why Television Needs a New Cosby Show Right Now

  News & Politics
Sept. 18 2014 8:20 PM A Clever Attempt at Explaining Away a Vote Against the Farm Bill
Sept. 18 2014 6:02 PM A Chinese Company Just Announced the Biggest IPO in U.S. History
The Slate Quiz
Sept. 18 2014 11:44 PM Play the Slate News Quiz With Jeopardy! superchampion Ken Jennings.
  Double X
Sept. 18 2014 8:07 PM Crying Rape False rape accusations exist, and they are a serious problem.
  Slate Plus
Behind the Scenes
Sept. 18 2014 1:23 PM “It’s Not Every Day That You Can Beat the World Champion” An exclusive interview with chess grandmaster Fabiano Caruana.
Brow Beat
Sept. 18 2014 4:33 PM The Top 5 Dadsplaining Moments From The Cosby Show
Future Tense
Sept. 18 2014 6:48 PM By 2100 the World's Population Could Be 11 Billion
  Health & Science
Sept. 18 2014 3:35 PM Do People Still Die of Rabies? And how do you know if an animal is rabid?
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.