What Can a Phone Do If it Knows Where It Is in 3D Space?

The Citizen's Guide to the Future
Feb. 20 2014 6:12 PM

What Can a Phone Do If it Knows Where It Is in 3D Space?

Project Tango's prototype looks normal, but it's watching in a way your smartphone never has.

Photo by Project Tango.

The thing about building IKEA furniture is that sometimes you just get stuck. You can't seem to orient the bookcase parts so it looks like the figure in the directions. Out of habit you pick up your smartphone, beacon of all knowledge, and unlock it. And then you just stare at the home screen for a second because there's nothing your smartphone can do to help you. Google is trying to change that.

Project Tango is a collaboration between researchers at multiple companies and institutions to produce a smartphone that gives "mobile devices a human-scale understanding of space and motion." And it's led by the Advanced Technology and Projects group at Google, which is the one Motorola devision that Google didn't sell to Lenovo. Basically Project Tango's prototype is a 5-inch phone that's loaded with sensors and processing power to interpret the environment and objects in it in three-dimensions.


That could allow the phone to, say, dynamically deliver audio directions and detailed information to a vision-impaired person no matter where she goes and whether or not she has been there before. The phone can assess its surroundings and figure out exactly where it is in human space. And it could scan the two pieces of a bookcase that you have left and then use an IKEA database to show you a customized animation of how they fit together.

The possibilites seem limitless. Video games that utilize the physical space around you! Body-position monitoring to check how well you're working the room at networking events! But if the potential of the device isn't immediately clear to you that's OK, too. The Project Tango website explains,

While we may believe we know where this technology will take us, history suggests we that should be humble in our predictions. We are excited to see the effort take shape with each step forward.

You don't need Google Translate to know what that means: No one knows what Project Tango can achieve—or what negative consequences lurk unforeseen. This is real research and only 200 developers are going to get to try the first generation of prototypes. (Google will choose the lucky 200 by March 14 based on applications.) The future of this technology is totally up in the air, which feels kind of uncomfortable, but also awesome.

The sensors in Project Tango's prototype include a compass and gyroscopes, but go far beyond.

Photo by Project Tango.

Future Tense is a partnership of SlateNew America, and Arizona State University.

Lily Hay Newman is lead blogger for Future Tense.


Frame Game

Hard Knocks

I was hit by a teacher in an East Texas public school. It taught me nothing.

Republicans Like Scott Walker Are Building Campaigns Around Problems That Don’t Exist

Why Greenland’s “Dark Snow” Should Worry You

If You’re Outraged by the NFL, Follow This Satirical Blowhard on Twitter

The Best Way to Organize Your Fridge

The World

Iran and the U.S. Are Allies

They’re just not ready to admit it yet.

Sports Nut

Giving Up on Goodell

How the NFL lost the trust of its most loyal reporters.

Chief Justice John Roberts Says $1,000 Can’t Buy Influence in Congress. Looks Like He’s Wrong.

Farewell! Emily Bazelon on What She Will Miss About Slate.

  News & Politics
Sept. 16 2014 2:11 PM Spare the Rod What Charles Barkley gets wrong about corporal punishment and black culture.
Sept. 16 2014 2:35 PM Germany’s Nationwide Ban on Uber Lasted All of Two Weeks
The Eye
Sept. 16 2014 12:20 PM These Outdoor Cat Shelters Have More Style Than the Average Home
  Double X
The XX Factor
Sept. 15 2014 3:31 PM My Year As an Abortion Doula
  Slate Plus
Slate Plus Video
Sept. 16 2014 2:06 PM A Farewell From Emily Bazelon The former senior editor talks about her very first Slate pitch and says goodbye to the magazine.
Brow Beat
Sept. 16 2014 1:27 PM The Veronica Mars Spinoff Is Just Amusing Enough to Keep Me Watching
Future Tense
Sept. 16 2014 1:48 PM Why We Need a Federal Robotics Commission
  Health & Science
Sept. 16 2014 1:39 PM The Case of the Missing Cerebellum How did a Chinese woman live 24 years missing part of her brain?
Sports Nut
Sept. 15 2014 9:05 PM Giving Up on Goodell How the NFL lost the trust of its most loyal reporters.