Do Books Need Soundtracks and Special Effects?

Slate’s design blog.
Feb. 4 2014 9:00 AM

Do Books Need Soundtracks and Special Effects?

An augmented reading experience for science fiction from MIT Media Lab

Courtesy of MIT Media Lab via Flickr

When e-readers first emerged, making it unnecessary to print words on felled trees, the devices sought to soothe those who had grown accustomed to the communion between man and book largely by mimicking the familiar experience of turning pages filled with blocks of text. The only things missing were the tactile and olfactory qualities of paper.

Now, many readers believe that reading a book on a screen doesn’t fundamentally change the  act of reading. But a couple of recent innovations seem determined to redesign this quiet, unitasking activity into a multisensory experience.

The recently launched Booktrack is a service that allows authors to add a synchronized soundtrack to e-books and other digital content. The idea is to turn reading into an “immersive, movie-like experience.” On the company's website, the founders claim that “Booktrack will change the way people read, write, and publish their stories.”


Setting music to narrative is a familiar trick of This American Life–style radio storytelling, but it seems odd to ask authors to add "sound designer" to their job descriptions. Do books, like movies, really need a predetermined soundtrack to manipulate emotions and set the mood?

Wearable tech is programmed to let readers experience a fictional protagonist's physiological emotions.

Courtesy of MIT Media Lab via Flickr

Researchers at the MIT Media Lab have introduced a concept for an even more elaborate digitally augmented reading experience, geared toward science fiction.

They call it Sensory Fiction. It's “about new ways of experiencing and creating stories,” Felix Heibeck, Alexis Hope, and Julie Legault write on their project website. “Traditionally, fiction creates and induces emotions and empathy through words and images. By using a combination of networked sensors and actuators, the Sensory Fiction author is provided with new means of conveying plot, mood, and emotion while still allowing space for the reader’s imagination. These tools can be wielded to create an immersive storytelling experience tailored to the reader.”

Using The Girl Who Was Plugged In by James Tiptree as a prototype story, they developed an animated book embedded with vibration capabilities and programmable LEDs “to create ambient light based on changing setting and mood.” Readers would strap into a wearable tech apparatus “to experience the protagonist’s physiological emotions,” the researchers write. A change “in the protagonist’s emotional or physical state triggers discrete feedback in the wearable, whether by changing the heartbeat rate, creating constriction through air pressure bags, or causing localized temperature fluctuations.”

If Booktrack wants to make reading more cinematic (its creators claim that it is “transforming reading the way sound transformed silent film”), Sensory Fiction seems to want to commandeer all our senses in order to inject virtual thrills into what has long been a low-tech, free-associative activity.

Will these tech-based redesigns of the reading experience make old-fashioned silent reading seem outdated and quaint? Or will they remain one-off experiments like the occasional scented theater performance or multisensory fireworks show? Or will they join the ranks of iSmell—that ill-fated attempt to perfume the experience of surfing the internet—or the long-running joke that is Smell-O-Vision?



Blacks Don’t Have a Corporal Punishment Problem

Americans do. But when blacks exhibit the same behaviors as others, it becomes part of a greater black pathology. 

I Bought the Huge iPhone. I’m Already Thinking of Returning It.

Scotland Is Just the Beginning. Expect More Political Earthquakes in Europe.

Lifetime Didn’t Think the Steubenville Rape Case Was Dramatic Enough

So they added a little self-immolation.

Two Damn Good, Very Different Movies About Soldiers Returning From War

Medical Examiner

The Most Terrifying Thing About Ebola 

The disease threatens humanity by preying on humanity.

Students Aren’t Going to College Football Games as Much Anymore, and Schools Are Getting Worried

The Good Wife Is Cynical, Thrilling, and Grown-Up. It’s Also TV’s Best Drama.

  News & Politics
Sept. 19 2014 9:15 PM Chris Christie, Better Than Ever
Business Insider
Sept. 20 2014 6:30 AM The Man Making Bill Gates Richer
Sept. 20 2014 7:27 AM How Do Plants Grow Aboard the International Space Station?
  Double X
The XX Factor
Sept. 19 2014 4:58 PM Steubenville Gets the Lifetime Treatment (And a Cheerleader Erupts Into Flames)
  Slate Plus
Slate Picks
Sept. 19 2014 12:00 PM What Happened at Slate This Week? The Slatest editor tells us to read well-informed skepticism, media criticism, and more.
Brow Beat
Sept. 19 2014 4:48 PM You Should Be Listening to Sbtrkt
Future Tense
Sept. 19 2014 6:31 PM The One Big Problem With the Enormous New iPhone
  Health & Science
Bad Astronomy
Sept. 20 2014 7:00 AM The Shaggy Sun
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.