Automated Insights to write AP earnings reports: Why robots can’t take journalists’ jobs.

The Real Difference Between Robots and Human Journalists Isn’t Writing Ability

The Real Difference Between Robots and Human Journalists Isn’t Writing Ability

Innovation, the Internet, gadgets, and more.
July 14 2014 5:11 PM

The Prose of the Machines

“Robots” are surprisingly good at writing news stories, but humans still have one big edge.

(Continued from Page 1)

As New York magazine’s Kevin Roose observes, “The stories that today’s robots can write are, frankly, the kinds of stories that humans hate writing anyway.” I made a similar point when I wrote about Quakebot, the Los Angeles Times program that cranks out a breaking-news brief whenever an earthquake hits. Even Robbie Allen, Automated Insights’ CEO, agrees. “Automation is about augmenting what reporters do,” he told me. “Now that you don’t have to have a reporter listening in on every earnings call, they can be focused on other things.”

But what happens when the machines get smarter? What will keep them from encroaching on human reporters’ territory?

You might think that what separates human writing from robo-journalism is the ability to write with flair. In fact, Automated Insights’ machines have little trouble couching their reports in a snarky tone if that’s what the client requests. Here, for example, are a few choice lines from a machine-generated Yahoo fantasy football draft recap:

“Good News, Bad News: The good news is that the draft for Benjamin’s Boss Team was consistent throughout. The bad news is that it was consistently the worst in the league in terms of projected points (over both the first and second halves of the draft).”
“Fantasy Fútbol: This is the American version, folks. Benjamin’s Boss Team elected to go with two kickers, rather than adding depth at other positions.”

Snark, it turns out, is just another software setting that you can dial up or down according to your predilections.

What will keep robo-journalism from usurping people’s jobs anytime soon is not the quality of the machines’ writing. Strange as it might sound, it’s the quality of their data.

Recall that Automated Insights’ Disney story made no mention of Frozen or Thor, recent works that readers might readily associate with the company. That’s because the company’s software, which draws exclusively on Zacks financial data for its reports, has no way of knowing that these movies are tied to Disney’s strategically important acquisitions of Pixar and Marvel, respectively. Even if it did, it couldn’t begin to generate a broader insight like the AP reporter Nakashima’s judgment that “both films showed the power of buying multibillion-dollar content brands.”

To pick out what might be most interesting to business readers about Disney’s latest earnings report isn’t a matter of processing power. It’s a matter of having the right kinds of data at your disposal. A good story about Disney requires a journalist who already has a conception of what the company is about and why it’s important in the wider scheme of things. Nakashima’s piece also draws on his understanding of the big abstract questions looming over 21st-century business management. Are big-time content brand acquisitions, in general, worth the money? Disney’s earnings report suggests they can be, at least in some circumstances.

Software programs can scan a spreadsheet in a fraction of a second. They can rapidly compare the numbers in that spreadsheet to all sorts of other data sets, from past earnings reports to historical averages to the recent performance of other companies in the relevant industry sector. Over time, this ability should allow them to spot trends that human reporters would overlook. For instance, Allen says, Automated Insights’ software might notice that a given company’s revenues have beaten estimates every third quarter for the past five years. “Certain kinds of analysis are completely missed all the time today because humans aren’t ideally suited to that kind of thing.”

But it still takes a human to situate those sorts of insights in the context of broader trends, current controversies, and ongoing narratives. In the end, the data in a company’s earnings report means little until it’s combined with all the data that’s already in people’s heads, accumulated through years of experience—not only experience covering business, but experience watching Disney movies, going to Disneyland, mulling over the role of corporations in children’s lives and the cultural forces that shaped a man like Walt Disney himself. In short, the data in people’s heads doesn’t just come from spreadsheets. It comes from years of experience being human.

Fortunately, we don’t have to choose between automated reporting and real journalism. The Disney reports above are a perfect example of how we can have both. For some smaller companies, whose earnings reports would have merited only a brief anyway, the automated reports may supplant human-written stories. But for the larger companies, like Disney, the AP will continue to supply both. The algorithmic brief will hit the wires first, conveying the essential data to people who want it as soon as possible. Then the humans will come in behind them, bringing fresh reporting, adding context, and making the sorts of connections that turn a factual brief into a real story.  

Robot journalists, it turns out, are neither robots nor journalists. They’re just another useful tool for presenting data in a form that humans can use to do what only humans can—make sense of the world.