Google searches for flu symptoms are at an all-time high. Is it time to panic?
Perhaps not. But Google’s track record is disconcertingly impressive. In the four years leading up to the Nature paper in 2009, its estimates lined up with the eventual CDC data with amazing accuracy. The algorithm works by not just counting the number of flu-related searches but weighting specific search topics according to their power as a predictor of the CDC’s doctor visit numbers. For instance, Google has found that searches for antiviral medication are only weakly correlated with the CDC’s findings. But searches for “influenza complications” line up beautifully.
That Google’s algorithm matched CDC data so well between 2004 and 2008 shouldn’t come as too much of a surprise. After all, it was built to do just that. The real question is how it has performed in the years since—and whether it could turn out to be way off in an anomalous year, like, say, this one.
While Google hasn’t published a similar report on Flu Trends’ performance in the last few years, Google.org spokeswoman Kelly Mason tells me it has continued to mirror the CDC’s data with similar accuracy—with one exception. In 2009, the first wave of H1N1 came extremely early, hitting between March and August. Google’s model seriously underestimated that spike, according to a paper published in PLOS One in 2011. Google tweaked its model later in 2009 in response to the glitch, and Mason says it hasn’t had to alter it again since then.
The 2009 hiccup should create at least a little room for doubt about Google’s figures this year. The obvious interpretation is that while the model works seamlessly for most seasons, it may stumble in the face of an outbreak that is truly out of the ordinary. Of course, an out-of-the-ordinary outbreak is exactly what the model is currently showing. If it’s wrong, that would be the algorithm’s first major instance of a false positive for a big flu spike.
Before anyone panics, though, there are two other things worth considering about Google’s indications of a flu year surpassing that of 2009. One is that the dominant strain so far this year is H3N2, not the novel “swine flu” strain of H1N1 that spooked the world. That makes this flu season more comparable to that of 2003-2004, which the CDC classified as “moderately severe.” And while H3N2 has been among the deadlier strains in past years, the CDC so far has seen just 18 flu-related deaths among children so far this season—an encouraging sign. During the pandemic, that number was 300.
The second caveat is that even the CDC’s headline metric is not a perfect indicator of a flu season’s severity. Again, the figure to which Google Flu Trends corresponds is the one that tells us what percentage of outpatient doctor visits are flu-related at the institutions in the CDC’s reporting network. But a separate PLOS One study from 2011 found that it doesn’t correlate quite as well with another CDC metric that’s based on the number of laboratory-confirmed cases of the flu. The discrepancy was especially noticeable in 2003-2004, when media attention to an especially early flu season may have triggered a wave of doctor visits and Google searches that turned out not to correspond to actual influenza infections.
All that said, it seems almost certain that the most recent CDC figures are underestimating the outbreak’s current magnitude. Don’t be surprised to see a flurry of increasingly dire warnings and media reports in the weeks to come. In fact, they’re already beginning. But thanks to Google Flu Trends, you can beat the rush. The CDC’s Jhung recommends that everyone over the age of 6 months who has not yet gotten a flu shot do so now.* Even if you’ve already caught one strain, he said, there are still two others that the vaccine can protect against.
If this is indeed the year that Google Flu Trends proves its merit as an early warning system for major flu outbreaks, there will be one sad irony to the timing. Google’s big health initiative, Google Health, was discontinued just last year because, according to Google, it was “not having the broad impact we hoped it would.” Flu Trends lives on for the time being under the Google.org umbrella. But after growing fast early on, Flu Trends has added just one country—Romania—to its 29-nation database this year, and Mason said there are no plans to add more.
Correction, Jan. 10, 2013: This article misstated the age at which the CDC recommends children get flu shots. It's 6 months, not 6 years. (Return to the corrected sentence.)