As the election approaches, it's not only candidates who face a reckoning. Pollsters, too, confront a moment of truth. The close election could leave many calling the wrong winner. On a recent day, six national polls reported new results. Four had Mitt Romney leading; two had President Barack Obama. The largest victory margin was 3 points (for Romney). The average margin was 2 points. The uncertainty has fueled speculation that Romney could win the popular vote and lose the electoral count.

It's not just the election. Among pollsters, there's fear that changing technology (mainly cellphones) and growing public unwillingness to do interviews are undermining telephone surveys -- and that there's no accurate replacement in sight. A recent study by the Pew Research Center reported its response rate at 9 percent, down from 36 percent in 1997. Put differently: in 1997, Pew made about three residential calls to get one response; now it makes 10.

Beginning with answering machines and caller-ID in the '70s and '80s, suspicious Americans have become more selective in screening calls. Robo calls -- automated messages for products, politicians, charities and polls -- have deepened the hostility. "The mass of communications coming into people's homes ends up being a blur," says Pew pollster Scott Keeter.


All this threatens the largest upheaval in polling since the 1930s. Until then, Americans gauged public sentiment through newspaper straw polls, "speeches, petitions, rallies, riots, strikes, elections and letters to the editor," writes historian Sarah Igo of Vanderbilt University in her book, "The Averaged American: Surveys, Citizens, and the Making of a Mass Public."

The big change came in 1936, when George Gallup and Elmo Roper, using population sampling techniques, forecast Franklin Roosevelt's victory. Meanwhile, The Literary Digest magazine, relying on a straw poll of its readers, predicted Republican Alf Landon. The magazine's readers were unrepresentative of the whole population. Scientific sampling, which attempted to reflect everyone, triumphed, though it suffered a temporary setback in 1948 when polls missed the late surge toward President Harry Truman.

Gallup and Roper were to some extent idealists, says Igo. They thought that modern polling would improve democracy by clarifying the majority's desires. It hasn't worked out that way, in part because polls, by exposing sizable minorities, also strengthened their sense of identity. But polls did change how we talk and think about ourselves. Concepts such as "the typical American," "mainstream culture" and "public opinion" became common, writes Igo.

Polls are controversial today because the presidential race is tight. If either candidate had a 10-point lead, few would care how different polls decide who's a "likely" voter or how various population segments are weighted. These details usually don't matter much. But when the margin is a few points, they can determine which candidate is the front-runner and has "momentum."

More menacing is whether cellphones and shrinking popular participation subvert polls' accuracy, because samples are less representative. The answer seems to be: "not yet." Pew did a study comparing responses to basic questions (are you: U.S. citizen, homeowner, married?) from its surveys to larger government surveys. On most questions, responses were identical or close: 37 percent of respondents in both had children in the house; 75 percent in both were registered to vote. There were a few troubling discrepancies -- but no fundamental break.


The solution seems obvious: switch to the Internet. But technically, that's hard. Internet users may not be a representative sample of the U.S. population. Does the person behind that email live in the United States? Permanent panels of respondents may act differently from randomly contacted people. Experiments are under way. Meanwhile, pollsters are stretched between a past that's growing untenable and a future that doesn't yet exist.
