Every election cycle, voters are inundated with surveys, phone calls, and online questionnaires that claim to capture public opinion. Some of these are rigorously designed research tools that provide valuable insight into voter preferences. Others are deliberately crafted to manipulate those same voters — a tactic known as a push poll. The difference can be subtle, but the consequences of mistaking one for the other are significant. Misleading polling erodes trust in democratic processes, fuels misinformation, and can even shift election outcomes. This article explains how to recognize push polls, why legitimate polling adheres to strict scientific standards, and how anyone — from students to seasoned educators — can critically evaluate the data they encounter.

What Are Push Polls?

A push poll is a type of survey designed not to collect genuine data but to influence or "push" the respondent toward a particular opinion or voting intention. The term was coined in the 1970s, but the practice has deeper roots in political campaigning. Unlike legitimate polls, which use neutral language and random samples to measure opinion, push polls rely on loaded questions, unverified claims, and emotional appeals. Their primary goal is persuasion, not measurement.

Legally, push polls occupy a gray area. In the United States, they are generally not regulated under campaign finance laws unless they explicitly advocate for or against a candidate. However, many states have disclosure requirements. The Federal Communications Commission (FCC) has also taken issue with robocall-based push polls that fail to identify the sponsoring organization. Despite this, push polls remain a common — and controversial — tool in political campaigns, especially during primaries where candidates attempt to damage rivals under the guise of impartial research.

Historical Examples of Push Polls

One of the most notorious push poll operations occurred during the 2000 South Carolina Republican primary. Unknown callers asked voters: "Would you be more or less likely to vote for John McCain if you knew he had fathered an illegitimate black child?" This question was entirely false — McCain’s adopted daughter from Bangladesh was the target of racist smear tactics. The poll had no interest in gathering data; it was designed to depress McCain’s support among conservative voters.

Another famous case involved the "Bradley effect" — a phenomenon named after Los Angeles mayor Tom Bradley, who lost the 1982 California governor’s race despite leading in pre-election polls. While not a push poll itself, the event prompted scrutiny of how hidden racial attitudes can distort polling. Push polls exploit such hidden biases by deliberately introducing false or exaggerated information, amplifying existing prejudices rather than measuring existing opinions.

Techniques Used in Push Polling

Push polls employ several distinct techniques that set them apart from legitimate surveys:

  • False Information: They present unverified or fabricated claims about a candidate or issue, then gauge the respondent’s reaction.
  • Emotionally Charged Language: Words like "corrupt," "radical," "betrayal," or "secret" are used to provoke an instant emotional response.
  • Absolute Statements: Questions that begin with "Would you support a candidate who has been convicted of fraud?" even when no such conviction exists.
  • Forced Choice: Respondents are asked to choose between a clearly negative characterization and a vague or positive one, with no neutral option.
  • Short Duration: Legitimate polls often take 10–20 minutes; push polls may last only one or two minutes, focused entirely on one issue.

Characteristics of Legitimate Polls

Legitimate polling is a systematic, scientific method of measuring public opinion. Reputable polling organizations follow established standards that ensure the data is reliable, unbiased, and representative. These standards are codified by professional bodies such as the American Association for Public Opinion Research (AAPOR).

Random Sampling and Representativeness

At the heart of legitimate polling is random sampling. A properly conducted poll selects respondents in a way that gives every member of the target population an equal (or known) probability of being included. This is typically achieved through random digit dialing for telephone polls, or address-based sampling for mail and in-person surveys. Online opt-in panels are increasingly common but require sophisticated statistical weighting to correct for self-selection bias.

Sample size is determined by the desired level of precision. For a national survey of 1,000 likely voters, the margin of error is roughly ±3 percentage points at a 95% confidence level. Legitimate polls always report both the sample size and the margin of error. They also describe the population sampled (e.g., "adults," "registered voters," "likely voters") and the field dates.

Questionnaire Design

Legitimate polls avoid leading, loaded, or double-barreled questions. A well-designed question is concise, neutral, and uses consistent wording. For example: "If the election for president were held today, would you vote for Candidate A or Candidate B?" versus a push poll question: "Given his corruption scandals, could you still consider voting for Candidate A?" The former measures preference; the latter attempts to embed an allegation.

Question order also matters. Legitimate polls randomize the order of response options to avoid recency or primacy effects. They include "don't know" and "refused" options, allowing respondents to opt out without biasing results. Push polls often omit these options, forcing a dichotomous choice.

Methodological Transparency

A legitimate poll publishes detailed information about its methodology. This includes the sampling method, sample size, margin of error, weighting procedures, and the sponsoring organization. The Pew Research Center, for instance, provides extensive documentation for every survey, including full question wording, topline results, and a methodology section. Reputable media outlets like The New York Times and FiveThirtyEight also require polls they cite to meet basic transparency thresholds.

Professional Standards and Peer Review

Many legitimate pollsters belong to professional associations such as AAPOR or the World Association for Public Opinion Research (WAPOR). These organizations enforce ethical guidelines that prohibit practices like push polling. Additionally, academic and nonpartisan survey research projects often undergo institutional review board (IRB) approval to ensure ethical treatment of participants. Commercial polling firms may not have the same oversight, but those with long track records — like Gallup, YouGov, and Ipsos — voluntarily submit to industry benchmarks.

How to Spot a Push Poll

Distinguishing a push poll from a legitimate poll requires careful attention to several warning signs. Below is a practical checklist you can use to evaluate any survey you encounter.

The "Too Good to Be True" Test

If a poll reports an implausibly large lead for a candidate, or claims that 80% of voters support a controversial position, be suspicious. Legitimate polls rarely produce such extreme results. Outliers do occur, but they should be accompanied by caveats. Push polls often exaggerate support or opposition to create a false sense of momentum.

Loaded or Leading Questions

Listen for questions that begin with phrases like "Are you aware that..." or "Is it important to you that..." These constructions often function as Trojan horses for false information. For example: "Are you aware that Candidate X voted to raise taxes on the middle class three times?" If the premise is false or misleading, the poll is a push poll.

Vague or Missing Methodology

If the poll does not state the sample size, margin of error, or sponsoring organization, it is almost certainly not a legitimate poll. Push polls rarely disclose this information. Even if they do, check the sponsor: is it an independent research firm, a partisan campaign, or a front group with a name like "Citizens for Honest Government"?

Short Duration and Single Focus

Legitimate polls cover multiple issues and take 10–20 minutes to administer. Push polls typically last less than five minutes and focus solely on one candidate or one issue. They may also use only one or two questions, repeating the same loaded question with slightly different wording.

Failure to Provide Results

Once a legitimate poll is complete, it is usually published or at least filed with a repository like Roper Center or iPoll. Push polls never release results because they were never intended to measure anything. If you cannot find any publication of results, treat the polling activity with extreme skepticism.

The Difference Between Push Polling and Message Testing

It is important not to confuse push polls with "message testing," a legitimate research practice used by campaigns. In message testing, respondents are shown several potential ad scripts or talking points and asked which is most persuasive. The goal is to optimize communication, not to spread falsehoods. Message testing is transparent in purpose, uses neutral language, and generally provides results for internal campaign use. Push polls, by contrast, are disguised as genuine surveys and actively disseminate misleading information.

The Role of Polling in Media and Democracy

Polling serves a vital function in democratic societies: it provides a snapshot of the public’s views, holds elected officials accountable, and informs voters about the state of races. However, the proliferation of push polls — especially through robocalls, text messages, and social media — threatens that function. When voters lose trust in all polling data, the entire ecosystem of public opinion research is undermined.

The "Bandwagon" and "Underdog" Effects

Legitimate polls can influence voter behavior through bandwagon effects (people support the apparent winner) and underdog effects (people sympathize with the trailing candidate). Push polls deliberately exploit these psychological tendencies by fabricating a dominant lead or a scandal trailing. In close races, even a small push can shift enough votes to change the outcome. FiveThirtyEight has documented multiple instances where false polling narratives altered campaign dynamics.

Journalistic Responsibility

Media outlets have a responsibility to critically assess polls before reporting them. Unfortunately, in the rush for clickbait headlines, some news organizations amplify push polls without verifying their methodology. The best practice is to cite only polls that meet transparency standards — for example, those rated by FiveThirtyEight’s pollster ratings, which score firms on accuracy and transparency. Journalists should also note when a poll was conducted by a partisan firm or a candidate’s own internal pollster.

Tips for Evaluating Polls

Whether you are a student writing a paper, a teacher designing a civics lesson, or a voter trying to make sense of the electoral landscape, these guidelines will help you separate reliable data from manipulation.

1. Identify the Sponsor

Look for the organization that paid for and conducted the poll. Reputable sponsors include nonpartisan research centers, major news organizations, universities, and long-established survey firms. Be skeptical of polls commissioned by a candidate’s campaign, a Super PAC, or an advocacy group with a clear agenda. If the sponsor is unknown or suspiciously named (e.g., "Americans for Truth"), dig deeper.

2. Check the Sample Specification

Who was interviewed? Adults, registered voters, or likely voters? "Likely voters" is the gold standard for election polls, but the screening questions should be disclosed. Also check the sample source: landline versus cellphone percentages, and whether online panels were used. The best polls combine multiple modes (phone, online, mail) and use probability-based sampling.

3. Examine the Questionnaire

If available, read the full questionnaire. Look for balanced wording, clear options, and inclusion of "don’t know." Be alert for questions that begin with "Are you aware that..." or "Given that..." — those are red flags. Also check if the order of candidates’ names was randomized.

4. Look for Full Disclosure of Methodology

Most reputable polls publish a methodology statement that includes field dates, sample size, margin of error, weighting details, and contact methods. If any of this information is missing, be wary. Cross-check with standards from AAPOR: they require disclosure of question wording, sample sizes, and response rates for any poll intended for public release.

5. Compare with Multiple Polls

No single poll is definitive. Use aggregators like FiveThirtyEight, RealClearPolitics, or The Economist’s election model to see the consensus of multiple surveys. If one poll wildly diverges from the average, it may be flawed — or a push poll. Also note the timing: polls taken during a news cycle may reflect that week’s headlines rather than underlying sentiment.

6. Examine the Response Rate and Weighting

Response rates for telephone polls have plummeted to single digits. Legitimate polls report response rates and explain how non-response bias is handled through weighting. If no response rate is mentioned, the poll may be using a non-probability sample that cannot be reliably weighted. Online polls that rely on self-selected volunteers (like "click here to vote" polls) are not scientific at all.

7. Use Pollster Ratings Tools

FiveThirtyEight provides rigorous pollster ratings that score firms on historical accuracy, transparency, and methodological rigor. Before citing any poll, check its rating. A pollster with an "A" rating is far more trustworthy than one rated "C" or "D." Many partisan pollsters fall into the lower tiers because they do not disclose full methodology or have a track record of bias.

8. Beware of "Rogue" or "Internal" Polls

Campaigns occasionally leak internal polls to shape media coverage. These polls may be legitimate — but because they are unverifiable and not peer-reviewed, they should be treated with caution. The same applies to so-called "straw polls" conducted on social media, which have no scientific value.

Conclusion

Push polls are not harmless — they are a deliberate form of political manipulation that misleads voters, tarnishes reputations, and erodes trust in democratic processes. The ability to distinguish between a push poll and a scientifically conducted survey is an essential skill for anyone who consumes political news. By looking for neutral question wording, transparent methodology, random sampling, and a reputable sponsor, you can avoid being swayed by false or misleading data. Educators, in particular, have a responsibility to teach students how to critically evaluate polls — not just in election seasons, but as a lifelong habit of skeptical, informed citizenship. In an age of information overload, the question is no longer simply what the polls say, but whether the poll itself deserves to be believed.