elections-and-voting-processes
Understanding the Difference Between Push Polls and Survey Research
Table of Contents
In the landscape of public opinion research, few distinctions are more critical—and more frequently misunderstood—than the difference between push polls and legitimate survey research. Both involve asking people questions and reporting results, but their intentions, methods, and ethical foundations could hardly be more different. Misidentifying a push poll as a genuine survey can lead to distorted perceptions of public sentiment, wasted resources, and even manipulated electoral outcomes. Conversely, dismissing all polling as “push polling” undermines the valuable insights that rigorous survey research provides to policymakers, journalists, and businesses. Understanding these two approaches is essential for anyone who consumes or conducts opinion research.
What Are Push Polls?
Push polls are a deceptive and ethically problematic technique used primarily in political campaigns. Despite the word “poll” in their name, they are not designed to collect unbiased data about voter opinions. Instead, their sole purpose is to influence—or “push”—the respondent toward a predetermined viewpoint or to spread negative information about an opponent. A push poll typically consists of a short series of highly leading questions, often accompanied by false or misleading assertions, delivered under the guise of a legitimate opinion survey.
The hallmark of a push poll is its question design. Rather than asking neutral questions like, “What is your opinion of Candidate X on the issue of taxes?”, a push poll might ask, “If you knew that Candidate X voted to raise taxes on middle-class families three times, would that make you less likely to vote for them?” The question itself becomes a vehicle for delivering a political attack. The respondent is not being asked to share their genuine opinion—they are being fed a narrative.
History and Notable Examples
Push polls have been a dark art in political campaigning for decades, but they gained widespread notoriety during the 1996 Republican presidential primaries. In that contest, push polls were used to spread rumors about candidate Bob Dole’s age and health, and about Steve Forbes’ stance on abortion. The practice has only grown more sophisticated with the advent of automated robocall systems and targeted digital advertising.
In the 2000 South Carolina Republican primary, push polls reportedly suggested that John McCain had fathered an illegitimate black child—a false and racially charged rumor. Such examples illustrate how push polls can cross the line from propaganda into outright defamation. The American Association for Public Opinion Research (AAPOR) has explicitly condemned push polling, stating that “push polls are not a legitimate form of public opinion research.”
How to Identify a Push Poll
While push pollsters often try to disguise their intent, several telltale signs can help identify them:
- Extreme length: Most push polls last only a few minutes; if a caller asks 20+ biased questions in rapid succession, be suspicious.
- Leading language: Questions that begin with “If you knew that…” or “Would you be more or less likely to support a candidate who…” often signal a push.
- Lack of anonymity: Legitimate surveys protect respondent identity; push polls often ask for names or voting intentions early on.
- No sponsor disclosure: Ethical surveys identify their sponsor; push pollsters may refuse or evade the question.
- No follow-up research: Legitimate surveys collect data for analysis; push poll results are rarely published or shared.
It is also worth noting that push polls are not the same as “push polling” done by campaign volunteers who ask a handful of soft questions before delivering a scripted talking point. That practice is simply a form of voter contact. True push polls are larger-scale, often using professional call centers or automated systems to reach thousands of voters.
What Is Survey Research?
Survey research—often simply called “polling” when focused on public opinion—is a systematic method for gathering information from a sample of individuals to make inferences about a larger population. It is a scientific discipline grounded in probability theory, statistics, and rigorous methodology. Unlike push polls, the goal of survey research is measurement, not manipulation.
Well-designed surveys use carefully worded, neutral questions to minimize bias. Respondents are selected through random sampling or other probability-based methods to ensure that the results can be generalized to the target population. Data collection can take many forms: telephone interviews, online panels, mail questionnaires, face-to-face interviews, or mixed-mode approaches. Reputable survey organizations—such as Pew Research Center, Gallup, and NORC at the University of Chicago—adhere to strict protocols for questionnaire design, sampling, weighting, and data analysis.
Key Principles of Survey Research
Neutral Question Wording
The foundation of any good survey is a question that does not lead the respondent toward a particular answer. For example, instead of asking, “Do you agree that police reform is urgently needed?”, a neutral survey might ask, “How important is police reform to you—very important, somewhat important, not very important, or not at all important?” The wording avoids judgment and gives the respondent space to express their genuine opinion.
Probability Sampling
For a survey to produce accurate estimates, the sample must be representative of the population of interest. Probability sampling—where every individual in the population has a known, non-zero chance of being selected—is the gold standard. This approach allows researchers to calculate margins of error and confidence intervals. Many modern surveys combine random-digit dialing, address-based sampling, and online panels to achieve representativeness.
Transparency and Reproducibility
Legitimate survey research is transparent. Responsible pollsters pre-register their methodology, release toplines and cross-tabulations, and disclose the sampling frame, mode of data collection, response rate, and any weighting procedures. This transparency allows other researchers to evaluate the quality of the data and to replicate the study if desired. The AAPOR Transparency Initiative sets standards that many organizations follow.
Ethical Considerations
Survey research is bound by codes of ethics that require informed consent, confidentiality, and the right to refuse participation. Respondents should never be deceived about the nature of the study, and their data must be anonymized to protect privacy. Push polls, by contrast, routinely deceive respondents about their purpose and often collect personal information under false pretenses.
Core Differences Between Push Polls and Survey Research
While both involve asking questions, the gulf between push polls and survey research is vast. The table below summarizes the most important distinctions, but we’ll explore each in depth.
Purpose
Push polls: The sole purpose is to persuade. The “poll” is a vehicle for delivering a message—usually negative—to as many voters as possible. Data may be collected but is rarely analyzed or reported; the caller is simply a propagandist.
Survey research: The purpose is to measure. Whether it’s tracking presidential approval, measuring customer satisfaction, or understanding attitudes toward climate change, the goal is to gather accurate, unbiased data that reflects the views of a population.
Question Design
Push polls: Use leading, loaded, or false premises. Questions are crafted to elicit a desired response or to plant a negative association. Often, they are not pre-tested for clarity or neutrality.
Survey research: Questions are pre-tested and revised to minimize ambiguity and bias. Open-ended questions may be used alongside scaled responses, but every item is designed to measure something specific without steering the respondent.
Sampling
Push polls: Typically use convenience samples—calling from voter lists or purchased phone numbers without any attempt at randomization. The aim is to reach as many people as possible with the message, not to draw a representative sample.
Survey research: Employs probability sampling or rigorous quota controls. Weighting is applied to correct for over- or under-representation of demographic groups. Sample sizes are calculated to achieve a desired margin of error.
Data Use
Push polls: Data is rarely analyzed or published. If results are shared, they are often cherry-picked or misrepresented to support the campaign’s narrative.
Survey research: Data is analyzed using statistical software. Findings are reported transparently, including margins of error and significance tests. Peer review and replication are encouraged.
Ethical Standards
Push polls: Operate outside any ethical framework. Deception is inherent. Many political professionals and academic organizations have condemned them as antithetical to democratic discourse.
Survey research: Adheres to codes of ethics from organizations like AAPOR, the World Association for Public Opinion Research (WAPOR), and the Council of American Survey Research Organizations (CASRO). Violations can result in expulsion and reputational damage.
Why It Matters: The Real-World Consequences
Confusing push polls with survey research is not merely an academic error—it has tangible consequences. When voters mistake a push poll for a legitimate survey, they may be swayed by false information without even realizing they are being manipulated. This erodes trust in all polling, making it harder for genuine researchers to gather data and for the public to rely on accurate measures of opinion.
For campaign strategists, the temptation to use push polls is understandable: they are cheap, anonymous, and effective at spreading rumors. But their use degrades political discourse and can lead to regulatory pushback. Several states have considered or enacted laws that require push pollsters to disclose the sponsor of the call. At the federal level, the Federal Communications Commission (FCC) has rules against unsolicited robocalls, though push polls often exploit loopholes by claiming they are conducting a “survey.”
On the other side, legitimate survey researchers have a responsibility to educate the public about their methods. The more people understand what real polling looks like, the harder it becomes for push pollsters to operate in the shadows. Public awareness campaigns, media literacy programs, and transparent reporting by pollsters all contribute to a healthier information ecosystem.
For an authoritative perspective on the ethics of public opinion research, see the AAPOR Code of Ethics, which explicitly differentiates legitimate research from practices like push polling. Additionally, the Pew Research Center’s polling methods page offers an excellent primer on how rigorous survey research is conducted.
Conclusion
The line between push polls and survey research may seem blurry to the casual observer, but in reality it is bright and clear. One is a tool for manipulation, the other a tool for measurement. By learning to identify the hallmarks of each—question wording, sampling, transparency, and ethics—anyone can become a more informed consumer of the polls that shape our public debates.
When you encounter a poll, ask yourself: Is this designed to inform me or to influence me? Is the methodology visible and reputable? Does the sponsor disclose their identity? If the answer to these questions raises doubt, you may be looking at a push poll in disguise. For researchers, educators, and citizens alike, the ability to distinguish between these two practices is not just a skill—it is a safeguard for democracy itself.