The Washington Post

Are women more likely to say ‘I don’t know’ to poll questions? It appears so.

A fascinating post at The Upshot written by pollster Allison Kopicki introduces an interesting idea: that women are more likely to choose the "I don't know" option in polling. If our quick analysis is any guide, she's right.

Kopicki offers an example:

For example, we asked, “Would you like to see Marco Rubio run for president of the United States in 2016, or not, or don’t you know enough about Marco Rubio to say?” The results, at first glance, gave Mr. Rubio what looks like an 8-point advantage among Republican and independent men over women. But in reality, his “don’t knows” among Republican and independent women were 17 points higher. So it was actually hard to tell what women really think of him.

She theorizes on the reason. Pollsters are asking people for their opinion on a topic, assuming they've formed one. Research, Kopicki notes, indicates that "women hold themselves to a higher threshold of certainty before they offer an opinion," so given the chance for nuance, they take it.

We wanted to test this hypothesis. We went to Public Policy Polling, a Democratically-aligned polling firm that offers a particularly helpful for our experiment: public cross-tabs on poll data; that is, a breakdown of answers by gender and age and party. (It's also helpful to use data from one firm, because the methodology will be consistent.) We looked at eight recent polls, extracting 98 politics-related questions. (The polls are listed at the bottom of this article.)

Over the course of those 98 questions, a higher percentage of women than men responded "not sure" to the question 70 percent of the time. And on average, they expressed about a third more uncertainty. (In other words, if 6 percent of men said "not sure," on average, 8 percent of women did.)

What was really striking was that one category of questions was noticeably different. Twenty-four of the questions asked poll respondents to choose a 2016 presidential favorite between Hillary Clinton and another candidate. On those questions, the difference evaporated: half of the time, women expressed less uncertainty, half of the time, they expressed more.

When we took those questions out of the broader pool, then, the difference between men and women widened. On non-Hillary horse-race questions, women said "not sure" at a higher rate than men 77 percent of the time. And the level of uncertainty also increased, from about a third to 43 percent higher.


One last note. As the level of uncertainty overall increased, the extent to which women expressed a higher level of uncertainty dropped. The more uncertain men were, the smaller the gap between the genders.

This is far from definitive (and uses a small sample size) but it certainly supports Kopicki's theory and experience. Does it mean polling is inaccurate? No, but as in the Rubio example it suggests that gender differences when asked to choose between candidates may be overstated. Kopicki says that it does influence her as a pollster: Her firm no longer allows an "I don't know" option.


The PPP polls we used: New Mexico (Mar. 27), Michigan (Apr. 9), Texas (Apr. 14), Wisconsin (Apr. 24), Arkansas (May 1), North Carolina (May 5), North Carolina (May 14), Alaska (May 14).

Philip Bump writes about politics for The Fix. He is based in New York City.

The Freddie Gray case

Please provide a valid email address.

You’re all set!

Campaign 2016 Email Updates

Please provide a valid email address.

You’re all set!
Comments
Show Comments
The Republicans debated Saturday night. The New Hampshire primary is Feb. 9. Get caught up on the race.
Highlights from Saturday's GOP debate
Except for an eminent domain attack from Bush, Trump largely avoided strikes from other candidates.

Christie went after Rubio for never having been a chief executive and for relying on talking points.

Carson tried to answer a question on Obamacare by lamenting that he hadn't been asked an earlier question about North Korea.
The GOP debate in 3 minutes
Listen
Play Video
Quoted
We have all donors in the audience. And the reason they're booing me? I don't want their money!
Donald Trump, after the debate crowd at St. Anselm's College booed him for telling Jeb Bush to be "quiet."
Listen
Play Video
New Hampshire polling averages
Donald Trump holds a commanding lead in the next state to vote, but Marco Rubio has recently seen a jump in his support, according to polls.
New Hampshire polling averages
A victory in New Hampshire revitalized Hillary Clinton's demoralized campaign in 2008. But this time, she's trailing Bernie Sanders, from neighboring Vermont. She's planning to head Sunday to Flint, Mich., where a cost-saving decision led to poisonous levels of lead in the water of the poor, heavily black, rust-belt city. 
55% 38%
Upcoming debates
Feb. 11: Democratic debate

on PBS, in Wisconsin

Feb 13: GOP debate

on CBS News, in South Carolina

Feb. 25: GOP debate

on CNN, in Houston, Texas

Campaign 2016
State of the race

To keep reading, please enter your email address.

You’ll also receive from The Washington Post:
  • A free 6-week digital subscription
  • Our daily newsletter in your inbox

Please enter a valid email address

I have read and agree to the Terms of Service and Privacy Policy.

Please indicate agreement.

Thank you.

Check your inbox. We’ve sent an email explaining how to set up an account and activate your free digital subscription.