Las Vegas Sun

January 24, 2015

Currently: 59° — Complete forecast | Log in | Create an account

Political Memo:

How Harry Reid’s pollster got it right


Steve Marcus

Senate Majority Leader Harry Reid gives a victory speech during a Democratic election party at Aria on Tuesday, Nov. 2, 2010.

All the late public polling in the race between Sen. Harry Reid and his Republican challenger Sharron Angle turned out to be wrong, including the Las Vegas Review-Journal’s final Mason-Dixon poll that had Angle up 49-45. Reid won by 5.

But Reid pollster Mark Mellman nailed it. Just as he did in the California and West Virginia Senate races.

How did he do it? And what was wrong with the public polls?

Mellman was kind of enough to take some time last week to walk me through it, and here are the key points:

• Pollsters too often subscribe to the “likely voter” fallacy. They seek out likely voters by asking them questions about their past behavior, which should give some indication of whether they’ll actually vote.

But Mellman looks for the likely electorate. The distinction is important. As Mellman notes, there are “unlikely voters” who actually wind up voting. And “likely voters” who wind up not voting. Every election there is some percentage of both, and Mellman has clearly mastered the art and science of modeling the likely electorate. It seems that in the Reid race, unlikely Reid voters — Hispanics come to mind — actually voted, with the help of the Reid turnout operation and Angle’s immigration ads that were deeply offensive to these voters.

• The cell phone problem. By now, this one is fairly well known, but as Mellman said, “It is a real problem.” To begin with, federal law prohibits automated calls to cell phones. So any poll conducted that way can’t call any cell phones. “There’s a real difference between people we reach on land lines and people on cell phones. If you’re only calling land lines, you get a distorted picture.”

How distorted?

A Pew Research Center analysis showed that a quarter of all Americans can be reached only by cell phone. They tend to be younger, a demographic dominated by Democrats. Pew estimated the land-line bias gives Republicans 4 to 6 percentage points in polls.

• Hard-to-reach voters. People don’t pick up their phones. A truly random sample requires the pollster to be persistent and try and try again with the same voter. Otherwise, you don’t get a truly random sample; you get a random sample of easy-to-reach voters.

Again, this has a distorting effect. Mellman’s group will try people six or seven times. Many pollsters are not as persistent because it’s cheaper to just move along.

“In Nevada these factors all mattered and all mattered meaningfully,” Mellman said.

Mellman didn’t address Hispanic voters, but polling experts including Nate Silver have speculated they may have been undercounted in polls.

(Sun columnist Jon Ralston was the earliest and most vocal critic of public polling in the race.)

The Reid camp said all along that it was confident because of its internal polls. Reporters were rightly skeptical, especially given that the campaign wasn’t sharing the data.

The key, though, is that the Reid campaign wasn’t using its polls as part of a press strategy, trying to goose up supporters. They wanted good information from which to craft a strategy.

“There’s no sense paying for bad information,” Mellman said. “Our job starts at getting it right. Then we use and interpret the data to build a strategy. But getting it right is the foundation.”

Mellman addressed the potentially damaging effect of bad public polling. “The problem is that these things can have an impact.” A bad poll can hurt a campaign, creating a narrative of defeat in the media, deflating donors and volunteers.

“So the media has a special responsibility to get it right. If you’re not going to get it right, then don’t bother.”

A novel concept in some quarters.

Join the Discussion:

Check this out for a full explanation of our conversion to the LiveFyre commenting system and instructions on how to sign up for an account.

Full comments policy

Previous Discussion: 1 comments so far…

Comments are moderated by Las Vegas Sun editors. Our goal is not to limit the discussion, but rather to elevate it. Comments should be relevant and contain no abusive language. Comments that are off-topic, vulgar, profane or include personal attacks will be removed. Full comments policy. Additionally, we now display comments from trusted commenters by default. Those wishing to become a trusted commenter need to verify their identity or sign in with Facebook Connect to tie their Facebook account to their Las Vegas Sun account. For more on this change, read our story about how it works and why we did it.

Only trusted comments are displayed on this page. Untrusted comments have expired from this story.

  1. > If people had bothered to talk to Angle and heard what she really said,If people had bothered to talk to Angle and heard what she really said,<

    I heard angle tell a group of Hispanic kids that some of them looked Asian to her. I also saw her attack Hispanics as thugs. makes you wonder why she lost, eh?

    off on another bent --- how in the world does the RJ continue to exist when they attack their customers? take a read of Sherm's and Mitchell's columns today and it's everyone in the world but them that screwed the pooch last Tuesday.

    The sun is a customer of the RJ, under constant attack.

    The casinos are customers of the RJ, under attack for taking employees to the polls. would you spend ad money with the RJ if you were them? I sure wouldn't.

    Hispanics are customers of the RJ, under attack because they're portrayed as the thugs angle sold them as.

    one will never improve without self reflection and honest assessment. so the RJ is doomed to continue its downward spiral into the ground. not saying that's bad --- but I do hope the empty-headed leadership over on Bonanza doesn't wonder why they're dead meat in the long run.

    Note to Sherm --- come get that free paper you dropped off today before I call the cops for your littering my driveway.