What The Hell Happened Last Night?

by: Chris Bowers

Wed Jan 09, 2008 at 15:29


Was it massive polling error? Were women motivated by a double standard imposed on Clinton for showing emotion? Was it the Wilder / Bradley effect, where white voters lie about supporting African-American candidates to pollsters out of perceived social pressure? Was it something else? Twelve public polling organizations were in the field in New Hampshire entirely after the Iowa caucuses. One of these organizations concluded interviews on Saturday, January 5th. Seven concluded interviews on Sunday, January 6th. Four concluded interviews on Monday, January 7th.. The average of the final results from these pollsters is as follows:

Obama: 37.25%
Clinton: 29.92%
Edwards: 18.92%
Richardson: 5.75%

Now, compare this to the results, with only one precinct outstanding
Clinton: 38.99% (+9.07, +30.3%)
Obama: 36.39% (-0.86, -2.3%)
Edwards: 16.91% (-2.01, -10.6%)
Richardson: 4.60% (-1.15, -20.0%)

While Obama and Richardson both saw their support drop from the final polling average, Edwards saw his drop as much as Obama and Richardson combined. It is possible that Edwards saw his numbers drop for a different reason than Obama or Richardson, or even that all three saw their numbers drop for different reasons. However, given Obama's numbers dropped the least, both in overall terms and in percentage terms, I am not convinced of a "Wilder effect here at all. Or, at least, I am not convinced that the "Wilder effect" was the only dynamic in play. It seems equally plausible that Edwards and Richardson saw their support drop much the way third-party support always drops from the polls to the final results. The lower the perceived chance a third-party candidate has the win, the larger their expected drop from the polls to the final results. It would appear that those voters broke toward Clinton.

Here is what I think happened, in chronological order:
Chris Bowers :: What The Hell Happened Last Night?
  1. First, Clinton probably had a superior absentee voter program, which gave her a small boost. Likely voters are not guaranteed voters, but those who have already voted are. Before they were rebalanced, the exit polls showed Obama narrowly ahead of Clinton, 39%-38%. Absentee voters were not included in the exit poll, and a successful and strong absentee voter program can indeed account for a 3-4% net swing, especially since Clinton held a commanding 48%--31% lead among voters who had their minds made up the longest. This is also, for example, is why Brian Bilbray outperformed Francine Busby in final polls in CA-50.

  2. Second, the polls were somewhat wrong, probably due both to a very mild "Wilder effect" and to improper weighting of the electorate / measurement of likely voters. However, the polls don't have to be more than 1% wrong in order to make this scenario work (although the more wrong the polls were, the easier this scenario works). Given that Rasmussen, a polling firm that utilizes the automated, IVR methodology, showed the campaign to be a little closer than other pollsters who used live interviews, there probably was a mild "Wilder effect" of about two percent or so. IVR polls should eliminate the Wilder effect altogether, and so it is useful to look to them as a baseline when determining the presence of a Wilder effect.

  3. Third, there was a break toward Clinton on Election Day itself, when no polls were taken. A survey of 2004 and 2000 polls taken between Iowa and New Hampshire shows there is a tendency for Iowa bounces to begin to recede after three to five days, meaning that by Election Day Clinton should have been pulling back on Obama anyway, with or without a sympathy vote. Exit polls back this up. Among voters who decided who to vote for in the last week, Obama led Clinton 43%-28%, probably due to a huge surge in the two days after Iowa. Among voters who decided in the three days before the election, Obama still led by a smaller amount, 37%--34%. Among those who made up their minds on Election Day itself, the bounce had faded entirely, and Clinton pulled into a 39%-36% lead. That accounts for at least another half of a percent. Of course, the sympathy vote probably didn't hurt.

  4. Fourth, Edwards and Richardson supporters who favored Clinton as a second choice disproportionately broke away and choose Clinton, since the narrative implied both that she was the only other candidate who could win and that she needed help to do so. We all saw this, for example, in 2000, when Nader was a factor and Gore was in a position similar to Clinton. In the end, Nader underperformed his final polls by 1.2%, and Gore outperformed his final polls by 2.0%, providing Gore enough of a boost to win the popular vote. By way of contrast, Edwards and Richardson supporters who favored Obama as a second choice probably didn't think Obama needed any help. This could have added as much as 3% to Clinton's total.

  5. Fifth, Clinton was assisted by the ballot order, probably to the tune of about 3%. Clinton was at the top of the ballot, and it is a well-known long and long-studied phenomenon in politics that placement at the top of the ballot provides a not insignificant edge to any given candidate.

This is a "perfect storm" scenario that requires no significant polling error, no significant Wilder effect, and no significant sympathy effect for Clinton. The top of the ballot, a superior absentee voter program, a naturally fading bounce, and an also somewhat typical "third party effect" from Edwards and Richardson supporters can, in and of itself, account for the ten-point swing from Obama to Clinton. However, that it requires all of these less than mysterious pieces to fall into place makes it somewhat dubious. The most likely scenario is that the four reasons I provide all played a role, but by less than the amounts I suggested here. Further, the three most common reasons being given for yesterday's shocker, Wilder effect, sympathy effect, and massive polling error, all also probably played a role, but less of a role than is being trumpeted by major news outlets. It was probably just a perfect storm for Clinton incorporating all seven rationales.

Still, this result should give real pause to anyone like me who believes pre-election final poll averages are almost always a very accurate predictor of final results. If a whole host of factors fall into place, clearly it is possible to bust up final averages by as much as 10%. Clinton got a perfect storm, drawing on as many as seven different factors. It will take a long time to sort this out with any certainty. In fact, certainty may never come. The future performance of polls in predicting final results will now be watched closer than ever. I guess they are "on notice" now.


Tags: , , , , , , , , , , , (All Tags)
Print Friendly View Send As Email
Ok (4.00 / 1)
Since we can't prove what happened, I'll buy this explanation. Sure is better than Cable News, who seem to repeat the same explanation...
"Wow, the polls were wrong! Let's play a clip of Hillary crying again!"


"Don't hate the media, become the media" -Jello Biafra

Made me chuckle (0.00 / 0)
Thanks.

[ Parent ]
Lesson (0.00 / 0)
Never give up, and conversely, never take it for granted.

John McCain won't insure children

Great analysis, Chris. (4.00 / 2)
I do think, though, that the "sympathy" vote after Clinton's "sincerity" moment was a likely factor that helped push some final-day undecideds her way.  And I think, as your analysis suggests, that having so many dynamics unfolding and interacting in so few days between Iowa and NH made polling extremely difficult.

I don't know how the independent numbers broke, but I wouldn't be surprised if uncertainty/volatility among them regarding an Obama vs. McCain vote also added something to the collective error factor.


Voting machines (4.00 / 2)
It's a sad commentary on our democracy that there can be any doubt as to whether the votes were recorded correctly, adding an eigth contributing factor.

The integrity of the vote should transparent and unimpeachable.


Weekend Polling (4.00 / 1)
The fact that all the polling was done over the weekend is almost certainly the main problem.  There is a reason pollsters try to avoid them!

what about field? (4.00 / 1)
Maybe you've already covered this elsewhere, but what about a superior field operation? Isn't that supposed to be worth to 2-3%?

I think having a strong field operation at the same time as a strong external motivating event ("the sympathy effect") provides a multiplicative factor that makes a huge difference. [As in, luck favors the prepared.]

They call me Clem, Clem Guttata. Come visit wild, wonderful West Virginia Blue


... (4.00 / 1)
Even if a good field operation is worth 2-3%, I doubt Clinton's was 2-3% better than Obama's. But yeah, no doubt this played some role as well.

"Don't hate the media, become the media" -Jello Biafra

[ Parent ]
Polls should cover field (4.00 / 1)
Except for absentee ballots, polls should effectively cover field operations. Voter contacts made through field campaigns don't exist in a different plane of existence.

[ Parent ]
The Wilder Effect... (4.00 / 1)
...and the Tom Bradley effect were both during general elections. How did Doug Wilder and Tom Bradley get to be the Democratic nominees? Was it by winning primaries? If so, it would seem to argue against the Wilder (or Bradley) effect being a significant factor in a Democratic primary.

CD-1, CD-2 (4.00 / 1)
Obama won northern NH by 400 votes but lost the south (CD-1) by around 8,000 votes (56,830 to 48,928). 

Clinton benefited by a number of cultural factors.  Hard work is valued in the old mill towns and their suburbs.  It is not something to be laughed at or sneered at.  Clinton organized better in NH and the personal touch counts for a lot in CD-1 (ask Carol Shea-Porter who was elected as a freshman to Congress last year despite spending only $287,000.  Shea-Porter worked Manchester hard and worked it personally.  New Hampshire has a history of electing women to high office (US House, Governor); sexist jokes backfired there. 


FYI (0.00 / 0)
Interesting post over at Pollster.com
http://www.pollster....

"Don't hate the media, become the media" -Jello Biafra

So what I wonder (0.00 / 0)
Given all of this, how does Obama turn things back in his favor again?

Chris, I'd be curious if you have any thoughts on this subject, your "PEOPLE, HERE'S HOW TO BEAT OBAMA" bullet-point list was quite detailed. :)


2000 election - you're wrong, Chris (0.00 / 0)
Chris, Al Gore lost New Hampshire in 2000 by about 7000 votes, while your point #4 implies that he won it.  New Hampshire was the one state to flip to blue in 2004.

Great post other than that.


I'm talking national polls in 2000 (n/t) (0.00 / 0)


[ Parent ]
Cross-tab comparison of ARG poll and exit poll. (4.00 / 1)
I know sub-populations in these polls are subject to a lot of error, but here's the Jan 7 ARG poll compared with the exit poll:

  . . . . . .  ARG  . .  Exit Poll
  . . . .  HRC BO  . HRC BO  .  Diff
Men . . .25  44  29  40  -19->-11
Women 35  37  46  34  -2 -> 12
Dem . . .34  37  45  34  -3  -> 12
Indep . . 25  44  31  41  -19->-10

The big jump here for Clinton is among women and Democrats.  The five reasons Chris cites above may all be true, but most of them don't explain the huge shift in the sub-populations voting for Clinton.  Also, as others have pointed out, though Obama dropped a bit, Clinton rose much more, again suggesting that her big boost came from women and Democrats switching from non-Obama candidates.  On the other hand, ARG's likely voters were broken down as 63% Dem, 37% Indep, whereas the actual voter breakdown was 54% - 44%.  So although Obama didn't do as well with independents as predicted, there were more independents to ameliorate that.

More on the exit poll in my diary.


What percent of the electorate was female, vs what percent of the polling samples were female? (0.00 / 0)
I have a hard time believing that saturation coverage of The Tear on Monday didn't have a leading effect.  Rarely does the media have a full day of playing the same video clip over and over like that.  That's not even getting into whatever their commentary in between showing the clip might have been.

I'm leaning toward the conclusion that the press and especially the televised press has WAY too much influence over this process.  The Clinton Takedown back around Labor Day, when the press singlehandedly knocked like 10% off her national numbers, is when I first started thinking that during this particular campaign.


Looks like it didn't work, though (0.00 / 0)
They tried to take her down and got a backlash.  Kind of like when they and DeLay and Ken Starr tried to take Bill down and he went up in the polls.  She always goes up in the polls when attacked.  Remember she had a multi-digit lead in NH for a long time.  I would guess that attention to absentees and getting out the solid voters through field helped her tremendously.  I discount the Wilder /Bradley effect in Dem primaries.  They are mostly not our people.

John McCain--He's not who you think he is.

[ Parent ]
You've hit a good point (0.00 / 0)
I think that the huge difference in turnout by women for the Democratic primary is the # 1 explanation -- see my post below.

[ Parent ]
Wilder effect. (0.00 / 0)
For what it's worth, I think this effect has consistently been much more prevalent in the south than in the north. When Tom Bradley ran for Gov, southern and central CA had a much higher % of former white southerners as part of their population than it has today. Wilder was obviously a southerner, as was Ron Kirk, who lost the Senate race in TX by 10 points after being tied in the polls. Northern blacks- including Carol Moseley Braun, Obama, Harold Washington, and Deval Patrick- haven't seemed to have the same dropoff problem. 

Extraordinary turnout of women voters (0.00 / 0)
MSNBC reported Tuesday night that exit polls showed the Democratic vote was 57% women, 43% men.  MSNBC also reported that women voted 47% for Obama.

The Suffolk poll (only one that had Hillary within margin or error to Obama) reported that its sample included 53% women, 47% men, and that about 42-43% of women picked Hillary in the  survey.

If the MSNBC exit poll reports are essentially correct, the difference was in the extraordinary turn-out of women voters, with a little bit perhaps in increased percentage for Hillary among women voters.  The difference in pre-vote estimates and the actual vote does not require any "Bradley-Wilder-Gantt" effect.

IMO Hillary's victory can be explained entirely by factors relating to turnout, primarily: (1) superior turn-out infrastructure based on support for Clinton from the party organization in NH; (2) some women voting for Hillary on the sympathy factor, particularly motivated by the MSM dumping on her for showing some emotion; and (3) possibly absentee ballots.

The biggest loss yesterday IMO was in the credibility of the MSM pundits who (a) predicted outcome based on the gross percentage votes in the surveys, without looking at the internal factors, and (b) cast about for all manner of wild explanations for their prognostication errors. No pundit that I heard suggested that the pundits had screwed up by interpreting the survey results too literally.

PS  One of the post-Iowa NH polls that posted internals online showed a strong move of independents from voting 2-to-1 in the Democractic primary to voting 50-50 in the two primaries. I do not know whether this trend (if accurate) meant that some independents started classifying themselves as Democrats or whether McCain's late-breaking viability in the polls attracted a substantial number of independents to switch from the Democrats to the Republicans. [Or some other factors...]


independent vote (0.00 / 0)
If you look at the independent vote - Obama got the most, then Clinton, then McCain .  That's right Hillary Clinton received more independent votes in New Hampshire than John McCain.  votes gained there also

It was stolen: IMHO (0.00 / 0)
If you care to look up Diebold on goole you will find plenty of information to muse upon

From slashdot.org

"Multiple indications of vote fraud are beginning to pop up regarding the New Hampshire primary elections. Roughly 80% of New Hampshire precincts use Diebold machines, while the remaining 20% are hand counted. A Black Box Voting contributor has compiled a chart of results from hand counted precincts vs. results from machine counted precincts. In machine counted precincts, Clinton beat Obama by almost 5%. In hand counted precincts, Obama beat Clinton by over 4%, which closely matches the scientific polls that were conducted leading up to the election. "

If you dont think this is going to be huge you dont know nothing.

Change
"We must break up the banks and never again let them get so big that they distort our politics and take down the economy.


Donate to Open Left








Friends of the Earth thanks the OpenLeft community for the ideas you generate and your contributions to the progressive movement.

As an anti-spam measure, there is a 24-hour waiting period after registering before new users can comment.
blog advertising is good for you
blog advertising is good for you
SEARCH

   

Advanced Search