National House Ballot Monitor

by: Chris Bowers

Thu Oct 29, 2009 at 13:08


Today, I am excited to announce a new feature on Open Left that will be updated every weekday between now and the 2010 midterm elections: the National House Ballot monitor. It is simply a small button that will appear over Quick Hits, providing my latest forecast of the national House vote. The button will link to a table, like the one below, that includes all of the polls I used to produce the forecast.

The current forecast shows Democrats with a 5.3% advantage in the National House Ballot. For the sake of comparison, Democrats won the 2008 House national vote by 8.9% and the 2006 House national vote by 7.9%. Republicans won by 2.6% in 2004, and by 4.6% in 2002.

In terms of predicting seat totals, the National House ballot is, at best, a crude and inexact measure. As the 2010 elections approach, a far more detailed, seat by seat forecast will take prominence over the national House Ballot monitor. However, it is still a useful stat to see where the current national political environment stands.

The forecast is based on a new and improved electoral forecasting methodology that I will be using in 2010. My preliminary research--which I hope to complete this weekend and release next week--indicates that this new method is about 7-8% more accurate in terms of mean error, and 15-16% more accurate in terms of median error, in predicting the final margins of 2008 statewide elections than Pollster.com and fivethirtyeight.com. Further, the method actually performed slightly better in 2006 than in 2008, showing that its strong performance in 2008 was not a fluke.  I have yet to examine how this method would have fared in 2004, which is why I still consider the research preliminary.

The methodology is pretty straightforward, and I explain it in the extended entry. For now, here are the polls used in creating the current forecast:

National House Ballot, 2010
(Polls can be found here and here)
Pollster Dates Democrats Republicans
Total 10/29 41.9 36.3
NBC / WSJ 10/22-25 46 38
Rasmussen 10/19-25 38 42
Daily Kos 10/19-22 37 28
YouGuv 10/18-20 45 36
PPP 10/16-19 48 40
ABC / WaPo 10/15-18 51 39
Rasmussen 10/12-18 37 42
Daily Kos 10/12-15 35 29
YouGov 10/11-13 47 37
Rasmussen 10/5-11 39 41
CBS 10/5-8 46 33
Daily Kos 10/5-8 34 28
YouGov 10/4-6 47 37
Gallup 10/1-4 46 44
Rasmussen 9/28-10/4 43 39
Daily Kos 9/28-10/1 35 29

Chris Bowers :: National House Ballot Monitor
Methodology:

  1. Until the final six weeks of the election, take the simple mean of virtually all polls where the majority of interviews were conducted over the last 30 days.

  2. During the final six weeks of an election, use the simple mean from the last 15 days.

  3. Do not include Zogby Interactive polls and Columbus Dispatch polls, due to their horrendous past performance and questionable methodologies.

  4. Do not include Strategic Vision polls, as it is starting to seem likely those are not real polls.

  5. Include campaign-funded polls. Further, if there is more than one poll from a single organization, include all of them.
The basic idea is to cram as many polls with sound methodologies into the averages as possible, and weight them evenly to include more overall data in the sample. Because voter preferences don't really change that much in high-profile elections, I thought this method might produce a more accurate result through logic of regression to the mean. It seems to work pretty well, as my research has shown so far.

This is different from my 2006 and 2008 methodology in that it includes polls from 15 days out from an election, instead of only 8. Further, campaign funded polls, and multiple polls from a single polling firm, are now included. All of these changes were made to include more polls in the averages, since my previous methodology was about 10-20% less accurate than Pollster.com and fivethrityeight.com. Since they had already raised the bar so high, and since they will probably improve their methodologies for 2010 even more, it was time for Open Left to step it up. I believe we have, as I intend to show in detail on Monday.


Tags: , , , , (All Tags)
Print Friendly View Send As Email
yeah, this isn't going to help much until we know seat estimates (0.00 / 0)
but it's a good starting point. i know we're too far away to follow each race.

Great work (0.00 / 0)
I look forward to following this addition Chris.  Any preliminary thoughts on what a 5.9% edge translates into seats?  I know any prediction would be very rough, but I'm curious what your thoughts are.

Incumbency Advantage? (0.00 / 0)
I'm curious how strong the incumbency advantage is.  Does a 0% edge lead to a 50/50 House, or does it lead to no change?  I assume it is somewhere in between and changes for each district depending upon how long the incumbent has been in office, making a good rule of thumb difficult.

[ Parent ]
Missing something (0.00 / 0)
Chris, if I remember right, the generic representative ballot preference question has a track record of overestimating the election-day Democratic edge by at least several points.  I can't remember citations for this point, but I think it's been discussed at pollster.com sometime in the past few years, and probably other places.

Generally speaking, yes (4.00 / 1)
But this year Rasmussen is added into the mix with a data point every single week - this was not the case in previous years.  Rasmussen tilts towards Republicans, so this year the average of all polls should actually be close to the real result.

[ Parent ]
Since "Democrats" includes DLCers... (0.00 / 0)
...Blue Dogs, and their unaffiliated pro-corporate, pro-NAFTA, anti-labor, anti-choicers, neoliberal, anti-progressive candidates -- such a number says little for progressives and lefties and populists and peace&justice  folks, except as another indicator of where most of the Wall St, hedge fund, banksters, "defense" contractors, "healthcare" for-profiteers, etc "contributions" will be flowing.  

good idea (0.00 / 0)
and may your numbers change often and most upward.

two things: (0.00 / 0)
1) I believe the Strategic Vision issue is not that Strategic Vision (R) has been producing fake polls -- they're just fine -- but that a new "pollster" came around and decided to also name themselves Strategic Vision and publish fake polls under that name. I am not sure about this though -- I just recall reading it -- so correct me if I am wrong.

2) While not playing favorites with polls is sensible enough, wouldn't a simple weighting by sample size (or square or square root or whatever statistically proper function of such) be worth doing?


Donate to Open Left








Friends of the Earth thanks the OpenLeft community for the ideas you generate and your contributions to the progressive movement.

As an anti-spam measure, there is a 24-hour waiting period after registering before new users can comment.
blog advertising is good for you
blog advertising is good for you
SEARCH

   

Advanced Search