Study: "Undecided" Voters Have Usually Already Decided

by: Daniel De Groot

Thu Aug 21, 2008 at 21:41



Even if they aren't fully aware of it consciously.

A new study to be published in Science this week has found it can predict the decision of "undecided" people with 70% accuracy:


The team tested the "automatic mental associations" of 129 residents of Vicenza, Italy, about a controversial expansion of an American military base in their community.

In a computer test, participants were asked to rapidly rate a series of words, interspersed with pictures of the base, as either positive or negative. One week later, when participants made a conscious choice to support or oppose the base expansion, researchers found that those choices invariably reflected the initial automatic associations.

Comments inside.

Update - The sample only included 33 undecided voters (the article I read did not convey that, but the original from Science does.  My scepticism goes up a bit (though I think a bigger study would find a similar result).  Science is highly respected, but that doesn't preclude them from running with an unconvincing study.  Hopefully someone else repeats this research.  

Daniel De Groot :: Study: "Undecided" Voters Have Usually Already Decided
129 residents isn't all that big a sample, but then 70% accuracy is much much higher than any kind of fluke one could reasonably expect for even this moderate sample size (feel free to do the math if you're statistically inclined).  Another independent study confirming this result would be needed for greater certainty.

I'm fairly sure they're on to something as it makes a lot of intuitive sense to my thinking.  What we often call "ideology" is often a kind of fairly deeply seated psychological heuristic that is present in most people.  This is probably why so many people who aren't particularly politically aware or highly educated will consistently take certain positions (which we usually label conservative and liberal) on sets of seemingly unrelated issues.  

So your preset heuristic for making these kinds of decisions will already bias you to one way even if you don't know the formal ideological debate club rationale for it.  

Also of course, there are other factors - if you stand to benefit or lose personally from the larger base, if you had some kind of traumatic experience with a soldier from the base, if a person you respect has taken a side and so on.  

As to what this means for elections:  My early thought is that the goal with undecided voters is not to convert them to your side so much as find the ones already disposed to support you and motivate them to do so.  It might come down to finding a trigger to force them to consciously decide so that they stop playing a self-imposed role of "objective observer" and take your side.

Finally:


There are some technical difficulties to be overcome before the research can be applied to public opinion polling . But Gawronski said it could eventually make it easier for pollsters to predict how the undecided will ultimately vote and, consequently, to predict the outcome of elections with greater accuracy.

He said some researchers in the United States are already using automatic association tests to determine why undecided voters seem to be flocking to Republican presidential nominee John McCain, rather than Democrat Barack Obama. The results could prove controversial.

McCain may have stumbled onto this already (or this kind of thing was already known through private research to the marketing gurus in the Republican camp).  

Tags: , , , , (All Tags)
Print Friendly View Send As Email
Antonio Damasio's book Descartes' Error (4.00 / 2)
shows that most of our decisions are rooted in emotion, not rational weighing of pros and cons. He's a neurologist, but the book is highly readable.

Join the Iowa progressive community at Bleeding Heartland.

70% isn't that impressive (4.00 / 2)
In a two person race, you get 50% by flipping a coin. Give me simple demographics like gender, age, income and place of residence and I can probably get close to 70%.

John McCain or Barack Obama?

hmm (4.00 / 1)
Assuming you can get to 70% accuracy with some basic demographics (seems plausible to me), how much higher can you get if you also had some form of pre-test factors like were done in this study?  90%?  This adds another ability of predictive power to polling.  

Also it says something about the human conditions.  Not everything has to have electoral campaign application to be interesting.


John McCain is anti-choice


[ Parent ]
Yeah (4.00 / 1)
Hell, what kind of prediction accuracy would you get if you just asked the single question "well, who are you leaning toward?"

Compare to a control, people! :P


[ Parent ]
I think you missed the point. (4.00 / 1)
This isn't about them trying to figure out how to better predict outcomes, it's trying to figure out how people came to those conclusion.

So this is also aimed at explaining what is at the basis of "well, who are you leaning toward?"'s predicting power.


[ Parent ]
Actually, This DOESN'T Prove That Individual Undecideds Have Made Up Their Minds (4.00 / 4)
What it shows is a statistical predetermination.  Meaning that more folks with a certain set of associations will vote one way while more of those with a different set will vote another.  But this is a far cry from predicting what individual voters will do, much less proving that they have already decided.

Of course, this doesn't invalidate your ultimate conclusion--that it makes more sense to surface latern support than to try to persuade.  It's just that the latent support is itself probabilistic, at least at our current state of understanding.

"Senate passes expanded GI bill despite Bush, McCain opposition"


Another subtle problem here (0.00 / 0)
Remember how generally speaking these predictor functions are calculated.

It's done post hoc, and you can regress the indicator (who they ultimately voted for) against a set of variables which I'd guess is fairly large.  Only a subset will likely be strongly correlated with the indicator.

Now go back time and ask yourself, given that you have all of that data you originally had. Would you even know which of the data was relevant?

Statistical estimators work on the assumption that if you run the election N times, the estimator will be correct a certain percentage of the time.  But elections are not actually run N times: they are run once, and they are all different.

There are ways of dealing with this (there are Bayesian techniques people use, for example), but I'd be very curious as to how the investigators dealt with this issue.


[ Parent ]
The ideology of undecidedness (4.00 / 3)
There's another persistent 'ideology' out there that places a value on declaring oneself "undecided."  That's led to this whole category of people who are endlessly courted and queried because, unlike the rest of us sheep, they're "still waiting for the candidates to make their cases" or whatever.  I think we'd all be better off if "undecidedness" was more like "ignorance," a truly disreputable state of being.  

thx (4.00 / 1)
I cut a paragraph about this phenomenon because it felt like a detour, but yeah, I've met (and been annoyed) by those who enjoy making a show of their "rationality" through a charade of "deciding" who to support in every election.

John McCain is anti-choice

[ Parent ]
Let's See, Will I Go With The Homicidal Maniacs This Time? (4.00 / 2)
I really have to wait for the non-homicidal maniacs to make their case, before I can really sure.

Or is that the non-(homicidal maniacs)?

This definitely needs a lot more study for a truly rational decision.

"Senate passes expanded GI bill despite Bush, McCain opposition"


[ Parent ]
oh, come on (0.00 / 0)
The "study" had 33 undecided voters.  It's a joke.

New Jersey politics at Blue Jersey.

Where do you read that? (0.00 / 0)


John McCain is anti-choice

[ Parent ]
Hardly a joke. (0.00 / 0)
Hardly a joke, although the results are not as certain as it's made out to be.

This isn't a study designed to predict who's going to win in November. This is a scientific study which has it target on how people make up their mind. It's not an opinion poll. The margin of error can be a lot larger without invalidating the result.

And yes speaking as somebody who has actually first hand knowledge on how such studies are performed a sample size of 33 is hardly uncommon for such test and far from a joke.

It's actually quite normal. Researchers tend to have very limited budgets and can't start up mega sized double blind tests without checking first if there is actually anything to research first. So they first perform this sort of test and only if the result is interesting enough do they perform a larger test.

Overall these small test are trustworthy enough to discern a general trend. And seeing that this result is already in line with other tests already done and general experience I doubt any further funding will be given for a larger test because the practical value will be little.


[ Parent ]
Kind of a joke (4.00 / 1)
A sample size of 33 gives a margin of error of 17%.  That means with 95% probability their predictors had some small effect.  Not really enough to be more useful than demographics, though.

If they found something that was 70% or more reliable with a larger sample size and that could be polled, that would be useful for polling undecided voters.


[ Parent ]
You are correct on that, But... (0.00 / 0)
But seeing that the main purpose of this study is to see if there is a statistical significant support for a theory explaining how people make up their mind instead of creating a better prediction model. It did exactly what it supposed to and was thus hardly a joke.

That as a prediction method it is hardly an improvement doesn't matter as that wasn't the point of the study.

The problem is that people read to much into the result of the study as to how it relates to their own situation instead of what the actual aim of the study was.


[ Parent ]
Don't know about the "study" ... (4.00 / 1)
but this accords with my experience as a canvasser. Lots of people you talk with at the doors won't give an opinion or claim not to have made a choice, but experienced door knockers come away convinced they know what the voter's choice will be on election day. I can't test whether they are right, but I am very sure they are.

The same canvassers are the kind who can tell, on volunteer recruitment phone banks, which of the people who say they will come in will actually flake.

Can it happen here?


<i>Science</i> (4.00 / 2)
My experience as a scientist has been that Science frequently publishes small-scale studies with intriguing, suggestive, or provocative results that can't be considered conclusive due to the study size, but may encourage funding of larger studies on the same subject, to be published in the more rigorous journals specific to the fields in question.  It's more a journal for kick-starting exciting new areas of research than for publishing final, definitive answers to important questions.

Donate to Open Left
ELECTION 2008 Presidential Forecast
Senate Forecast
PREMIUM AD

ADVERTISEMENTS



MENU

OpenLeft in your inbox!

 

Or, subscribe to each author individually.

OPTIMIZE MCCAIN About
Tips
McCain
John McCain
SEARCH

   

Advanced Search

OPENLEFT VIDEO WALL
Donna Edwards Thanks OpenLeft


Russ Feingold on the New FISA Legislation


Jon Conyers on Impeachment


Al Franken Thanks Blue Majority


FCC Commissioner Michael Copps on Pearl Jam, Net Neutrality


Darcy Burner on the FISA Legislation

More OpenLeft video...