SI
SI
discoversearch

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor.  We ask that you disable ad blocking while on Silicon Investor in the best interests of our community.  If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
Politics : I Will Continue to Continue, to Pretend.... -- Ignore unavailable to you. Want to Upgrade?


To: Sully- who wrote (6094)11/4/2004 11:54:38 PM
From: Sully-  Respond to of 35834
 
Mystery Pollster

Again, the same pattern: Kerry's performance on the partial
exit polls surpassed his ultimate performance nationally and
in 15 of 16 states. So whatever was happening, it was not
just the random variation due to sampling error. If you don't
believe me, try flipping a coin and see how often you can get
heads to come up 16 of 17 times.


Demystifying the Science and Art of Political Polling

By Mark Blumenthal
November 04, 2004

Exit Polls: What We Know

The apparent problems with Tuesday's exit polls were obviously topic number one with MP's readers yesterday. Before jumping into what went "wrong" and why, it is important for all of us to be clear about what we know and what we do not. We might start by considering why the networks do exit polls in the first place. I see three:

1) To provide an analytical tool to provide journalists and the general public with a greater understanding of the election results, who voted for whom, why, etc.

2) To provide data to help the networks project winners, especially in states where one candidate holds a huge lead

3) To provide networks and other news organizations some advance notice of the likely election outcome well before the polls close so they can plan their coverage accordingly.

The National Election Pool (NEP) designed procedures for conducting the exit polls to fulfill these three missions: Interviewers phone in raw data from completed questionnaires at several intervals during the day. To provide networks guidance on likely outcomes, NEP releases partial data several times during the afternoon. These are the numbers that get leaked and appear all over the Internet. As I wrote Tuesday, my understanding is that unlike the final numbers, these early releases are not weighted to reflect the actual turnout that day.

Shortly before the polls close, the interviewers call in tabulated results, as well as some measure of actual turnout at their precinct. NEP uses the actual turnout data to weight each state's poll, so that the regional distribution of respondents matches the actual turnout for that day. The last report and turnout data allows for a tabulation provided to the networks just before the polls close that they use for projections. If the margin is well outside the margin of error (typically 4% for a state) the networks will use the exit poll alone to call the state.

As Martin Plissner, a former executive political director of CBS News, wrote yesterday in Slate,

Exit-poll surveys in some 29 states showed margins for George Bush or John Kerry great enough to conclude that the chances the leading candidate losing was essentially zero. On that basis, when the polls closed in those states and before any votes were counted, 16 of them were placed in the president's corner and 13 in the senator's. They tended to be places like Kansas and Rhode Island.

Needless to say, if the lead is within (or even close to) statistical sampling error, the networks will not make a projection on the basis of the exit poll alone. To enable projections in these cases, NEP also does tabulations of actual returns obtained for a larger random sample of precincts (often referred to as "key precincts"). They also continue to use and update the exit poll. As returns start to come in, the exit pollsters weight each individual precinct sample by the actual vote cast by all voters at that precinct. Thus, as the night wears on, the accuracy of the exit poll gradually improves.

Why bother with the exit poll when real votes are available
? The poll helps analysts determine the size and preferences of key subgroups with increasingly greater precision. What is the vote among Independents? African Americans? Young voters? New registrants? How do those patterns compare with pre-election expectations? Knowing the answers to those questions helps guide those at the network "decision desks" in making projections.

Also, weighting the poll by the actual vote improves its accuracy for its third and most important mission: providing an analytical tool for journalists and the rest of us who want to interpret and explain the election outcome. When a final result for a state is available, the exit pollsters weight the entire sample to match the vote results (there is often a mismatch due to drawing a sample of precincts rather than the entire state). That is the reason bloggers and others noticed that exit poll results posted on CNN and other news sites changed overnight. It was not a conspiracy, just standard practice.

So, given this procedure, what can we say about what seemed to go so wrong
?

With respect to the second mission, correctly calling outcomes, the exit polls did well. "No wrong projections [of winners] were made; the projections were spot on,"
said Joe Lenski of Edison Research (the company that conducted the NEP exit poll along with Mitofsky International) to the Washington Post's Richard Morin.

True enough, but what about all those mid-day numbers everyone saw on the Internet
? The official answer from people like Lenski mirrored what you heard from me on Tuesday, that mid-day numbers are less reliable and only reflect the views of those who have voted so far. Actually, they went a bit farther. "The leaking of this information without any sophisticated understanding or analysis," said Lenski, "[made] it look inaccurate." They were "about as accurate as they usually are," wrote Plissner, adding "the problem was that...the exit polls were being seen by thousands of people who didn't know how to read them....like any sophisticated weapon, they are dangerous in the hands of the untrained."

Is that fair?

I went back and looked at the numbers that Jack Shafer posted on Slate at 12:15 p.m. Pacific Time (3:15 Eastern). He posted results for 10 states, but most focused on Ohio and Florida which both showed Kerry one percentage point ahead of George Bush. Of course, both Kerry "leads" were well within sampling error and, given the smaller mid-day sampling, also within an acceptable range of the actual result.

But there is something else interesting about these results: Kerry's standing against Bush in all ten states surpassed what he received on election night. At 4:28 Pacific Time (7:38 Eastern, Shafer posted more recent numbers for an even larger list of states, 16 in all, plus the national result (51% Kerry, 48% Bush). Again, the same pattern: Kerry's performance on the partial exit polls surpassed his ultimate performance nationally and in 15 of 16 states. So whatever was happening, it was not just the random variation due to sampling error. If you don't believe me, try flipping a coin and see how often you can get heads to come up 16 of 17 times.

The NEP officials seem to concede there was some Democratic bias in the early numbers. An Associated Press story from yesterday said:

<<<
The NEP had enough concerns that its early exit polls were skewing too heavily toward Kerry that it held a conference call with news organizations mid-afternoon urging caution in how that information was used. Early polls in New Hampshire, Pennsylvania, Minnesota and Connecticut were then showing a heavier Kerry vote than anticipated.

Pollsters anticipate a post-mortem to find out why that happened. Some possibilities: Democrats were more eager to speak to pollsters than Republicans, or Kerry supporters tended to go to the polls earlier in the day than Bush voters.
>>>

The same AP story reported that after the initial release showing Kerry ahead by three points, "as the day wore on, later waves of exit polling showed the race tightening." You can see that pattern in Jack Shafer's numbers for Ohio, Florida and Pennsylvania. However, did the final surveys just before the polls closed continue to show a consistent Kerry bias? I cannot answer that question, although it would be easy enough if we had the final results shared with the networks just before the polls closed in each state. I am sure there are reporters among readers of this blog who saw the data releases just before the polls closed. Perhaps someone can email me and set me straight.

The issue is not whether the decision desks at the networks paid any attention to the small Kerry leads in the early Ohio and Florida, but whether news organizations relied on them in planning coverage and discussing the race in the late afternoon. It was not just bloggers. Very serious reporters from very serious media outlets jumped to the conclusion that Kerry was running the table, just like all those "unsophisticated" bloggers.

And then there is the issue of why the networks and NEP gave no consideration to the virtual certainty that these numbers would make their way into the public domain. It ought to be obvious by now that giving exit polls to 500 or so reporters, editors and producers -- all of whom have phones and computers -- is essentially the same as putting them in the public domain. It was not exactly a surprise that the leaked exit polls would be all over the Internet, yet they had no strategy to help the consumers of leaked numbers understand what they were looking at
.

In their post-mortems, the networks need to consider that far more Americans consumed raw exit polls in their partial, dirty, unreliable state than will ever examine the final cross-tabulations now available. Too many came away from the experience convinced that exit polls are biased and unreliable. Confidence in the final numbers, the ones we all rely on to understand the election, has been seriously shaken. We simply cannot blame that on the bloggers.

If partial exit poll data is "dangerous in the hands of the untrained," and we choose to leave it lying around where the "unsophisticated" will play with it, doesn't it make sense to at least publish a warning label?


mysterypollster.com



To: Sully- who wrote (6094)11/6/2004 11:37:48 PM
From: Sully-  Respond to of 35834
 
THIS IS ME PATTING MYSELF ON THE BACK

Cori Dauber

Last night I wrote that "moral values" had to be the most poorly worded polling question in history. Today in the Times, one of the pollsters on the committee what produced the exit poll -- the one who tried to talk the committee out of using the question -- explains [edit: see the post below] why he opposed using the question, and why it's distorting analysis of the election now. I really believe, given some of the post-mortems I've seen, and what they mean for where the Democratic party goes from here (and what they mean for the type of civic -- and civil -- discourse we see in the next few years) that this piece is one of the most important you'll read on the election.

You know, I'm no polling expert, and I don't try to pass myself off as one, but I hang out with enough of them to have picked up a few things. And just from the little I know, it was immediately clear that the conclusions people were jumping to based on the "moral values" question were asking that result to bear a weight it just couldn't hold. Aside from the obvious (that "moral values" could have meant Kerry's values, as a characteristic of leadership) the interpretations also presumed that every voter was a single issue voter, but the poll never asked people if they voted only on the basis of the issue "most important to you."

I'll go back to something I've raised before -- given how reliant political reporters in particular are on polls, how well trained are they in polling and the use of polls?


OP-ED CONTRIBUTOR
A Question of Values
By GARY LANGER

A poorly devised exit poll question and a dose of spin are threatening to undermine our understanding of the 2004 presidential election.

The news media has made much of the finding that a fifth of voters picked "moral values" as the most important issue in deciding their vote - as many as cited terrorism or the economy. The conclusion: moral values are ascendant as a political issue
.

The reporting accurately represents the exit poll data, but not reality
. While morals and values are critical in informing political judgments, they represent personal characteristics far more than a discrete political issue. Conflating the two distorts the story of Tuesday's election.

This distortion comes from a question in the exit poll, co-sponsored by the national television networks and The Associated Press, that asked voters what was the most important issue in their decision: taxes, education, Iraq, terrorism, economy/jobs, moral values or health care. Six of these are concrete, specific issues. The seventh, moral values, is not, and its presence on the list produced a misleading result.

How do we know? Pre-election polls consistently found that voters were most concerned about three issues: Iraq, the economy and terrorism. When telephone surveys asked an open-ended issues question
(impossible on an exit poll), answers that could sensibly be categorized as moral values were in the low single digits. In the exit poll, they drew 22 percent.

Why the jump? One reason is that the phrase means different things to people. Moral values is a grab bag; it may appeal to people who oppose abortion, gay marriage and stem-cell research but, because it's so broadly defined, it pulls in others as well. Fifteen percent of non-churchgoers picked it, as did 12 percent of liberals
.

Look, too, at the other options on the list. Four of them played to John Kerry's strengths: economy/jobs, health care, education, Iraq. Just two worked in President Bush's favor: terrorism and taxes. If you were a Bush supporter, and terrorism and taxes didn't inspire you, moral values was your place to go on the exit poll questionnaire. People who picked it voted for him by 80 percent to 18 percent.

Moral values, moreover, is a loaded phrase, something polls should avoid. (Imagine if "patriotism" were on the list
.) It resonates among conservatives and religious Americans. While 22 percent of all voters marked moral values as their top issue, 64 percent of religious conservatives checked it. And among people who said they were mainly interested in a candidate with strong religious faith (just 8 percent, in a far more balanced list of candidate attributes), 61 percent checked moral values as their top issue. So did 42 percent of people who go to church more than once a week, 41 percent of evangelical white Christians and 37 percent of conservatives.

The makeup and views of the electorate in other measures provide some context for the moral values result. The number of conservative white Protestants or weekly churchgoing white Protestants voting (12 percent and 13 percent of voters, respectively) did not rise in 2004. Fifty-five percent of voters said abortion should be legal in all or most cases. Sixty percent said they supported either gay marriage (25 percent) or civil unions (an additional 35 percent).

Opinion researchers don't always agree. The exit poll is written by a committee, and that committee voted down my argument against including "moral values" in the issues list. That happens - and the exit poll overall did deliver a wealth of invaluable data. The point is not to argue that moral values, however defined, are not important. They are, and they should be measured. The intersection of religiosity, ideology and politics is the staging ground for many of the most riveting social issues of our day.

The point, instead, is that this hot-button catch phrase had no place alongside defined political issues on the list of most important concerns in the 2004 vote. Its presence there created a deep distortion - one that threatens to misinform the political discourse for years to come
.


Gary Langer is the director of polling for ABC News.

Copyright 2004 The New York Times Company | Home | Privacy Policy | Search | Corrections | RSS | Help | Back to Top



To: Sully- who wrote (6094)11/10/2004 1:41:02 AM
From: Sully-  Respond to of 35834
 
JOHN HOOD:

Interestingly, while Bush slightly improved his standing among frequent churchgoers, by about a point in 2004, his support grew by 3 to 4 points among those attending seldom or never.

Yep, it was the atheist vote that really put Bush over the top in 2004.


I guess that's why he's always careful to speak respectfully of those who "choose not to worship." More of Karl Rove's genius!


Myths of the Republican Mullah-cracy

You can't blame Jesus for the voters' choice


John Hood

It took only a few hours for media talking heads to come up with an explanation for why the tax-cutting, war-mongering ignoramus George W. Bush got re-elected on Tuesday. It couldn't have been, they agreed, that the electorate truly wanted four more years of Republican domestic and foreign policies. After all, didn't John Kerry win every substantive point on the issues that really matter? Wasn't Bush an accidental, illegitimate president in the first place?

Another explanation had to be found.

Quickly scanning the exit polling, pundits spotted that 22 percent of voters had said "moral issues" were the most important in the race, and they broke heavily for Bush. A-ha! Now they had a talking point: evil mastermind Karl Rove had used the same-sex marriage issue to turn out so many religious conservatives that they overwhelmed everyone's likely-voter models and became a disproportionate share of the 2004 electorate.

The initially unspoken, but soon loudly proclaimed, implication of this fact was that Bush and the Republicans had bamboozled these voters, whose real economic interests lay with the Democrats. They didn't truly support Bush on substantive domestic and foreign-policy issues. They were just anti-gay bigots. As the spin got more frenzied Wednesday and Thursday, words like "jihadis" and "mullahs" got attached to these deluded and dangerous Bush voters, whom Democrats and sympathetic analysts described as something akin to a bizarre and perversely fascinating lost tribe just discovered in the rain forests of Borneo. By weekend, an inevitable backlash against the frenzy had set in.

The problem with all this is that, while comforting to many Kerry supporters and exhilarating for some social-conservative leaders, the notion that Bush won primarily because religious voters turned out for him does not seem to be backed up by any real evidence. Few reporters or commentators appear to have gone back to examine the 2000 exit polls, which would seem to be necessary if one wishes to assert a trend.

I did. I found that the percentage of voters sampled who said they attended church at least weekly was the same—42 percent—in both 2000 and 2004. The percentage never attending church was also the same, at 15 percent. The middle group, those attending occasionally, was, you guessed it, 42 percent each time. Interestingly, while Bush slightly improved his standing among frequent churchgoers, by about a point in 2004, his support grew by 3 to 4 points among those attending seldom or never.

Yep, it was the atheist vote that really put Bush over the top in 2004
.

There could be other ways to salvage the myth of the Republican mullah-cracy. For example, one might argue that it is unfair to equate church-going with religiosity or cultural conservatism.

Another potential proof: More people identified themselves as conservatives in 2004 (34 percent) than in 2000 (29 percent). But there are all kinds of conservatives, including quite a few who are socially conservative and hawkish and in favor of privatizing Social Security. Sorry, this doesn't prove anything other than people are increasingly willing to label themselves as conservative rather than moderate.

OK, what about issue positions? In 2000, about 40 percent of voters in the exit poll said that abortion should be mostly or always illegal. In 2004, it was 42 percent. Not exactly a huge jump. And we don't know how many of those are single-issue voters on abortion. Both parties have significant minorities who disagree with the official party position: about a quarter of pro-lifers voted for Kerry, while around one-third of pro-choicers picked Bush. On same-sex marriage, the issue was not polled in 2000 so it is impossible to say with certainty how the two electorates compare, but it is unlikely that this year's voters were significantly more conservative on it. In fact, the public's position is more nuanced here than the insta-spin would have you believe. About as many favored civil unions but not official marriage (35 percent) as favored neither (37 percent), and Bush was preferred by both groups over Kerry.

Well, perhaps there was no national trend but it happened in selected states such as Ohio. Nope. In the 2000 exit poll for Ohio, the percentage of frequent churchgoers was higher (45 percent) than in 2004 (40 percent). Bush did win a larger majority of religious Ohio voters in 2004 than he did four years ago, but there were fewer of them proportionally. Besides, saying that the religious-vote affect mattered in a few key states changes the nature of the media spin, which has been trying to assert it as a sweeping national "explanation" for Bush's popular vote.

That leaves the initial assertion about 22 percent of voters citing moral issues as most important, higher than the share citing terrorism, Iraq, the economy, or other issues. When I looked more closely at this question, however, doubts immediately presented themselves. For one thing, the answers were broken out in ways that biased the analysis. While the poll did not attempt to distinguish the various moral issues that voters might be thinking about—abortion, marriage, wars for oil, etc.—it did list "taxes" and "the economy" separately, as well as "terrorism" and "Iraq." Of course, for many voters, these are not separate issues. You may disagree with them, but most voters sampled in the exit poll said that the war in Iraq was part of the overall war on terrorism. And many right-leaning voters see tax policy as inextricably linked with economic growth and job creation (at least a few freedom-loving folks even see tax cuts as a moral issue—imagine that!)

In short, the question is flawed and the answers easily misunderstood. Moreover, it doesn't compare well with the 2000 exit poll, in which "moral issues" was not listed as an option. On the other hand, you can track the impact of foreign policy over time. In 2000, only 12 percent said that "foreign affairs" was the most important issue in the presidential race, and they broke 54 percent to 40 percent for Bush over Gore. In 2004, a combined 34 percent identified foreign policy (either Iraq or the war on terrorism) as the most important, and they appear to have broken for Bush by 59 percent to 40 percent. Put it all together, and the increase in salience and small increase in Bush preference for foreign policy constitutes a gain of 13.5 percentage points in the Bush vote in 2004.

Obviously, he didn't win by that much. He lost ground on economic issues, because of the recession. But without his edge on war on terrorism, Bush would have lost. And that proposition—unlike the "it's all about gay marriage meme"—is testable and fits the available data. Voters worried about partial-birth abortion, same-sex marriage, and other cultural issues are obviously an important constituency within the current GOP majority, but they are no more responsible for Bush's national victory on Tuesday than voters motivated by other issues to re-elect the president.


John Hood is president of the John Locke Foundation, a public policy think tank in North Carolina, and a syndicated columnist and radio host.



To: Sully- who wrote (6094)11/10/2004 9:46:54 AM
From: Sully-  Respond to of 35834
 
Evasive Maneuvers

coxandforkum.com



To: Sully- who wrote (6094)11/12/2004 10:46:07 AM
From: Sully-  Respond to of 35834
 
'Moral Values' Myth

By Charles Krauthammer

Friday, November 12, 2004; Page A25


In 1994, when the Gingrich revolution swept Republicans into power, ending 40 years of Democratic hegemony in the House, the mainstream press needed to account for this inversion of the Perfect Order of Things. A myth was born. Explained the USA Today headline: "ANGRY WHITE MEN: Their votes turn the tide for GOP."

Overnight, the revolution of the Angry White Male became conventional wisdom. In the 10 years before the 1994 election there were 56 mentions of angry white men in the media, according to LexisNexis. In the next seven months there were more than 1,400.

At the time, I looked into this story line -- and found not a scintilla of evidence to support the claim. Nonetheless, it was a necessary invention, a way for the liberal elite to delegitimize a conservative victory. And, even better, a way to assuage their moral vanity: You never lose because your ideas are sclerotic or your positions retrograde, but because your opponent appealed to the baser instincts of mankind.

Plus ca change ... Ten years and another stunning Democratic defeat later, and liberals are at it again. The Angry White Male has been transmuted into the Bigoted Christian Redneck.

In the post-election analyses, the liberal elite, led by the holy trinity of the New York Times -- Paul Krugman, Thomas Friedman and Maureen Dowd -- just about lost its mind denouncing the return of medieval primitivism. As usual, Dowd achieved the highest level of hysteria, cursing the Republicans for pandering to "isolationism, nativism, chauvinism, puritanism and religious fanaticism" in their unfailing drive to "summon our nasty devils."

Whence comes this fable
? With President Bush increasing his share of the vote among Hispanics, Jews, women (especially married women), Catholics, seniors and even African Americans, on what does this victory-of-the-homophobic-evangelical voter rest?

Its origins lie in a single question in the Election Day exit poll. The urban myth grew around the fact that "moral values" ranked highest in the answer to Question J: "Which ONE issue mattered most in deciding how you voted for president?"

It is a thin reed upon which to base a General Theory of the '04 Election. In fact, it is no reed at all. The way the question was set up, moral values were sure to be ranked disproportionately high. Why? Because it was a multiple-choice question, and moral values cover a group of issues, while all the other choices were individual issues. Chop up the alternatives finely enough, and moral values are sure to get a bare plurality over the others.

Look at the choices:

• Education, 4 percent.

• Taxes, 5 percent.

• Health Care, 8 percent.

• Iraq, 15 percent.

• Terrorism, 19 percent.

• Economy and Jobs, 20 percent.

• Moral Values, 22 percent.

"Moral values" encompass abortion, gay marriage, Hollywood's influence, the general coarsening of the culture and, for some, the morality of preemptive war. The way to logically pit this class of issues against the others would be to pit it against other classes: "war issues" or "foreign policy issues" (Iraq plus terrorism) and "economic issues" (jobs, taxes, health care, etc).

If you pit group against group, the moral values class comes in dead last: war issues at 34 percent, economic issues variously described at 33 percent and moral values at 22 percent -- i.e., they are at least a third less salient than the others.

And we know that this is the real ranking. After all, the exit poll is just a single poll. We had dozens of polls in the run-up to the election that showed that the chief concerns were the war on terrorism, the war in Iraq and the economy
.

Ah, yes. But the fallback is then to attribute Bush's victory to the gay marriage referendums that pushed Bush over the top, particularly in Ohio.

This is more nonsense. George Bush increased his vote in 2004 over 2000 by an average of 3.1 percent nationwide. In Ohio the increase was 1 percent -- less than a third of the national average. In the 11 states in which the gay marriage referendums were held, Bush increased his vote by less than he did in the 39 states that did not have the referendum.

The great anti-gay surge was pure fiction.

This does not deter the myth of the Bigoted Christian Redneck from dominating the thinking of liberals and infecting the blue-state media. They need their moral superiority like oxygen, and they cannot have it cut off by mere facts. Once again they angrily claim the moral high ground, while standing in the ruins of yet another humiliating electoral defeat
.

letters@charleskrauthammer.com

© 2004 The Washington Post Company



To: Sully- who wrote (6094)11/12/2004 4:22:36 PM
From: Sully-  Respond to of 35834
 
Resurveying about that "moral values" motivation.

By Ann Althouse

Pew Research finds that you get very different results if you present voters with a list than if you ask them an open-ended question:

[W]hen [voters] were asked an open-ended question about the top issue, Iraq and the economy moved past moral values. Iraq was picked by 27 percent, the economy by 14 percent and moral values tied with terrorism at 9 percent.

Presumably, there's suggestive power to mentioning "moral values" to people. They want to look like they care about morality once it's brought up, but before that, they may not have been thinking about it. The new poll also probes what people mean when they say "moral values":

Just over four in 10 of those who picked ``moral values'' from the list mentioned social issues like gay marriage and abortion, but others talked about qualities like religion, helping the poor, and candidates' honesty and strength of leadership.

"We did not see any indication that social conservative issues like abortion, gay rights and stem cell research were anywhere near as important as the economy and Iraq,'' said Andrew Kohut, director of the Pew Research Center. "'Moral values' is a phrase that's very attractive to people.''