Red Racing Horses
Menu

Make a New Account

Username:

Password:



Forget your username or password?


About

Red Racing Horses analyzes and discusses elections from a Republican-leaning perspective. Thank you for visiting, and we hope you'll enjoy the blog. Please read our site Terms of Use.

~The RRH Moderators: BostonPatriot, Daniel Surman, GoBigRedState, Greyhound, James_Nola, Right Reformer, Ryan_in_SEPA, and Shamlet.

Problems logging into your account? Inside information? Complaints? Compliments? E-Mail us at: redracinghorses@yahoo.com. We check it often!

The Current RRH Race Ratings:

Senate

Governor

House

Row Officers

Q2 Fundraising


PPP vs. Rasmussen

by: AppleCon

Thu May 03, 2012 at 18:30:48 PM EDT


The most accurate American pollsters are the left-leaning Public Policy Polling (PPP) and right-leaning Rasmussen Reports (RR). Their poll number results are typically not biased, but their questions sometimes are. Rasmussen has teamed up with Fox News. PPP has teamed up with the Daily Kos and the SEIU. In 2008 and 2010, their poll numbers were similar, and ended up being among the most accurate.

Recently, PPP and RR have not had similar poll results. I don't know why. Do you know what's going on? Do you have any theories?

Virginia presidential:

  • PPP on 4/29/12: Obama leading 51%-43%.
  • RR on 4/23/12: Romney leading 45%-44%.

Florida presidential:

  • PPP on 4/15/12: Obama leading 50%-45%.
  • RR on 4/25/12: Romney leading 46%-45%.

North Carolina presidential:

  • PPP on 4/7/12: Obama leading 49%-44%.
  • RR on 4/10/12: Romney leading 46%-44%.

Massachuestts presidential:

  • PPP on 3/18/12: Obama leading 58%-35%.
  • RR on 4/9/12: Obama leading 51%-40%.

Montana Senate election between Rehberg and Tester:

  • PPP on 4/29/12: Tester leading 48%-43%.
  • RR on 5/2/12: Rehberg leadng 53%-43%.

Massachusetts Senate election between Brown and Warren:

  • PPP on 3/18/2012: Warren leading 46%-41%.
  • RR on 4/9/2012: Warren leading 46%-45%.
AppleCon :: PPP vs. Rasmussen
Tags: (All Tags)
Print Friendly View Send As Email

PPP vs. Rasmussen | 15 comments
I disagree with your presupposition
"The most accurate American pollsters are the left-leaning Public Policy Polling (PPP) and right-leaning Rasmussen Reports (RR). Their poll number results are typically not biased"

Rasmussen hasn't been on the most accurate pollster list since 2004, and their polling has systematically been off in a rightward direction in recent years. I truly wish they get their formulas back in order, as they were invaluable during the 2002 and 2004 cycles.

I am a Tom Rukavina Democrat.


RR is not #1 most accurate...**but one of the most accurate**


Male, PA-15, Libertarian leaning-Republican

[ Parent ]
See below.


(-9.38, -7.49), libertarian socialist, KY 01, "When smashing monuments, save the pedestals. They always come in handy."


-- Stanisław Lem


[ Parent ]
if I recall
The best pollster is Quinnipiac.

27, R, PA-07.

Pollsters ranked by accuracy
based on polls from the final 21 days prior to the 2010 election:

1). Quinnipiac:
Polls: 21
Average error: 3.3
Bias: R+0.7

2). SurveyUSA
Polls: 30
Average error: 3.5
Bias: R+0.8

3). YouGov
Polls: 35
Average error: 3.5
Bias: R+1.1

4). Public Policy Polling (PPP):
Polls: 45
Average error: 3.8
Bias: R+0.3

5). Mason-Dixon
Polls: 20
Average error: 4.6
Bias: D+0.4

6). Marist:
Polls: 14
Average error: 4.9
Bias: R+4.0(!!!)

7). CNN/Opinion Research:
Polls: 17
Average error: 4.9
Bias: R+2.1

8). (last place) Rasmussen Reports:
Polls: 105
Average error: 5.8(!)
Bias: R+3.9

.

Above data taken from FiveThirtyEight

You state:

In 2008 and 2010, their poll numbers were similar, and ended up being among the most accurate.

Rasmussen had the worst track record in 2010, being off be an average of almost 6 points and having a Republican bias of a little under 4 points. 2010 was not a good year for most pollsters, but Rasmussen was worst, almost every pollster has a slight Republican bias, but few so egregious as Rasmussen. PPP showed no such bias toward Democrats, indeed they had a 3/10 of a percentage point bias toward Republican candidates. Their survey's were also closer to the results by 2 full percentage points, performing just 1/5 of a percentage point worse than the best performing pollster.

Neither made the top-two of best performing pollsters in 2010.

(-9.38, -7.49), libertarian socialist, KY 01, "When smashing monuments, save the pedestals. They always come in handy."


-- Stanisław Lem


This study is Statistical Abuse
and can only be called a joke.

1st RAS is credited for multiple polls in the same race in that three week time period.  So exactly how can you justify that in any sort stat analysis? It could have been 2-7-9 points off in a race but pollster A is only in there once.  Martist could have polled that race 3 points off at the same time RAS was two points but it comes off as statistical more accurate.  Now how that work out stat wise?  Oh I see if you pile a lot of numbers up people get fooled.

2nd RAS is rated in races that no one else did.  So if they  missed HI senate by 20 points and no one else on this list polled it how do rate them a better pollster then RAS? I guess only in a 538 survey.

We get think joke survey posted here in some form of another every couple of months.  Posting it over and over again does not make it any more accurate.

Lets just say that even the CBO would score the analysis in the survey a "zero".


[ Parent ]
My analysis below
I excluded any race where there was only one pollster and only included the most recent poll. Thus, my number of polls each pollster did was lower than 538.

R, CA-37; hometown: PA-2

[ Parent ]
But you also objected
when I did a comparison of PPP and Rasmussen's final polls in each state where they both polled. What evidence would you accept?

(-9.38, -7.49), libertarian socialist, KY 01, "When smashing monuments, save the pedestals. They always come in handy."


-- Stanisław Lem


[ Parent ]
somewhat of an artificial metric
Really just means that Ras should do fewer polls.  

27, R, PA-07.

[ Parent ]
My analysis
I'm going to show my analysis, which, while Rasmussen didn't do that well, doesn't show them as the worst. I included how often they were within 4 points and how often they predicted the winner. Average error can have a few outliers have a big impact.

Quinnipiac
Within 4 points: 70%
Predict winner:  80%
Bias: R+0.9

PPP
Within 4 points: 61%
Predict winner:  81%
Bias: R+1.3

Suffolk
Within 4 points: 60%
Predict winner:  90%
Bias: D+3.0

Reuters/Ipsos
Within 4 points: 57%
Predict winner:  86%
Bias: R+3.4

CNN/Time
Within 4 points: 55%
Predict winner:  80%
Bias: R+0.2

Fox News
Within 4 points: 50%
Predict winner:  71%
Bias: R+3.0

Rasmussen
Within 4 points: 47%
Predict winner:  87%
Bias: R+3.3

Survey USA
Within 4 points: 47%
Predict winner:  88%
Bias: R+0.7

McClatchey/Marist
Within 4 points: 44%
Predict winner:  89%
Bias: R+4.8

Mason-Dixon
Within 4 points: 36%
Predict winner:  64%
Bias: D+0.3

My analysis, like the 538 analysis, only accounts for polls within the three weeks before the election. That means that any polls before that aren't included. PPP moved several points to the right once they switched to a likely voter model. Until they did that, Rasmussen was a far better pollster.

R, CA-37; hometown: PA-2


[ Parent ]
I tend to think you need to look at other pollsters
to determine who's right and who's wrong. PPP is probably right in Virginia and Rasmussen is closer to right in Florida.

blerg!
Nobody's 'right' now.  It's all a different mix of voters.  Between now an election day:
1.  The races can and will move because of the campaigns.
2.  The races can and will move because of outside influences.
3.  The races can move because of the enthusiasm of various partisans.  
4.  Momentum exists.  No one says the polls were 'wrong' when they had Coakley up 20 in November 2009.  The race moved, and it moved fast. "If the election were held today" is meaningless this far out.

You can't be 'right' in May.  You just can't.  If, in November, your poll from May was correct and everyone's else was wrong, sweet!  But it really doesn't mean you did something great.  You got lucky.  Your 'snapshot' of the race 6 months early hit it.  Now, your final poll the weekend before, that should be how you are judged.    


[ Parent ]
one-day samples
One of the biggest reasons for Rasmussen's supposed inaccuracy is that they do quick one-day samples without any callbacks, thus usually getting only the most informed voters.  That is probably why their name ID numbers are usually so much higher than other pollsters.

These one-day samples can lead to wild swings in the results.  For example, RR's Wisconsin Senate poll in February had Tommy Thompson up 50-36 on Tammy Baldwin, with Baldwin even losing 41-40 to Jeff Fitzgerald.  However, the March poll had it return to a more believable 48-44 lead for Tommy Thompson, with Baldwin back up 48-40 on Fitzgerald.  Did the results really move that much? No.  Did Rasmussen "fix" one or both of the polls? No.  They likely just got a big fluctuation due to a warped one-day sample, which also shows up occasionally in the daily tracking poll.

This is probably why Quinnipiac usually, but not always, shows the most stable results, as they have a huge sample size with a margin of error almost always under 3%.

The one thing that annoys me about Rasmussen is the weird variations between their Presidential and Senate polls in the same state with the exact same sample.  For example, if Obama only wins by 11% in MA, Scott Brown would be easily re-elected, not losing by 1%.  Likewise, in Florida, their March poll had Obama leading Romney 46-43, while Connie Mack led Bill Nelson 43-36.  In reality, Romney probably has a narrow advantage in FL, while Bill Nelson is favored to win the Senate race.  Then the April poll went back to reality with Romney taking a 46-45 lead, and Nelson winning 47-36.  In the unlikely event Obama wins Florida again, Bill Nelson would prevail by about 10%, not losing by 7.

CO-6, socially liberal, fiscally conservative, devout atheist


Agree
Rasmussen seems to do better when they do multi-day samples.  

28, Republican, PA-6

[ Parent ]
PPP vs. Rasmussen | 15 comments
Search




Advanced Search


(C) RedRacingHorses
Powered by: SoapBlox