Friday, August 10, 2012

Summer Vacation Peak Arrives and Republicans Disappear from National Samples


Three recent presidential preference polls conducted in late July and early August have had ending samples that were strongly skewed toward Democrat identifiers.

• The Pew Poll, conducted July 16-26, 2012, among 2,508 adults, including 1,956 registered voters,  had an 18-point Democrat advantage: 43% D, 25% R, 32% I
• A PPP poll of NC PPP surveyed 813 likely North Carolina voters from August 2nd to 5th had a 12-point Democrat advantage: 45% D, 33% R, 21% I likely voters
• A recent Fox News poll based on landline and cell phone interviews from August 5 to August 7 among 930 randomly-chosen registered voters nationwide had a +9 Democratic advantage.

While some may believe these huge skews to be intentional on the part of the pollsters, a more realistic   explanation is seasonality.  The main reason for these strong Democratic skews, we think, is that these 3 surveys (and more to come in peak early/mid August vacation weeks) are surveying into the teeth of the American Summer Vacation Sampling Frame, the high season period when many Americans go away for vacation. 

This leads to what Kish (1995)1 cited as one of the main problems of sampling frames: "missing
elements: some members of the population are not included in the frame".

Although American Summer Vacation Sampling Frame problems are not nearly as severe as in the European case (where much of market research shuts down in August), at Moran Group, we've found that 'missing elements'  can  definitely be a problem in July & August surveys, especially when it comes to interviewing more upscale and professional respondents.

Indeed, one of the reasons that the American Summer Vacation Sampling Frame problem may be particularly acute in 2012 is found in a recent Harris Interactive survey cited in Business News Daily, which shows that the members of the US population who are not included in the 2012 Summer Sampling Frame may be particularly upscale this year
While only six in 10 adults planned at least one trip through August, which was down from 2009 and 2010 numbers these vacationers are planning on spending an average of $3,136 during vacations this year, nearly double the 2010 average of $1,627
Since school openings tend to be a big driver of family Summer vacation schedules and vary regionally, the problems associated with the American Vacation Summer Sampling Frame really won't go away until school starts: 34% of school districts open before August 19, 27% open 8/20 to 8/26,  45% open 8/27 to 9/2 and 21% open after 9/2. 

For purists like me out there, we should be back to the standard American Sampling Frame in polls taken after Labor Day.

1. (Leslie Kish (1995). Survey sampling. Wiley. ISBN 978-0-471-10949-5. Retrieved 11 January 2011.)

No comments:

Post a Comment