August 17, 2019

Winnipeg
17° C, A few clouds

Full Forecast

Advertisement

Advertise With Us

Opinion

Sorting out polls, surveys and tests of the wind

Hey there, time traveller!
This article was published 7/8/2015 (1470 days ago), so information in it may no longer be current.

Poll questions, and methodologies, vary from pollster to pollster. Consult researcher websites for more information.

It has never been cheaper or easier to survey Canadians about their political preferences. That’s why, with the federal election campaign underway, you can expect your phone to start ringing more often.

There will be a proliferation of public opinion polls released between now and election day Oct. 19. As the campaign unfolds, many national public opinion polls will show what Canadians think about the parties, their leaders and their platforms.

But not all polls are created equal. That’s why it is important for voters to become educated about the different ways pollsters, media outlets and political parties take the pulse of the electorate.

Get the full story:

Already have an account? Log in here »

Keep reading free:

Already have an account? Log in here »

Subscribers Log in below to continue reading,
not a subscriber? Create an account to start a 30 day free trial.

Log in Create your account

Your free trial has come to an end.

We hope you have enjoyed your trial! To continue reading, we recommend our Read Now Pay Later membership. Simply add a form of payment and pay only 27¢ per article.

For unlimited access to the best local, national, and international news and much more, try an All Access Digital subscription:

Thank you for supporting the journalism that our community needs!

Your free trial has come to an end.

We hope you have enjoyed your trial! To continue reading, we recommend our Read Now Pay Later membership. Simply add a form of payment and pay only 27¢ per article.

For unlimited access to the best local, national, and international news and much more, try an All Access Digital subscription:

Thank you for supporting the journalism that our community needs!

We hope you have enjoyed your free trial!

To continue reading, select a plan below:

All Access Digital

Introductory pricing*

99¢

per month

  • Unlimited online reading and commenting
  • Daily newspaper replica e-Edition
  • News Break - our award-winning iOS app
  • Exclusive perks & discounts
Continue

Read Now Pay Later

Pay

27¢

per article

  • Commitment-free
  • Cancel anytime
  • Only pay for what you read
  • Refunds available
Continue

*Introductory pricing schedule for 12 month: $0.99/month plus tax for first 3 months, $5.99/month for months 4 - 6, $10.99/month for months 7 - 9, $13.99/month for months 10 - 12. Standard All Access Digital rate of $16.99/month begins after first year.

We hope you have enjoyed your free trial!

To continue reading, select a plan below:

Read Now Pay Later

Pay

27¢

per article

  • Commitment-free
  • Cancel anytime
  • Only pay for what you read
  • Refunds available
Continue

All Access Digital

Introductory pricing*

99¢

per month

  • Unlimited online reading and commenting
  • Daily newspaper replica e-Edition
  • News Break - our award-winning iOS app
  • Exclusive perks & discounts
Continue

Mon to Sat Delivery

Pay

$34.36

per month

  • Includes all benefits of All Access Digital
  • 6-day delivery of our award-winning newspaper
Continue

*Introductory pricing schedule for 12 month: $0.99/month plus tax for first 3 months, $5.99/month for months 4 - 6, $10.99/month for months 7 - 9, $13.99/month for months 10 - 12. Standard All Access Digital rate of $16.99/month begins after first year.

We hope you have enjoyed your free trial!

To continue reading, select a plan below:

All Access Digital

Introductory pricing*

99¢

per month

  • Unlimited online reading and commenting
  • Daily newspaper replica e-Edition
  • News Break - our award-winning iOS app
  • Exclusive perks & discounts
Continue

Read Now Pay Later

Pay

27¢

per article

  • Commitment-free
  • Cancel anytime
  • Only pay for what you read
  • Refunds available
Continue

*Introductory pricing schedule for 12 month: $0.99/month plus tax for first 3 months, $5.99/month for months 4 - 6, $10.99/month for months 7 - 9, $13.99/month for months 10 - 12. Standard All Access Digital rate of $16.99/month begins after first year.

We hope you have enjoyed your free trial!

To continue reading, select a plan below:

Read Now Pay Later

Pay

27¢

per article

  • Commitment-free
  • Cancel anytime
  • Only pay for what you read
  • Refunds available
Continue

All Access Digital

Introductory pricing*

99¢

per month

  • Unlimited online reading and commenting
  • Daily newspaper replica e-Edition
  • News Break - our award-winning iOS app
  • Exclusive perks & discounts
Continue

*Introductory pricing schedule for 12 month: $0.99/month plus tax for first 3 months, $5.99/month for months 4 - 6, $10.99/month for months 7 - 9, $13.99/month for months 10 - 12. Standard All Access Digital rate of $16.99/month begins after first year.

Hey there, time traveller!
This article was published 7/8/2015 (1470 days ago), so information in it may no longer be current.

Poll questions, and methodologies, vary from pollster to pollster. Consult researcher websites for more information.

It has never been cheaper or easier to survey Canadians about their political preferences. That’s why, with the federal election campaign underway, you can expect your phone to start ringing more often.

There will be a proliferation of public opinion polls released between now and election day Oct. 19. As the campaign unfolds, many national public opinion polls will show what Canadians think about the parties, their leaders and their platforms.

But not all polls are created equal. That’s why it is important for voters to become educated about the different ways pollsters, media outlets and political parties take the pulse of the electorate.

Here’s what you need to know:

Party polling and IDing the vote

The terms "poll" or "survey" are often misused during campaigns. If a particular candidate or party calls your home and asks which party’s candidate you plan to support, this is "voter identification" rather than a scientific survey.

Identifying the vote is useful to parties because it allows them to figure out who might vote for them, but it is not a reliable guide to public opinion. Not only is it not necessarily representative of the people living in a riding, but many people will not be completely honest with canvassers about their voting intentions.

Also, campaigns frequently spin voter ID numbers to suggest they have more support than they actually do.

However, parties do conduct their own private polls. These surveys are usually much different than public surveys conducted on behalf of media outlets.

First, rather than survey the entire country or a particular province, parties are more likely to survey specific ridings that are competitive.

The federal Conservatives don’t need to know that they are the most popular party in Manitoba (as a recent Probe Research survey confirmed), but they do need to know how well their candidates are faring in swing ridings like Winnipeg South Centre, Winnipeg South and Elmwood-Transcona.

Because they put significant resources into polling, parties will also ask much deeper questions than the straightforward voting intention questions typically released in public polls. They will test their campaign messages by asking voters to agree or disagree with a series of statements about specific issues.

These statements may seem misleading and unfair, but they allow parties to see which messages most effectively resonate with voters.

(Here, I should note that my firm, Probe Research, is strictly non-partisan and does not conduct polls on behalf of political parties).

Methodologies

People are most likely to encounter the results of public opinion polls conducted on behalf of media outlets. It’s important to make sense of the different types of methodologies used to gather the results.

No survey methodology is perfect, with each having weaknesses that must be overcome.

Telephone surveys with live interviewers (the principal method Probe Research uses for the vast majority of its public affairs surveys) obtain a random sample and have the widest potential coverage, but they have become increasingly expensive and more difficult to conduct because of declining response rates and cell phone-only households.

Online panels where people sign up to take surveys can be conducted relatively quickly and cheaply, but there are legitimate questions about whether panelists are truly representative of the general public and if they share certain traits that may skew the results.

Interactive voice response surveys (also known as robo-polls) are increasingly common, as an automated survey can be conducted with huge numbers of people within a day, for pennies per completion.

However, these surveys have a whole host of methodological problems. Response rates are extremely low (sometimes as low as one to two per cent) and because some are conducted in as little as one day they may miss people who are available.

It is also difficult to collect extensive behavioural and demographic information through this method because many people will not spend 10 minutes on the phone punching numbers into a keypad.

The uses (and misuses) of polls

Polls tell us how the public felt at a particular time. Polls are not projections that necessarily tell the future. Public opinion can shift quickly — especially in the last few days of a campaign. We have seen this in a number of different campaigns, including Winnipeg’s own mayoral election last year.

Polls conducted two to three weeks before voting day provide important information about voting preferences at that time, but are subject to change. This is why the practice of developing seat projections based on polls can be problematic, especially if polls do not pick up late shifts in public opinion.

For public opinion researchers, elections are the best opportunity to showcase our methods, but they can be fraught times when poorly designed or executed surveys show a different result than the outcome. With this information in mind, however, citizens can have a better understanding of how public opinion is measured during the campaign.

Curtis Brown is the vice-president of Probe Research Inc., a Winnipeg-based public opinion firm and the polling firm of record for the Winnipeg Free Press.

curtis@probe-research.com

Twitter: @curtisatprobe

Graeme Bruce

Graeme Bruce
Multimedia producer

Graeme Bruce is a multimedia producer for the Winnipeg Free Press with a focus on data and graphics.

Read full biography

You can comment on most stories on The Winnipeg Free Press website. You can also agree or disagree with other comments. All you need to do is be a Winnipeg Free Press print or digital subscriber to join the conversation and give your feedback.

Have Your Say

Have Your Say

Comments are open to The Winnipeg Free Press print or digital subscribers only. why?

Have Your Say

Comments are open to The Winnipeg Free Press Subscribers only. why?

By submitting your comment, you agree to abide by our Community Standards and Moderation Policy. These guidelines were revised effective February 27, 2019. Have a question about our comment forum? Check our frequently asked questions.

Advertisement

Advertise With Us