Unrepresentative samples were the key factor. In particular, having over 65s as a single group in an aging population is no longer sophisticated enough. Online and telephone modes under represented those older people who are likely to vote, and older electors have a higher propensity to vote, which led to undercounting the Conservative vote. Young electors are more likely to say they will vote, but less likely to do so – over-representing likely Labour support. Secondly, those who are more politically engaged are more likely to participate in polls. Pollsters face low response, self-selecting samples – one pollster stated that 30,000 calls were necessary to achieve 2000 participants. Hard–to-contact groups really matter. The inquiry team split the face-to-face random probability samples from two post-election surveys to examine voting behaviour: those interviewed after one or two attempts closely mirrored the pollsters’ findings; by adding in those contacted in subsequent attempts the result was closer to the actual election result. Other factors Other possible causes had no significant impact, if any at all. ‘Herding’ was also examined as the final polls were tightly clustered. This was due to weighting models being fine-tuned throughout the campaign, but there was no evidence of collusion. Applying the initial weighting schemes to the final polls reduced clustering but didn’t improve accuracy. ‘Flawed, but better than nothing’ (Guardian editorial 20th January) Recommendations cover: actions for BPC members to address the key flaws identified by the inquiry, with an audit before the next election to identify the actions being taken; changes in BPC rules to create increased methodological transparency; a face-to-face random probability poll during the 2020 campaign; communicating the inherent imprecision within polling. Some pollsters have undertaken their own investigations, and were transparent in meeting the inquiry teams’ requests for information and data. Limitations on polling activity are unlikely. Stakeholders deserve to be informed. Restrictions on publication will lead to the public being uniformed whereas others will still fund private polls. Clients must take some responsibility if ‘fast & cheap’ equals ’quick & dirty’. Methodology is under the microscope, with the potential negative impact on trust in research. Going forward, ‘fit-for-purpose’ must surely be a key consideration, but as the inquiry warn: ‘….there will be no silver bullet for the problem of polling errors’. Peter Mouncey FMRS F IDM A Visiting Fellow at Cranfield School of Management, specialising in key account management, market research and marketing accountability. Appointed Editor-in-Chief of the Market Research Society’s (MRS) ‘International Journal of Market Research’ (IJMR) in 2004. Peter is a joint editor of ‘Market Research Best Practice, 30 visions for the future’ (ESOMAR/Wiley 2007) and joint author of ‘Marketing Accountability’ (Kogan Page 2009) and ‘Marketing Value Metrics’ (Kogan Page 2014). He was also a Finalist for the MRS Silver Medal in 2004. Peter is a long term member of the MRS Market Research Standards Board and runs seminars on data privacy and research for the MRS, SRA and in-company. From 2000 until retirement in 2013, he was also Director of Research at the Institute of Direct Marketing (IDM), developing courses covering CRM and Data Management, teaching market research on their Diploma course, and a member of the Executive Board of the IDM journal (Journal of Direct, Digital and Data Marketing Practice). He was also founder member of the IDM Data Council. Worked at the Automobile Association from 1971-2000, latterly as General Manager, Group Marketing Services & CRM Strategy. Fellow of both the MRS and IDM. By Peter Mouncey, Editor in Chief, International Journal of Market Research (IJMR) Following on from the inaccurate predictions of the published polls throughout the UK 2015 general election campaign, the British Polling Council (BPC) and the Market Research Society (MRS) launched an inquiry into the performance of the pollsters last July. I reported their initial open meeting in my IJMR Editor’s blog at the time (https://www.mrs.org.uk/ijmr_blog_archive/blog/1298). The details of the inquiry itself can be found on the BPC website (http://www.britishpollingcouncil.org/tag/inquiry/). The interim findings were presented by the inquiry team on January 19th 2016, and the final report was published on March 31st. (http://eprints.ncrm.ac.uk/3789/).The key factor: unrepresentative samples
The grbnnews.com website, including all of its features and content (‘Website’) is a service made available by Global Research Business Network (GRBN), and all content and information provided on and through this Website (‘Content’) may be used solely under the following terms and conditions. Users of this website agree to be bound by these terms and conditions, which are subject to change at the discretion GRBN.
Intellectual Property
By using this Website, you agree that the content and Website are protected by copyrights, trademarks, service marks, patents or other proprietary rights and laws and may not be modified, copied, republished or distributed without acknowledging the grbnnews.com website as the source of such material or information. All intellectual property in relation to material included on this site belongs to GRBN or to the third party. In the later case, the IP owner agrees to grant rights to GRBN under the “User generated content” section below. The third-party content included in this site (including article contributors and advertisers) is subject to that third party’s terms and conditions of use.
Liability
We will do our best to ensure that the content and information published on our Website are accurate, however, as GRBN relies on the submissions of the third-parties, the completeness, adequacy or currency of the Content is not warranted or guaranteed. Your use of information on this Website or materials linked from this Website is at your own risk. We accept no liability for any loss, injury, claim, liability, or damage of any kind resulting from your use of this Website or any facts or opinions appearing on this website. The content of the Website is not intended to and does not constitute legal, financial, medical or technical advice of any other kind.
User generated content
Some of the Website content is generated by the members of GRBN or the general public. If you submit content to GRBN, you agree to be bound by these terms and conditions.
Unless otherwise agreed in writing, by submitting your content to the Website, you grant the GRBN an irrevocable, royalty free and perpetual licence to use, disclose and sub-licence the content and understand that GRBN may use all intellectual property rights in your content, including publication of that material on the Website, hard copy publications or in electronic media, social media, using your content in advertising and promotional material for the GRBN, without restriction and without making payment to you.
You acknowledge that you are solely responsible for the accuracy, completeness and legal compliance of the submitted content.
You warrant that you have all the necessary rights (including any intellectual property rights), in the Content (including photographs, illustrations, audio and video content) you contribute to the Website.
GRBN editors and moderators at their discretion may edit or remove your content.
These terms and conditions are subject to change at any time.
Third party links
Some of the Website content includes links to the third-party content. GRBN makes no representations about any other web sites and by accessing third party links, you understand that it is independent from GRBN resources and that we have no control over the content or availability of that content. You understand that the information and opinions in the third-party content is neither endorsed by nor does it reflect the belief of GRBN.
Advertisers
This Website may contain advertising and sponsorship. Advertisers and sponsors are responsible for ensuring that material submitted for inclusion on this Website is accurate and complies with applicable laws.
Privacy
Your use of this Website is subject to the GRBN’s Privacy Policy.