Accounting for Nonresponse in Election Polls: Total Margin of Error (WP-24-22)
Jeff Dominitz and Charles F. Manski
The potential impact of nonresponse on election polls is well known and frequently acknowledged. Yet measurement and reporting of polling error has focused solely on sampling error, represented by the margin of error of a poll. Survey statisticians have long recommended measurement of the total survey error of a sample estimate by its mean square error (MSE), which jointly measures sampling and non-sampling errors. Extending the conventional language of polling, the researchers think it reasonable to use the square root of maximum MSE to measure the total margin of error. This paper demonstrates how to measure the potential impact of nonresponse using the concept of the total margin of error, which they argue should be a standard feature in the reporting of election poll results. The researchers first show how to jointly measure statistical imprecision and response bias when a pollster lacks any knowledge of the candidate preferences of non-responders. They then extend the analysis to settings where the pollster has partial knowledge that bounds the preferences of nonresponders.