Skip to Main content Skip to Navigation
Journal articles

Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment

Abstract : In the social sciences, randomized experimentation is the optimal research design for establishing causation. However, for a number of practical reasons, researchers are sometimes unable to conduct experiments and must rely on observational data. In an effort to develop estimators that can approximate experimental results using observational data, scholars have given increasing attention to matching. In this article, we test the performance of matching by gauging the success with which matching approximates experimental results. The voter mobilization experiment presented here comprises a large number of observations (60,000 randomly assigned to the treatment group and nearly two million assigned to the control group) and a rich set of covariates. This study is analyzed in two ways. The first method, instrumental variables estimation, takes advantage of random assignment in order to produce consistent estimates. The second method, matching estimation, ignores random assignment and analyzes the data as though they were nonexperimental. Matching is found to produce biased results in this application because even a rich set of covariates is insufficient to control for preexisting differences between the treatment and control group. Matching, in fact, produces estimates that are no more accurate than those generated by ordinary least squares regression. The experimental findings show that brief paid get-out-the-vote phone calls do not increase turnout, while matching and regression show a large and significant effect.
Document type :
Journal articles
Complete list of metadata

https://hal-sciencespo.archives-ouvertes.fr/hal-03635471
Contributor : Hélène Saint-Gal Connect in order to contact the contributor
Submitted on : Friday, April 8, 2022 - 3:01:21 PM
Last modification on : Saturday, April 9, 2022 - 3:31:05 AM

Links full text

Identifiers

Collections

Citation

Kevin Arceneaux, Alan Gerber, Donald Green. Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment. Political Analysis, Oxford University Press (OUP), 2006, 14 (1), pp.37-62. ⟨10.1093/pan/mpj001⟩. ⟨hal-03635471⟩

Share

Metrics

Record views

5