Analysis of Cluster-Randomized Experiments: A Comparison of Alternative Estimation Approaches Donald P. Green Yale University, Department of Political Science, 77 Prospect Street, New Haven, CT 06520-8209 e-mail: donald.green@yale.edu Lynn Vavreck UCLA, Department of Political Science, 4289 Bunche Hall Box 951472, Los Angeles, CA 90095-1472 e-mail: lvavreck@ucla.edu (corresponding author) Analysts of cluster-randomized field experiments have an array of estimation techniques to choose from. Using Monte Carlo simulation, we evaluate the properties of point estimates and standard errors (SEs) generated by ordinary least squares (OLS) as applied to both individual-level and cluster-level data. We also compare OLS to alternative random effects estimators, such as generalized least squares (GLS). Our simulations assess efficiency across a variety of scenarios involving varying sample sizes and numbers of clusters. Our results confirm that conventional OLS SEs are severely biased downward and that, for all estimators, gains in efficiency come mainly from increasing the number of clusters, not increasing the number of individuals within clusters. We find relatively minor differences across alternative estimation approaches, but GLS seems to enjoy a slight edge in terms of the efficiency of its point estimates and the accuracy of its SEs. We illustrate the appli- cation of alternative estimation approaches using a clustered experiment in which Rock the Vote TV advertisements were used to encourage young voters in 85 cable TV markets to vote in the 2004 presidential election. 1 Introduction Recent years have seen rapid growth in the number and sophistication of randomized field experiments in political science. Prior to 2000, only a handful of randomized experiments were conducted outside of laboratory settings (for a review, see Green and Gerber 2002); since 2000, dozens of field experiments have been conducted on topics ranging from the effects of political campaigns on voter turnout (summarized in Green and Gerber 2004) to the effects of international election monitors on election fraud (Hyde 2006). These exper- imental studies have become increasingly ambitious. Whereas early studies focused on the Authors’ note: We thank Rock the Vote for permission to use their public service announcements in this field experiment. The authors are grateful to Alan Gerber for suggestions throughout the design phase of this project. We are also grateful to Dan Kotin and Margaret Coblentz, who worked with cable operators, distributed the advertisements, and assembled the data. We thank Terence Leong for his programming expertise. Replication materials are available on the Political Analysis Web site. Ó The Author 2007. Published by Oxford University Press on behalf of the Society for Political Methodology. All rights reserved. For Permissions, please email: journals.permissions@oxfordjournals.org 138 Advance Access publication September 14, 2007 Political Analysis (2008) 16:138–152 doi:10.1093/pan/mpm025