Computational Statistics & Data Analysis 29 (1999) 429–444 Monte Carlo EM with importance reweighting and its applications in random eects models Fernando A. Quintana a;∗ , Jun S. Liu b , Guido E. del Pino a a Departamento de Probabilidad y Estad stica, Facultad de Matem atica, Ponticia Universidad Cat olica de Chile, Casilla 306, Correo 22, Santiago, Chile b Department of Statistics, Stanford University, Stanford, CA 94305-4065, USA Received 1 September 1997; received in revised form 1 August 1998 Abstract In this paper we propose a new Monte Carlo EM algorithm to compute maximum likelihood estimates in the context of random eects models. The algorithm involves the construction of ecient sampling distributions for the Monte Carlo implementation of the E-step, together with a reweighting procedure that allows repeatedly using a same sample of random eects. In addition, we explore the use of stochastic approximations to speed up convergence once stability has been reached. Our algorithm is compared with that of McCulloch (1997). Extensions to more general problems are discussed. c 1999 Elsevier Science B.V. All rights reserved. Keywords: Importance sampling; Metropolis–Hastings algorithm; Stochastic approximations 1. Introduction 1.1. Random eects models The last decade has witnessed the modication of many standard (xed eects) statistical models through the incorporation of the so-called random eects. The mo- tivation behind these modications has been the quest for more realistic models that take into account heterogeneity in population parameters and correlations between This work was partially supported by Project FONDECYT 1960915 and by a visiting professorship grant from DIPUC. * Corresponding author. E-mail: quintana@mat.puc.cl. 0167-9473/99/$ – see front matter c 1999 Elsevier Science B.V. All rights reserved. PII: S0167-9473(98)00075-9