The main purpose of this study is to improve estimation efficiency in obtaining maximum marginal likelihood estimates of contextual effects in the framework of nonlinear multilevel latent variable model by adopting the Metropolis–Hastings Robbins–Monro algorithm (MH-RM). Results indicate that the MH-RM algorithm can produce estimates and standard errors efficiently. Simulations, with various sampling and measurement structure conditions, were conducted to obtain information about the performance of nonlinear multilevel latent variable modeling compared to traditional hierarchical linear modeling. Results suggest that nonlinear multilevel latent variable modeling can more properly estimate and detect contextual effects than the traditional approach. As an empirical illustration, data from the Programme for International Student Assessment were analyzed.
CaiL. (2008). A metropolis-hastings robbins-monro algorithm for maximum likelihood nonlinear latent structure analysis with a comprehensive measurement model(Unpublished doctoral dissertation). Department of Psychology, Universityof North Carolina, Chapel Hill, NC.
4.
CaiL. (2010a). High-dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm. Psychometrika, 75, 33–57.
5.
CaiL. (2010b). Metropolis-Hastings Robbins-Monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, 35, 307–335.
6.
CeleuxG.ChauveauD.DieboltJ. (1995). On stochastic versions of the EM algorithm(Tech. Rep. No. 2514). Rocquencourt, France: The French National Institute for Research in Computer Science and Control.
7.
CeleuxG.DieboltJ. (1991). A stochastic approximation type EM algorithm for the mixture problem(Tech. Rep. No. 1383). Rocquencourt, France: The French National Institute for Research in Computer Science and Control.
8.
DelyonB.LavielleM.MoulinesE. (1999). Convergence of a stochastic approximation version of the EM algorithm. The Annals of Statistics, 27, 94–128.
9.
FisherR. A. (1925). Theory of statistical estimation. Proceedings of the Cambridge Philosophical Society, 22, 700–725.
10.
FoxJ. P.GlasC. A. W. (2001). Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika, 66, 269–286.
11.
GoldsteinH.BonnetG.RocherT. (2007). Multilevel structural equation models for the analysis of comparative data on educational performance. Journal of Educational and Behavioral Statistics, 32, 252–286.
12.
GoldsteinH.BrowneW. (2004). Multilevel factor analysis models for continuous and discrete data. In Maydeu-OlivaresA.McArdleJ. J. (Eds.), Contemporary psychometrics (pp. 7270–7274). Mahwah, NJ: Erlbarum.
13.
GuM. G.KongF. H. (1998). A stochastic approximation algorithm with Markov chain Monte-Carlo method for incomplete data estimation problems. Proceedings of the National Academy of Sciences, 95, 7270–7274.
14.
HabermanS. J. (2013). A general program for item-response analysis that employs the stabilized newton-raphson algorithm. (ETS RR-13-32). Princeton, NJ: Educational Testing Service.
15.
HastingsW. K. (1970). Monte carlo simulation methods using markov chains and their applications. Biometrika, 57, 97–109.
16.
KamataA. (2001). Item analysis by the hierarchical generalized linear model. Journal of Educational Measurement, 38, 79–93.
17.
KamataA.BauerD. J.MiyazakiY. (2008). Multilevel measurement modeling. In OConnellA. A.McCoachD. B. (Eds.), Multilevel modeling of educational data (pp. 345–388). Charlotte, NC: Information Age Publishing.
18.
LeeS. Y.PoonW. Y. (1998). Analysis of two-level structural equation models via EM type algorithms. Statistica Sinica, 8, 749–766.
19.
LeeV. E.BrykA. (1989). A multilevel model of the social distribution of educational achievement. Sociology of Education, 62, 172–192.
20.
LouisT. A. (1982). Fiding the observed information matrix when using the EM algo-rithm. Journal of the Royal Statistical Society, 44, 226–233.
21.
LüdtkeO.MarshH.RobitzschA.TrautweinU. (2011). A 2 × 2 taxonomy of multilevel latent covariate models: Accuracy and bias trade-offs in full and partial error-correction models. Psychological Methods, 16, 444–467.
22.
LüdtkeO.MarshH.RobitzschA.TrautweinU.AsparouhovT.MuthénB. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203–229.
23.
MarshH. W.LüdtkeO.RobitzschA.TrautweinU.AsparouhovT.MuthénB.NagengastB. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44, 764–802.
24.
MetropolisN.RosenbluthA. W.RosenbluthM. N.TellerA. H.TellerE. (1953). Equations of state space calculations by fast computing machines. Journal of Chemical Physics, 21, 1087–1092.
25.
MonroeS.CaiL. (2014). Estimation of a Ramsay-curve item response theory model by the Metropolis-Hastings Robbins-Monro algorithm. Educational and Psychological Measurement, 74, 343–369.
26.
Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338–354.
27.
MuthénL. K.MuthénB. O. (2008). Mplus 5.0 [Computer software]. Los Angeles, CA: Muthèn & Muthèn.
28.
MuthénL. K.MuthénB. O. (2010). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthèn & Muthèn.
29.
PinheiroJ.BatesD.DebRoyS.SarkarD.R CoreTeam. (2012). nlme: Linear and nonlinear mixed effects models (R package version 3.1-104 [Computer software manual]). Retrieved from: http://cran.r-project.org/web/packages/nlme/nlme.pdf
30.
R Core Team. (2012). R: A language and environment for statistical computing[Computer software manual]. Vienna, Austria. Retrieved fromhttp://www.R-project.org
31.
RaudenbushS. W.BrykA. S. (1986). A hierarchical model for studying school effects. Sociology of Education, 59, 1–17.
32.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
33.
RaudenbushS. W.LiuX. (2000). Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5, 199–213.
34.
RaudenbushS. W.WillmsJ. (1995). The estimation of school effects. Journal of Educational and Behavioral Statistics, 20, 307–335.
35.
RijmenF. (2011). Hierarchical factor item response theory models for pirls: Capturing clustering effects at multiple levels. IERI Monograph Series: Issues and Methodologies in Large-Scale Assessments, 4, 59–74.
36.
RobbinsH.MonroS. (1951). A stochastic approximation method. The Annals of Mathematical Statistics, 22, 400–407.
37.
SamejimaF. (1969). Estimation of latent ability using a response pattern of graded scores(Psychometric Monographs 17). Richmond, VA: Psychometric Society.
38.
SinharayS. (2004). Experiences with markov chain monte carlo convergence assessment in two psychometric examples. Journal of Educational and Behavioral Statistics, 29, 461–488.
39.
SpearmanC. (1904). “General intelligence” objectively determined and measured. American Journal of Psychology, 15, 201–293.
40.
von DavierM.SinharayS. (2010). Stochastic approximation for latent regression item response models. Journal of Educational and Behavioral Statistics, 35, 174–193.
41.
WillmsJ. D. (1986). Social class segregation and its relationship to pupils’ examination results in scotland. American Socialological Review, 55, 224–241.
