Sensitivity analyses encompass a broad set of post-analytic techniques that are characterized as measuring the potential impact of any factor that has an effect on some output variables of a model. This research focuses on the utility of the simulated annealing algorithm to automatically identify path configurations and parameter values of omitted confounders in structural equation modeling (SEM). An empirical example based on a past published study is used to illustrate how strongly related an omitted variable must be to model variables for the conclusions of an analysis to change. The algorithm is outlined in detail and the results stemming from the sensitivity analysis are discussed.
BollenK. A. (1989). Structural equations with latent variables. John Wiley.
2.
BrownJ.WinsorD. L.BlakeS. (n.d.). Technology and social-emotional development in the early childhood environments. In Child development and the use of technology (pp. 112–128). IGI Global. https://doi.org/10.40182F978-1-61350-317-1.ch006
3.
FouskakisD.DraperD. (2002). Stochastic optimization: A review. International Statistical Review, 70, 315–349.
4.
HancockG. R.MuellerR. O. (2019). Structural equation modeling. In HancockG. R.StapletonL. M.MuellerR. O. (Eds.), The reviewer’s guide to quantitative methods in the social sciences (2nd ed., pp. 445–456). Routledge.
5.
HarringJ. R.McNeishD. M.HancockG. R. (2017). Using phantom variables in structural equation modeling to assess model sensitivity to external misspecification. Psychological Methods, 22, 616–631.
6.
HippJ. R.BauerD. J. (2006). Local solutions in the estimation of growth mixture models. Psychological Methods, 11, 36–53.
7.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
8.
JohnsonD. S.AragonC. R.McGeochL. A.SchevonC. (1989). Optimization by simulated annealing: An experimental evaluation; part 1; graph partitioning. Operations Research, 37, 865–892.
9.
KaplanD. (1990). Evaluating and modifying covariance structure models: A review and recommendation. Multivariate Behavioral Research, 25, 137–155.
LeiteW. L.HuangI. C.MarcoulidesG. A. (2008). Item selection for the development of short forms of scales using an ant colony optimization algorithm. Multivariate Behavioral Research, 43, 411–431.
16.
ShadishW.CookT.CampbellD. (2001). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
17.
MarcoulidesG. A.DreznerZ. (2001). Specification searches in structural equation modeling with a genetic algorithm. In MarcoulidesG. A.SchumackerR. E. (Eds.), New developments and techniques in structural equation modeling (pp. 247–268). Lawrence Erlbaum.
18.
MarcoulidesG. A.DreznerZ. (2003). Model specification searches using ant colony optimization algorithms. Structural Equation Modeling, 10, 154–164.
19.
MarcoulidesK. M.FalkC. F. (2018). Model specification searches in structural equation modeling with r. Structural Equation Modeling: A Multidisciplinary Journal, 25, 484–491.
20.
MeehlP. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66, 195–244.
21.
MetropolisN.RosenbluthA. W.RosenbluthM. N.TellerA. H.TellerE. (1953). Equation of state calculation by fast computing machines. Journal of Chemical Physics, 21, 1087–1091.
22.
MuthénB. O. (2002). Beyond SEM: General latent variable modeling. Behaviormetrika, 29, 81–117.
23.
PakarinenE.LerkkanenM.-K.SuchodoletzA. (2020). Teacher emotional support in relation to social competence in preschool classrooms. International Journal of Research & Method in Education, 43, 1–17. https://doi.org/10.1080/1743727X.2020.1791815
24.
PekJ.MacCallumR. C. (2011). Sensitivity analysis in structural equation models: Cases and their influence. Multivariate Behavioral Research, 46, 202–228.
25.
Rayward-SmithV.OsmanI.ReevesC.SimthG. (1996). Modern heuristic search methods. John Wiley.
26.
RindskopfD. (1984). Using phantom and imaginary latent variables to parameterize constraints in linear structural models. Psychometrika, 49, 37–347.
27.
RosseelY. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.
28.
RudasillK.GallagherK.WhiteJ. (2010). Temperamental attention and activity, classroom emotional support, and academic achievement in third grade. Journal of School Psychology, 48, 113–134. https://doi.org/10.1016/j.jsp.2009.11.002
29.
RutenbarR. (1989). Simulated annealing algorithms: An overview. IEEE Circuits and Devices Magazine, 5, 19–26.
30.
RyanA.ShimS. (2012). Changes in help seeking from peers during early adolescence: Associations with changes in achievement and perceptions of teachers. Journal of Educational Psychology, 104, 1122. https://doi.org/10.1037/a0027696
31.
ShadishW.CookT.CampbellD. (2004). Quasi-experimental designs for generalized causal inference (Vol. 27).
SpearC.PiastaS.Yeomans-MaldonadoG.OttleyJ.JusticeL.O’ConnellA. (2018). Early childhood general and special educators: An examination of similarities and differences in beliefs, knowledge, and practice. Journal of Teacher Education, 69, 263–277.
34.
StanderJ.SilvermanB. W. (1994). Temperature schedules for simulated annealing. Statistics and Computing, 4, 21–32.
35.
XiangY.GubianS.SuomelaB.HoengJ. (2013). Generalized simulated annealing for global optimization: The GenSA package. R Journal, 5, 13–28.
36.
XuS.BlozisS. A. (2010). Sensitivity analysis of mixed models for incomplete longitudinal data. Journal of Educational and Behavioral Statistics, 36, 237–256.
37.
YuanK.-H.KourosC.KelleyK. (2008). Diagnosis for covariance structure models by analyzing the path. Structural Equation Modeling: A Multidisciplinary Journal, 15, 564–602.
