This study compares two network-based approaches for analyzing binary psychological assessment data: network psychometrics and latent space item response modeling (LSIRM). Network psychometrics, a well-established method, infers relationships among items or symptoms based on pairwise conditional dependencies. In contrast, LSIRM is a more recent framework that represents item responses as a bipartite network of respondents and items embedded in a latent metric space, where the likelihood of a response decreases with increasing distance between the respondent and item. We evaluate the performance of both methods through simulation studies under varying data-generating conditions. In addition, we demonstrate their applications to real assessment data, showcasing the distinct insights each method offers to researchers and practitioners.
AsamovT.Ben-IsraelA. (2022). A probabilistic l1 method for clustering high-dimensional data. Probability in the Engineering and Informational Sciences, 36, 433–453. https://doi.org/10.1017/S026996482100040X
BeeberL.Holditch-DavisD.PerreiraK.SchwartzT.LewisV.BlanchardH.CanusoR.GoldmanB. (2010). Short-term in-home intervention reduces depressive symptoms in Early Head Start Latina mothers of infants and toddlers. Research in Nursing & Health, 33, 60–76. https://doi.org/10.1002/nur.20363
4.
BeeberL.SchwartzT.Holditch-DavisD.CanusoR.LewisV.HallH. (2013). Parenting enhancement, interpersonal psychotherapy to reduce depression in low-income mothers of infants and toddlers: A randomized trial. Nursing Research, 62, 82–90. https://doi.org/10.1097/NNR.0b013e31828324c2
5.
BeeberL.SchwartzT.MartinezM.Holditch-DavisD.BledsoeS.CanusoR.LewisV. (2014). Depressive symptoms and compromised parenting in low-income mothers of infants and toddlers: Distal and proximal risks. Research in Nursing & Health, 37, 276–291. https://doi.org/10.1002/nur.21604
6.
BesagJ. (1975). Statistical analysis of non-lattice data. Journal of the Royal Statistical Society. Series D (The Statistician), 24, 179–195. https://www.jstor.org/stable/2987782
ChenJ.ChenZ. (2008). Extended Bayesian information criteria for model selection with large model spaces. Biometrika, 95, 759–771. https://doi.org/10.1093/biomet/asn034
9.
CramerA. O. J.WaldorpL. J.van der MaasH. L. J.BorsboomD. (2010). Comorbidity: A network perspective. Behavioral and Brain Sciences, 33(2–3), 137–150. https://doi.org/10.1017/S0140525X09991567
10.
de ValpineP.PaciorekC.TurekD.MichaudN.Anderson-BergmanC.ObermeyerF.Wehrhahn CortesC.RodrìguezA.Temple LangD.PaganinS. (2024). NIMBLE: MCMC, particle filtering, and programmable hierarchical modeling (Version 1.2.1). https://doi.org/10.5281/zenodo.1211190
11.
de VriesJ. J.NijkampP.RietveldP. (2009). Exponential or power distance-decay for commuting? An alternative specification. Environment and Planning A: Economy and Space, 41, 461–480. https://doi.org/10.1068/a39369
12.
D’UrsoP.MassariR.De GiovanniL.CappelliC. (2016). Exponential distance-based fuzzy clustering for interval-valued data. Fuzzy Optimization and Decision Making, 16, 51–70. https://doi.org/10.1007/s10700-016-9238-8
EpskampS.CramerA. O. J.WaldorpL. J.SchmittmannV. D.BorsboomD. (2012). Qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48, 1–18. https://doi.org/10.18637/jss.v048.i04
16.
EpskampS.KruisJ.MarsmanM. (2017). Estimating psychopathological networks: Be careful what you wish for. PLOS ONE, 12, Article e0179891. https://doi.org/10.1371/journal.pone.0179891
17.
EpskampS.MarisG.WaldorpL. J.BorsboomD. (2018). Network psychometrics. In The Wiley handbook of psychometric testing: A multidisciplinary reference on survey, scale and test development (pp. 953–986). Wiley Blackwell. https://doi.org/10.1002/9781118489772.ch30
FinnemannA.BorsboomD.EpskampS.van der MaasH. L. (2021). The theoretical and statistical Ising model: A practical guide in R. Psych, 3, 593–617. https://doi.org/10.3390/psych3040039
20.
FoygelR.DrtonM. (2010). Extended Bayesian information criteria for Gaussian graphical models. Advances in Neural Information Processing Systems, 23. https://doi.org/10.48550/arXiv.1011.6640
21.
GoD.JeonM.LeeS.JinI. H.ParkH.-J. (2022). Analyzing differences between parent-and self-report measures with a latent space approach. PLOS ONE, 17, Article e0269376. https://doi.org/10.1371/journal.pone.0269376
HaslbeckJ. M.EpskampS.MarsmanM.WaldorpL. J. (2021). Interpreting the Ising model: The input matters. Multivariate Behavioral Research, 56, 303–313. https://doi.org/10.1080/00273171.2020.1730150
24.
HoE.JeonM. (2023). Interaction map: A visualization tool for personalized learning based on assessment data. Psych, 5, 1140–1155. https://doi.org/10.3390/psych5040076
25.
HoffP. D.RafteryA. E.HandcockM. S. (2002). Latent space approaches to social network analysis. Journal of the American Statistical Association, 97, 1090–1098. https://doi.org/10.1198/016214502388618906
JeonM. (2021). A network approach to assessment data: A latent space item response modeling framework [A workshop at the Annual Meeting of German Association of Psychology].
28.
JeonM.JinI. H.SchweinbergerM.BaughS. (2021). Mapping unobserved item–respondent interactions: A latent space item response model with interaction map. Psychometrika, 86, 378–403. https://doi.org/10.1007/s11336-021-09762-5
29.
JeonM.SchweinbergerM. (2024). A latent process model for monitoring progress toward hard-to-measure targets with applications to mental health and online educational assessments. The Annals of Applied Statistics, 18, 2123–2146. https://doi.org/10.48550/arXiv.2305.09804
30.
JinI. H.JeonM. (2019). A doubly latent space joint model for local item and person dependence in the analysis of item response data. Psychometrika, 84, 236–260. https://doi.org/10.1007/s11336-018-9630-0
31.
JinI. H.JeonM.SchweinbergerM.YunJ.LinL. (2022). Multilevel network item response modelling for discovering differences between innovation and regular school systems in Korea. Journal of the Royal Statistical Society Series C: Applied Statistics, 71, 1225–1244. https://doi.org/10.1111/rssc.12569
32.
JinI. H.YunJ.KimH.JeonM. (2023). A latent space accumulator model for response time: Applications to cognitive assessment data. Stat, 12, e632. https://doi.org/10.1002/sta4.632
33.
JohalS.RhemtullaM. (2023). Comparing estimation methods for psychometric networks with ordinal data. Psychological Methods, 28, 1251–1272. https://doi.org/10.1037/met0000449
34.
KangI.JeonM. (2024). A recent development of a network approach to assessment data: Latent space item response modeling for intelligence studies. Journal of Intelligence, 12, 38. https://doi.org/10.3390/jintelligence12040038
35.
KangI.JeonM.PartchevI. (2023). A latent space diffusion item response theory model to explore conditional dependence between responses and response times. Psychometrika, 88, 830–864. https://doi.org/10.1007/s11336-023-09920-x
36.
KeetelaarS.SekulovskiN.BorsboomD.MarsmanM. (2024). Comparing maximum likelihood and maximum pseudolikelihood estimators for the Ising model. Advances in Psychology, 2, e25745. https://doi.org/10.31234/osf.io/x29ub
37.
KimN.JeonM.PartchevI. (2024). Conditional dependence across slow and fast item responses: With a latent space item response modeling approach. Journal of Intelligence, 12, 23. https://doi.org/10.3390/jintelligence12020023
LangeJ.DalegeJ.BorsboomD.van KleefG. A.FischerA. H. (2020). Toward an integrative psychometric model of emotions. Perspectives on Psychological Science, 15, 444–468. https://doi.org/10.1177/1745691619895057
40.
LiangF. (2010). A double metropolis–hastings sampler for spatial models with intractable normalizing constants. Journal of Statistical Computation and Simulation, 80, 1007–1022. https://doi.org/10.1080/00949650902882162
41.
LiangF.JinI. H.SongQ.LiuJ. S. (2016). An adaptive exchange algorithm for sampling from distributions with intractable normalizing constants. Journal of the American Statistical Association, 111, 377–393. https://doi.org/10.1080/01621459.2015.1009072
42.
LiuQ.IhlerA. (2012). Distributed parameter estimation via pseudo-likelihood [Proceedings of the International Conference on Machine Learning (ICML)]. https://doi.org/10.5555/3060832.3060888
43.
LuoJ.De CarolisL.ZengB.JeonM. (2023). Bayesian estimation of latent space item response models with JAGS, Stan, and NIMBLE in R. Psych, 5, 396–415. https://doi.org/10.3390/psych5020027
44.
LuoJ.JeonM. (2023). prolsirm: Procrustes matching for latent space item response model.
45.
MøllerJ.PettittA. N.ReevesR.BerthelsenK. K. (2006). An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants. Biometrika, 93, 451–458. https://doi.org/10.1093/BIOMET/93.2.451
46.
MarsmanM.van den BerghD.SekulovskiN. (2023). bgms: Bayesian variable selection for networks of binary and/or ordinal variables [Computer software manual].
47.
MoghadamP. H.HeidariV.MoeiniA.KamandiA. (2019). An exponential similarity measure for collaborative filtering. SN Applied Sciences, 1, 1–4.
48.
MohammadiR.WitE. C. (2019). BDgraph: An R package for Bayesian structure learning in graphical models. Journal of Statistical Software, 89, 1–30. https://doi.org/10.18637/jss.v089.i03
49.
OpsahlT.AgneessensF.SkvoretzJ. (2010). Node centrality in weighted networks: Generalizing degree and shortest paths. Social Networks, 32, 245–251. https://doi.org/10.1016/j.socnet.2010.03.006
RadloffL. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401. https://doi.org/10.1177/014662167700100306
52.
SantosH. P. J.KossakowskiJ. J.SchwartzT. A.BeeberL.FriedE. I. (2018). Longitudinal network structure of depression symptoms and self-efficacy in low-income mothers. PLOS ONE, 13, Article e0191675. https://doi.org/10.1371/journal.pone.0191675
53.
ShafferD.FisherP.LucasC. P.DulcanM. K.Schwab-StoneM. E. (2000). Nimh diagnostic interview schedule for children version iv (nimh disc-iv): Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 28–38. https://doi.org/10.1097/00004583-200001000-00014
54.
SilkT. J.MalpasC. B.BeareR.EfronD.AndersonV.HazellP.JongelingB.NicholsonJ. M.SciberrasE. (2019). A network analysis approach to ADHD symptoms: More than the sum of its parts. PLOS ONE, 14, Article e0211053. https://doi.org/10.1371/journal.pone.0211053
55.
SoaresG. H.SantiagoP. H. R.Michel-CrosatoE.JamiesonL. (2020). The utility of network analysis in the context of indigenous Australian oral health literacy. PLOS ONE, 15, Article e0233972. https://doi.org/10.1371/journal.pone.0233972
56.
Stan Development Team. (2024). Stan modeling language users guide and reference manual (Version 2.35). https://mc-stan.org
57.
van BorkuloC. D. (2018). Symptom network models in depression research: From methodological exploration to clinical application [Doctoral dissertation, University of Groningen]. University of Groningen.
58.
van BorkuloC. D.BorsboomD.EpskampS.BlankenT. F.BoschlooL.SchoeversR. A.WaldorpL. J. (2014). A new method for constructing networks from binary data. Scientific Reports, 4, 5918. https://doi.org/10.1038/srep05918
van BorkuloC. D.EpskampS.RobitzschA.ConstantinM. A. (2023). Isingfit: Fitting Ising models using the eLasso method [R package version 0.4]. https://cran.r-project.org/package=IsingFit
61.
van BorkuloC. D.van BorkR.BoschlooL.KossakowskiJ. J.TioP.SchoeversR. A.BorsboomD.WaldorpL. J. (2023). Comparing network structures on three aspects: A permutation test. Psychological Methods, 28, 1273. https://doi.org/10.1037/met0000476
62.
WilliamsD. R.MulderJ. (2020). BGGM: Bayesian Gaussian graphical models in R. Journal of Open Source Software, 5, 21111. https://doi.org/10.21105/joss.02111
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
