This study aimed to investigate the measurement invariance of the Alabama Parenting Questionnaire (for both long [APQ-lg] and short [APQ-9] forms) across age, gender, clinical status, and informant (i.e., parent vs. child reports). The sample was composed of adolescents (community sample: N = 1,746; clinical sample: N = 166) and parents (N = 149). The analyses were conducted in R. Measurement invariance was assessed via multi-group confirmatory factor analysis, equivalence test, and subsampling approach. The original model of APQ-lg (five factors) showed a significantly better fit than other concurrent models (five concurrent models were specified, based on prior literature). For APQ-lg, we found measurement invariance across gender and partial measurement invariance across age, clinical status, and informant. For APQ-9, we confirmed the measurement invariance across gender and clinical status, while across age and informant partial measurement invariance was attested. Overall, our study indicated that APQ-lg and APQ-9 are two valid tools for measuring parenting practices with some caveats.
AugustG. J.LeeS. S.BloomquistM. L.RealmutoG. M.HektnerJ. M. (2003). Dissemination of an evidence-based prevention innovation for aggressive children living in culturally diverse, urban neighborhoods: The early risers effectiveness study. Prevention Science, 4(4), 271–286. https://doi.org/10.1023/A:1026072316380
2.
BarryC. T.FrickP. J.GrafemanS. J. (2008). Child versus parent reports of parenting practices: Implications for the conceptualization of child behavioral and emotional problems. Assessment, 15(3), 294–303. https://doi.org/10.1177/1073191107312212
BergerK. S. (2015). Developing person through childhood and adolescence. Macmillan Learning.
5.
ChenF. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
6.
ChenF. F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95(5), 1005–1018. https://doi.org/10.1037/a0013193
7.
ChenM.ChanK. L. (2016). Effects of parenting programs on child maltreatment prevention: A meta-analysis. Trauma, Violence, & Abuse, 17(1), 88–104. https://doi.org/10.1177/1524838014566718
8.
ClerkinS. M.MarksD. J.PolicaroK. L.HalperinJ. M. (2007). Psychometric properties of the Alabama Parenting Questionnaire-preschool revision. Journal of Clinical Child and Adolescent Psychology, 36(1), 19–28. https://doi.org/10.1207/s15374424jccp3601_3
9.
CortinaJ. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037/0021-9010.78.1.98
10.
CounsellA.CribbieR. A.FloraD. B. (2020). Evaluating equivalence testing methods for measurement invariance. Multivariate Behavioral Research, 55(2), 312–328. https://doi.org/10.1080/00273171.2019.1633617
11.
CovaF.RincónP.BustosC.StreinerD.KingM.SaldiviaS.InostrozaC.GrandónP.NovoaC. (2020). Randomized cluster trial of a parenting program in Chile: Key mediators in the decrease in behavior problems in preschool children. Clinical Child Psychology and Psychiatry, 25(2), 320–332. https://doi.org/10.1177/1359104519864124
12.
CrockerL.AlginaJ. (1986). Introduction to classical and modern test theory. Holt, Rinehart and Winston.
13.
DarlingN.SteinbergL. (1993). Parenting style as context: An integrative model. Psychological Bulletin, 113(3), 487–496.
14.
DengL.YuanK.-H. (2016). Comparing latent means without mean structure models: A projection-based approach. Psychometrika, 81(3), 802–829. https://doi.org/10.1007/s11336-015-9491-8
15.
DiStefanoC.MorganG. B. (2014). A comparison of diagonal weighted least squares robust estimation techniques for ordinal data. Structural Equation Modeling: A Multidisciplinary Journal, 21(3), 425–438. https://doi.org/10.1080/10705511.2014.915373
16.
DobreanA.PăsăreluC.-R.BalazsiR.PredescuE. (2021). Measurement invariance of the ADHD Rating Scale–IV home and school versions across age, gender, clinical status, and informant. Assessment, 28(1), 86–99. https://doi.org/10.1177/1073191119858421
17.
DrasgowF. (1984). Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are the central issues. Psychological Bulletin, 95(1), 134–135. https://doi.org/10.1037/0033-2909.95.1.134
18.
DunnT. J.BaguleyT.BrunsdenV. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046
19.
EekhoutI.de VetH. C. W.TwiskJ. W. R.BrandJ. P. L.de BoerM. R.HeymansM. W. (2014). Missing data in a multi-item instrument were best handled by multiple imputation at the item score level. Journal of Clinical Epidemiology, 67(3), 335–342. https://doi.org/10.1016/j.jclinepi.2013.09.009
20.
ElgarF. J.WaschbuschD.DaddsM. R.SigvaldasonN. (2007). Development and validation of a short form of the Alabama Parenting Questionnaire. Journal of Child and Family Studies, 16(2), 243–259. https://doi.org/10.1007/s10826-006-9082-5
21.
EndersC. K.BandalosD. L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling: A Multidisciplinary Journal, 8(3), 430–457. https://doi.org/10.1207/S15328007SEM0803_5
22.
EscribanoS.AniorteJ.OrgilésM. (2013). Factor structure and psychometric properties of the Spanish version of the Alabama Parenting Questionnaire (APQ) for children. Estructura Factorial y Propiedades Psicométricas de La Versión Española Del Alabama Parenting Questionnaire (APQ) Para Niños, 25(3), 324–329. https://doi.org/10.7334/psicothema2012.315
23.
EspositoA.ServeraM.Garcia-BandaG.Del GiudiceE. (2016). Factor analysis of the Italian version of the Alabama Parenting Questionnaire in a community sample. Journal of Child and Family Studies, 25(4), 1208–1217. https://doi.org/10.1007/s10826-015-0291-7
24.
EssauC. A.SasagawaS.FrickP. J. (2006). Psychometric properties of the Alabama Parenting Questionnaire. Journal of Child and Family Studies, 15(5), 595–614. https://doi.org/10.1007/s10826-006-9036-y
25.
FlemingC. B.MasonW. A.ThompsonR. W.HaggertyK. P.GrossT. J. (2016). Child and parent report of parenting as predictors of substance use and suspensions from school. The Journal of Early Adolescence, 36(5), 625–645. https://doi.org/10.1177/0272431615574886
26.
FloreanI. S.DobreanA.PăsăreluC. R.GeorgescuR. D.MileaI. (2020). The Efficacy of internet-based parenting programs for children and adolescents with behavior problems: A meta-analysis of randomized clinical trials. Clinical Child and Family Psychology Review, 23, 510–528. https://doi.org/10.1007/s10567-020-00326-0
27.
FrickP. J. (1991). The Alabama parenting questionnaire [Unpublished rating scale]. University of Alabama.
28.
FrickP. J.ChristianR. E.WoottonJ. M. (1999). Age trends in the association between parenting practices and conduct problems. Behavior Modification, 23(1), 106–128. https://doi.org/10.1177/0145445599231005
29.
FriedlmeierM.TrommsdorffG. (2011). Are mother–child similarities in value orientations related to mothers’ parenting? A comparative study of American and Romanian mothers and their adolescent children. European Journal of Developmental Psychology, 8(6), 661–680. https://doi.org/10.1080/17405629.2011.590649
30.
GadermannA. M.GuhnM.ZumboB. D. (2012). Estimating ordinal reliability for likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation, 17(3), 1–13.
31.
GherasimL. R.BrumariuL. E.AlimC. L. (2017). Parenting style and children’s life satisfaction and depressive symptoms: Preliminary findings from Romania, France, and Russia. Journal of Happiness Studies, 18(4), 1013–1028. https://doi.org/10.1007/s10902-016-9754-9
32.
GrossT. J.FlemingC. B.MasonW. A.HaggertyK. P. (2017). Alabama Parenting Questionnaire–9: Longitudinal measurement invariance across parents and youth during the transition to high school. Assessment, 24(5), 646–659. https://doi.org/10.1177/1073191115620839
33.
GuenoleN.BrownA. (2014). The consequences of ignoring measurement invariance for path coefficients in structural equation models. Frontiers in Psychology, 5, Article 980. https://doi.org/10.3389/fpsyg.2014.00980
34.
GüngörD.BornsteinM. H. (2010). Culture-general and -specific associations of attachment avoidance and anxiety with perceived parental warmth and psychological control among Turk and Belgian adolescents. Journal of Adolescence, 33(5), 593–602. https://doi.org/10.1016/j.adolescence.2009.12.005
35.
HadiwijayaH.KlimstraT. A.VermuntJ. K.BranjeS. J. T.MeeusW. H. J. (2017). On the development of harmony, turbulence, and independence in parent–adolescent relationships: A five-wave longitudinal study. Journal of Youth and Adolescence, 46(8), 1772–1788. https://doi.org/10.1007/s10964-016-0627-7
36.
HancockG. R.StapletonL. M.MuellerR. O. (2018). The reviewer’s guide to quantitative methods in the social sciences. Routledge.
37.
HawesD. J.DaddsM. R. (2006). Assessing parenting practices through parent-report and direct observation during parent-training. Journal of Child and Family Studies, 15(5), 554–567. https://doi.org/10.1007/s10826-006-9029-x
38.
HoeveM.DubasJ. S.EichelsheimV. I.van der LaanP. H.SmeenkW.GerrisJ. R. M. (2009). The relationship between parenting and delinquency: A meta-analysis. Journal of Abnormal Child Psychology, 37(6), 749–775. https://doi.org/10.1007/s10802-009-9310-8
39.
HornJ. L.McardleJ. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18(3), 117–144. https://doi.org/10.1080/03610739208253916
40.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
41.
HurleyK.Huscroft-D’AngeloJ.TroutA.GriffithA.EpsteinM. (2014). Assessing parenting skills and attitudes: A review of the psychometrics of parenting measures. Journal of Child & Family Studies, 23(5), 812–823. https://doi.org/10.1007/s10826-013-9733-2
42.
JiangG.MaiY.YuanK.-H. (2020). equaltestMI: Examine measurement invariance via equivalence testing and projection method (Version 0.6.0) [Computer software]. https://CRAN.R-project.org/package=equaltestMI
43.
JorgensenT. D.PornprasertmanitS.SchoemannA. M.RosseelY.MillerP.QuickC.Garnier-VillarrealM.SeligJ.BoultonA.PreacherK.CoffmanD.RhemtullaM.RobitzschA.EndersC.ArslanR.ClintonB.PankoP.MerkleE.ChesnutS.. . . JohnsonA. R. (2021). semTools: Useful tools for structural equation modeling (Version 0.5-5) [Computer software]. https://CRAN.R-project.org/package=semTools
KyriazosT. A.StalikasA. (2019). Alabama Parenting Questionnaire–short form (APQ-9): Evidencing construct validity with factor analysis, CFA MTMM and measurement invariance in a Greek sample. Psychology, 10(12), 1790–1817. https://doi.org/10.4236/psych.2019.1012117
47.
LeungJ. T. Y.ShekD. T. L. (2020). Theories of adolescent development: Overview. In LeungJ. T. Y.ShekD. T. L. (Eds.), The encyclopedia of child and adolescent development (pp. 1–12). American Cancer Society. https://doi.org/10.1002/9781119171492.wecad305
48.
LiC.-H. (2016). The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables. Psychological Methods, 21(3), 369–387. https://doi.org/10.1037/met0000093
49.
LiK.-H.MengX.-L.RaghunathanT. E.RubinD. B. (1991). Significance levels from repeated p-values with multiply-imputed data. Statistica Sinica, 1(1), 65–92.
LindhiemO.ShafferA. (2016). Introduction to the special series: Current directions for measuring parenting constructs to inform prevention science. Prevention Science, 3(18), 253–256. https://doi.org/10.1007/s11121-016-0724-6
52.
Lorenzo-SevaU.FerrandoP. J. (2021). Not positive definite correlation matrices in exploratory item factor analysis: Causes, consequences and a proposed solution. Structural Equation Modeling: A Multidisciplinary Journal, 28(1), 138–147. https://doi.org/10.1080/10705511.2020.1735393
53.
MacCallumR. C.RoznowskiM.NecowitzL. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111(3), 490–504. https://doi.org/10.1037/0033-2909.111.3.490
54.
MaguinE.NochajskiT.WitD. D.SafyerA. (2016). Examining the validity of the adapted Alabama Parenting Questionnaire—Parent global report version. Psychological Assessment, 28(5), 613–625. https://doi.org/10.1037/pas0000214
55.
MolinuevoB.PardoY.TorrubiaR. (2011). Psychometric analysis of the catalan version of the Alabama Parenting Questionnaire (APQ) in a community sample. The Spanish Journal of Psychology, 14(2), 944–955. https://doi.org/10.5209/rev_SJOP.2011.v14.n2.40
56.
NogueiraS.SantosM.CanárioC.FerreiraT.Abreu-LimaI.CardosoC.CruzO. (2020). Psychometric properties of the Portuguese version of the Alabama Parenting Questionnaire parent form. European Journal of Developmental Psychology, 17(3), 465–479. https://doi.org/10.1080/17405629.2019.1686972
57.
PăsăreluC. R.DobreanA. (2018). An investigation of mediators for the relationship between parent mental health and adolescent problematic Internet use: A cross-sectional study in Romanian adolescents. Journal of Evidence-Based Psychotherapies, 18(2), 97–116. https://doi.org/10.24193/jebp.2018.2.16
58.
PăsăreluC. R.DobreanA.BalazsiR.PredescuE.ŞiposR.LupuV. (2017). The Penn State Worry Questionnaire for children: Age, gender and clinical invariance. Child Psychiatry & Human Development, 48(3), 359–369. https://doi.org/10.1007/s10578-016-0663-2
59.
PetersonR. A. (1994). A meta-analysis of Cronbach’s coefficient alpha. Journal of Consumer Research, 21(2), 381–391.
60.
PetscherY.SchatschneiderC.ComptonD. L. (2013). Applied quantitative analysis in education and the social sciences. Routledge.
61.
PinquartM. (2017). Associations of parenting dimensions and styles with externalizing problems of children and adolescents: An updated meta-analysis. Developmental Psychology, 53(5), 873–932. https://doi.org/10.1037/dev0000295
62.
PutnickD. L.BornsteinM. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
63.
RevelleW. (2020). psych: Procedures for psychological, psychometric, and personality research (Version 2.0.9) [Computer software]. https://CRAN.R-project.org/package=psych
64.
RhemtullaM.Brosseau-LiardP. E.SavaleiV. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. https://doi.org/10.1037/a0029315
65.
RStudio Team (2020). RStudio: Integrated Development Environment for R. RStudio, PBC, Boston, MA URLhttp://www.rstudio.com/.
66.
RubinD. B. (1987). Multiple imputation for survey nonresponse. John Wiley & Sons.
67.
RussellJ. D.GrahamR. A.NeillE. L.WeemsC. F. (2016). Agreement in youth–parent perceptions of parenting behaviors: A case for testing measurement invariance in reporter discrepancy research. Journal of Youth and Adolescence, 45(10), 2094–2107. https://doi.org/10.1007/s10964-016-0495-1
68.
SakalukJ. K.FisherA. N.KilshawR. E. (2021). Dyadic measurement invariance and its importance for replicability in romantic relationship science. Personal Relationships, 28(1), 190–226. https://doi.org/10.1111/pere.12341
69.
SchminkeyD. L.OertzenT. von, & BullockL. (2016). Handling missing data with multilevel structural equation modeling and full information maximum likelihood techniques. Research in Nursing & Health, 4(39), 286–297. https://doi.org/10.1002/nur.21724
70.
SchmittN.GolubovichJ.LeongF. T. L. (2011). Impact of measurement invariance on construct correlations, mean differences, and relations with external correlates: An illustrative example using Big Five and RIASEC measures. Assessment, 18(4), 412–427. https://doi.org/10.1177/1073191110373223
71.
ShafferA.RodriguezV. J.KolkoD. J.PilkonisP. A.LindhiemO. (2021). Measurement invariance in the Alabama Parenting Questionnaire: Implications for culturally inclusive parenting research. Journal of Family Issues. Advance online publication. https://doi.org/10.1177/0192513X211030022
72.
SheltonK. K.FrickP. J.WoottonJ. (1996). Assessment of parenting practices in families of elementary school-age children. Journal of Clinical Child Psychology, 25(3), 317–329. https://doi.org/10.1207/s15374424jccp2503_8
73.
ShroutP. E.LaneS. P. (2012). Psychometrics. In MehlM. R.ConnerT. S. (Eds.), Handbook of research methods for studying daily life (pp. 302–320). The Guilford Press.
74.
ŚwięcickaM.Woźniak-PrusM.GambinM.StolarskiM. (2019). Confirmation of the five-factor structure of the parent global report version of the Alabama Parenting Questionnaire in a polish community sample. Current Psychology, 1–19. https://doi.org/10.1007/s12144-019-00340-8
75.
TyupaS. (2011). A theoretical framework for back-translation as a quality assessment tool. New Voices in Translation Studies, 7, 35–46. https://ruj.uj.edu.pl/xmlui/handle/item/15068
76.
van BuurenS. (2018). Flexible imputation of missing data (2nd ed.). CRC Press.
77.
van BuurenS.Groothuis-OudshoornK.VinkG.SchoutenR.RobitzschA.DooveL.JolaniS.Moreno-BetancurM.WhiteI.GaffertP.MeinfelderF.GrayB. (2020). mice: Multivariate imputation by chained equations (Version 3.8.0) [Computer software]. https://CRAN.R-project.org/package=mice
78.
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002
79.
WoottonJ.FrickP.SheltonK.SilverthornP. (1997). Ineffective parenting and childhood conduct problems: The moderating role of callous—unemotional traits. Journal of Consulting and Clinical Psychology, 65(2), 301–308.
80.
World Health Organization. (1993). The ICD-10 classification of mental and behavioural disorders: Diagnostic criteria for research. World Health Organization.
81.
YoonM.LaiM. H. C. (2018). Testing factorial invariance with unbalanced samples. Structural Equation Modeling: A Multidisciplinary Journal, 25(2), 201–213. https://doi.org/10.1080/10705511.2017.1387859
82.
YuanK.-H.ChanW. (2016). Measurement invariance via multigroup SEM: Issues and solutions with chi-square-difference tests. Psychological Methods, 21(3), 405–426. https://doi.org/10.1037/met0000080
83.
YuanK.-H.ChanW.MarcoulidesG. A.BentlerP. M. (2016). Assessing structural equation models by equivalence testing with adjusted fit indexes. Structural Equation Modeling: A Multidisciplinary Journal, 23(3), 319–330. https://doi.org/10.1080/10705511.2015.1065414
ZlomkeK. R.LamportD.BaumanS.GarlandB.TalbotB. (2014). Parenting adolescents: Examining the factor structure of the Alabama Parenting Questionnaire for adolescents. Journal of Child and Family Studies, 23(8), 1484–1490. https://doi.org/10.1007/s10826-013-9803-5
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
