Investigating the Structure of the Pediatric Symptoms Checklist in the Preschool Setting

Abstract

When using educational/psychological instruments, psychometric investigations should be conducted before adopting to new environments to ensure that an instrument measures the same constructs. Exploratory structural equation modeling and confirmatory factor analysis methods were used to examine the utility of the short form of the Pediatric Symptoms Checklist (PSC-17) in the school setting. Using a sample of 836 preschool children rated by teachers, three factors were identified across both techniques, with factors matching the hypothesized structure of the instrument. The PSC-17 may be an option for use in preschool settings when conducting behavioral and emotional screening.

Keywords

exploratory structural equation modeling confirmatory factor analysis preschool multitiered systems of support validation

Get full access to this article

View all access options for this article.

References

Achenbach

T. M.

Rescorla

L. A.

(2001). Manual for the ASEBA school-age forms and profiles. Burlington, VT: Research Center for Children, Youth, and Families.

American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational & Psychological Testing. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.

Aos

Lieb

Mayfield

Miller

Pennucci

(2004). Benefits and costs of prevention and early intervention programs for youth. Olympia: Washington State Institute for Public Policy.

Asparouhov

Muthén

(2009). Exploratory structural equation modeling. Structural Equation Modeling, 16, 397-438.

Barbarin

O. A.

(2007). Mental health screening of preschool children: Validity and reliability of ABLE. American Journal of Orthopsychiatry, 77, 402-418.

Benson

Nasser

(1998). On the use of factor analysis as a research tool. Journal of Vocational Education Research, 23, 13-33.

Blucker

R. T.

Jackson

Gillaspy

J. A.

Hale

Wolraich

Gillaspy

S. R.

(2014). Pediatric behavioral health screening in primary care: A preliminary analysis of the Pediatric Symptom Checklist-17 with functional impairment items. Clinical Pediatrics, 53, 449-455.

Booth

Hughes

D. J.

(2014). Exploratory structural equation modeling of personality data. Assessment, 21, 260-271. doi:10.1177/1073191114528029

10.

Campaign for Mental Health Reform. (2005). Emergency response: A roadmap for federal action on America’s mental health crisis. Washington, DC: Author.

11.

DiStefano

Ene

Leighton

(2015). Teacher ratings of child behavior in preschool: A MIMIC investigation of the BESS TRS-P. Psychological Assessment.

12.

DiStefano

Greer

F. W.

Kamphaus

R. W.

(2013). Multifactor modeling of emotional and behavioral risk of preschool-age children. Psychological Assessment, 25, 467-476.

13.

Finney

S. J.

DiStefano

(2013). Nonnormal and categorical data in structural equation models. In Hancock

G. R.

Mueller

R. O.

(Eds.), Structural equation modeling: A second course (2nd ed., pp. 439-492). Charlotte, NC: Information Age.

14.

Flanagan

K. S.

Bierman

K. L.

Kam

C. M.

(2003). Identifying at-risk children at school entry: The usefulness of multibehavioral problem profiles. Journal of Clinical Child & Adolescent Psychology, 32, 396-407.

15.

Furnham

Guenole

Levine

S. Z.

Chamorro-Premuzic

(2012). The NEO Personality Inventory–Revised: Factor structure and gender invariance from exploratory structural equation modeling analyses in a high-stakes setting. Assessment, 20(14), 14-23. doi:10.1177/1073191112448213

16.

Furr

(2011). Scale construction and psychometrics for social and personality psychology. London, England: Sage.

17.

Gardner

Murphy

J. M.

Childs

Kelleher

Pagano

Jellinek

. . . Chiappetta

(1999). The PSC-17: A brief Pediatric Symptom Checklist with psychosocial problem subscales. A report from PROS and ASPN. Ambulatory Child Health, 5, 225-236.

18.

Gignac

G. E.

(2008). Higher-order models versus direct hierarchical models: g as superordinate or breadth factor? Psychology Science, 50, 21-43.

19.

Glover

T. A.

Albers

C. A.

(2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117-135.

20.

Goodman

(2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 1337-1345.

21.

Gorsuch

R. L.

(1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

22.

Guzman

Kessler

R. C.

Squicciarini

A. M.

George

Baer

Canenguez

K. M.

. . . Murphy

J. M.

(2015). Evidence for the effectiveness of a national school-based mental health program in Chile. Journal of the American Academy of Child & Adolescent Psychiatry, 54, 799-807.

23.

Harrison

J. R.

Vannest

K. J.

Reynolds

C. R.

(2013). Social validity criteria applied to a screening instrument for emotional and behavioral issues. Journal of Behavioral Disorders, 38(3), 171-182.

24.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.

25.

Jellinek

M. S.

Murphy

J. M.

(2006). Pediatric Symptoms Checklist–17 [Instrument]. Retrieved from http://www.massgeneral.org/psychiatry/assets/PSC-17_English.pdf

26.

Jellinek

M. S.

Murphy

J. M.

Burns

B. J.

(1986). Brief psychosocial screening in outpatient pediatric practice. Journal of Pediatrics, 109, 371-378.

27.

Kamphaus

R. W.

DiStefano

Dowdy

Eklund

Dunn

A. R.

(2010). Determining the presence of a problem: Comparing two approaches for detecting youth behavioral risk. School Psychology Review, 39(3), 395-407.

28.

Kamphaus

R. W.

Reynolds

C. R.

(2007). BASC-2 Behavioral and Emotional Screening System (BESS) manual. Circle Pines, MN: Pearson.

29.

Kazdin

A. E.

(1987). Conduct disorders in childhood and adolescence. Newbury Park, CA: Sage.

30.

Kline

R. B.

(2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.

31.

Marsh

H. W.

Liem

G. A. D.

Martin

A. J.

Morin

A. J. S.

Nagengast

(2011). Methodological measurement fruitfulness of exploratory structural equation modeling (ESEM): New approaches to key substantive issues in motivation and engagement. Journal of Psychoeducational Assessment, 29, 322-346. doi:10.1177/0734282911406657

32.

Marsh

H. W.

Lüdtke

Muthén

Asparouhov

Morin

A. J. S.

Trautwein

Nagengast

(2010). A new look at the Big Five factor structure through exploratory structural equation modeling. Psychological Assessment, 22, 471-491. doi:10.1037/a0019227

33.

Marsh

H. W.

Muthén

Asparouhov

Lüdtke

Robitzsch

Morin

A. J. S.

Trautwein

(2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Structural Equation Modeling, 16, 439-476.

34.

Muthén

L. K.

Muthén

B. O.

(1998-2010). Mplus user’s guide (7th ed.). Los Angeles, CA: Author.

35.

Rubin

K. H.

Hymel

Mills

R. S. L.

(1989). Sociability and social withdrawal in childhood: Stability and outcomes. Journal of Personality, 57, 237-255.

36.

Schermelleh-Engel

Moosbrugger

Müller

(2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8(2), 23-74.

37.

Spinrad

T. L.

Eisenberg

Harris

Hanish

Fabes

R. A.

Kupanoff

. . . Holmes

(2004). The relation of children’s everyday nonsocial peer play behavior to their emotionality, regulation, and social functioning. Developmental Psychology, 40(1), 67-80.

38.

Stoppelbein

Greening

Moll

Jordann

Suozzi

(2012). Factor analyses of the Pediatric Symptom Checklist–17 with African-American and Caucasian pediatric populations. Journal of Pediatric Psychology, 37, 348-357. doi:10.1093/jpepsy/jsr103

39.

Taylor

H. G.

Anselmo

Foreman

A. L.

Schatschneider

Angelopoulos

(2000). Utility of kindergarten teacher judgments in identifying early learning problems. Journal of Learning Disabilities, 33, 200-210.

40.

ten Holt

J. C.

van Duijn

M. A. J.

Boomsma

. (2010). Scale construction and evaluation in practice: A review of factor analysis versus item response theory applications. Psychological Test and Assessment Modeling, 52, 272-297.

41.

Teo

(2013). Examining the psychometric properties of the Epistemic Belief Inventory (EBI). Journal of Psychoeducational Assessment, 3(1), 72-79.

42.

Velicer

W. F.

(1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321-327.

43.

Webster-Stratton

Reid

M. J.

(2008). Adapting the incredible years child dinosaur social, emotional and problem solving intervention to address co-morbid diagnoses. Journal of Children’s Services, 3(3), 17-30.

44.

Wiesner

Schanding

G. T.

(2013). Exploratory structural equation modeling, bifactor models, and standard confirmatory factor analysis models: Application to the BASC-2 Behavioral and Emotional Screening System Teacher Form. Journal of School Psychology, 51, 751-763.

45.

You

Furlong

M. J.

Dowdy

Renshaw

T. L.

Smith

D. C.

O’Malley

M. D.

(2014). Further validation of the Social and Emotional Health Survey for high school students. Applied Research in Quality of Life, 9(4), 997-1015.

46.

Zevenbergen

A. A.

Ryan

M. M.

(2010). Gender differences in the relationship between attention problems and expressive language and emerging academic skills in preschool-aged children. Early Child Development and Care, 180, 1337-1348.