The Behavioral and Emotional Screening System Student Form: Is There Evidence of a Global At-Risk Factor in a Sample of Predominantly African American Youth?

Abstract

School-based universal screening for behavioral and emotional risk can serve as a foundation for effective multi-tiered service delivery systems. The current study examines the measurement and structure of one such universal screener, the Behavioral and Emotional Screening System Student Form (BESS SF). Four models were investigated including a unidimensional model, a multidimensional model, a second-order model, and a bifactor model. This study is the first to use a bifactor model in examining the structure of the BESS SF, and further adds to the literature by using bifactor modeling with a predominantly low-income, urban, African American sample. Results indicate that the bifactor model provided the best fit. Practically, results support interpretation of the global risk score as well as the domain-specific factors.

Keywords

universal screening behavioral and emotional risk Behavioral and Emotional Screening System Student Form factor analysis bi-factor measurement

Get full access to this article

View all access options for this article.

References

Albers

C. A.

Glover

T. A.

Kratochwill

T. R.

(2007). Introduction to the special issue: How can universal screening enhance educational and mental health outcomes? Journal of School Psychology, 45, 113-116. doi:10.1016/j.jsp.2006.12.002

Alegria

Vallas

Pumariega

A. J.

(2010). Racial and ethnic disparities in pediatric mental health. Child and Adolescent Psychiatric Clinics of North America, 19, 759-774. doi:10.1016/j.chc.2010.07.001

Bentler

P. M.

(1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.

Brown

T. A.

(2006). Confirmatory factor analysis for applied research. New York, NY: The Guilford Press.

Chen

West

Sousa

(2006). A comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research, 41, 189-225.

Chin

J. K.

Dowdy

Quirk

(2013). Universal screening in middle school: Examining the Behavioral and Emotional Screening System. Journal of Psychoeducational Assessment, 31, 52-59. doi: 10.1177/073482912448137

Curran

P. J.

West

S. G.

Finch

J. F.

(1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29.

DeMars

C. E.

(2013). A tutorial on interpreting bifactor model scores. International Journal of Testing, 13, 354-378.

DiStefano

Greer

F. W.

Kamphaus

R. W.

(2013). Multifactor modeling of emotional and behavioral risk of preschool-age children. Psychological Assessment, 25, 467-476. doi:10.1037/a0031393

10.

Dowdy

Kamphaus

Twyford

Dever

(2014). Culturally competent behavioral and emotional screening. In Weist

M. D.

Lever

N. A.

Bradshaw

C. P.

Owens

J. S.

(Eds.) Handbook of school mental health: research, training, practice, and policy. New York: Springer.

11.

Dowdy

Twyford

Chin

DiStefano

Kamphaus

Mays

(2011). Factor structure of the BASC-2 behavioral and emotional screening system student form. Psychological Assessment, 23, 379-387. doi:10.1037/a0021843

12.

Fenning

Rose

(2007). Overrepresentation of African American students in exclusionary discipline: The role of school policy. Urban Education, 42, 536-559. doi:10.1177/0042085907305039

13.

Fish

R. E.

(2016). The racialized construction of exceptionality: Experimental evidence of race/ethnicity effects on teachers’ interventions. Social Science Research. doi:10.1016/j.ssresearch.2016.08.007

14.

Gibbons

Bock

Hedeker

Weiss

Segawa

Bhaumik

Stover

(2007). Full-information item bifactor analysis of graded response data. Applied Psychological Measurement, 31, 4-19.

15.

Gignac

G. E.

(2007). Multi-factor modeling in individual differences research: Some recommendations and suggestions. Personality and Individual Differences, 42, 37-48. doi:10.1016/j.paid.2006.06.019

16.

Gignac

G. E.

(2015). The higher-order model imposes a proportionality constraint: That is why the bifactor model tends to fit better. Intelligence, 55, 57-68. doi:10.1016/j.intell.2016.01.006

17.

Glover

T. A.

Albers

C. A.

(2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117–135. doi:10.1016/j.jsp.2006.05.005.

18.

Gudino

O. G.

Lau

A. S.

Yeh

McCabe

K. M.

Hough

R. L.

(2009). Understanding racial/ethnic disparities in youth mental health services: Do disparities vary by problem type? Journal of Emotional and Behavioral Disorders, 17, 3-16. doi:10.1177/1063426608317710

19.

Harrell-Williams

Raines

Kamphaus

Dever

(2015). Psychometric analysis of the BASC-2 Behavioral and Emotional Screening System (BESS) Student Form: Results from high school student samples. Psychological Assessment, 27, 738-743. doi:10.1037/pas0000079

20.

Harry

Klingner

(2006). Why are so many minority students in special education? Understanding race and disability in schools. New York: Teachers College Press.

21.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55.

22.

Kamphaus

Reynolds

Dever

(2014) Behavioral and mental health screening. In Kettler

Glover

Albers

Feeny-Kettler

(Eds.) Universal screening in educational settings: Evidence-based decision making for schools. Washington D.C.: APA

23.

Kamphaus

R. W.

Reynolds

C. R.

(2007). BASC-2 Behavioral and Emotional Screening System manual. Minneapolis, MN: Pearson.

24.

Kenny

(2016). Structural Equation Modeling ( Kenny

David A.

). Retrieved from http://davidakenny.net/cm/fit.htm

25.

King

Reschly

Appleton

(2012). An examination of the validity of the Behavioral and Emotional Screening System in a rural elementary school: Validity of the BESS. Journal of Psychoeducational Assessment, 30, 527-538. doi:10.1177/0734282912440673

26.

Levitt

Mass

Noa

Romanelli

Hoagwood

(2007). Early identification of mental health problems in schools: The status of instrumentation. Journal of School Psychology, 45, 163-191. doi:10.1016/j.jsp.2006.11.005

27.

Leys

Ley

Klein

Bernard

Licata

(2013). Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49, 764-766. doi:10.1016/j.jesp.2013.03.013

28.

Masten

Roisman

Long

Burt

Obradovic

Riley

. . . Tellegen

(2005). Developmental cascades: Linking academic achievement and externalizing and internalizing symptoms over 20 years. Developmental Psychology, 41, 733-746.

29.

McDonald

R. P.

(1999). Test theory: A unified approach. Mahwah, NJ: Lawrence Erlbaum.

30.

McIntosh

Frank

Spaulding

(2010). Establishing research-based trajectories of office discipline referrals for individual students. School Psychology Review, 39, 380-394.

31.

Merrell

Tymms

(2001). Inattention, hyperactivity and impulsiveness: Their impact on academic achievement and progress. British Journal of Educational Psychology, 71, 43-56. doi:10.1348/000709901158389

32.

Miller

Jome

(2008). School psychologists and the assessment of childhood internalizing disorders. School Psychology International, 29, 500-510.

33.

Murray

A. L.

Johnson

(2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41, 407-422. doi:10.1016/j.intell.2013.06.004

34.

Murray

K. M.

Waas

G. A.

(2008). Child and teacher reports of teacher-student relationships: Concordance of perspectives and associations with school adjustment in urban kindergarten classrooms. Journal of Applied Developmental Psychology, 29, 49-61. doi:10.1016/j.appdev.2007.10.006

35.

New Orleans Parents Guide. (2015). Available from http://neworleansparentsguide.org/

36.

Niditch

Varela

(2011). Mother-child disagreement in reports of child anxiety: Effects of child age and maternal anxiety. Journal of Anxiety Disorders, 25, 450-455.

37.

Perfect

Morris

(2011). Delivering school-based mental health services by school psychologists: Education, training, and ethical issues. Psychology in the Schools, 48, 1049-1063. doi:10.1002/pits.20612

38.

Peters

C. D.

Kranzler

J. H.

Algina

Smith

S. W.

Daunic

A. P.

(2014). Understanding disproportionate representation in special education by examining group differences in behavior ratings. Psychology in the Schools, 51, 452-465. doi:10.1002/pits.21761

39.

Raftery

A. E.

(1995). Bayesian model selection in social research. Sociological Methodology, 25, 111-163.

40.

Raines

Dever

Kamphaus

Roach

(2012). Universal screening for behavioral and emotional risk: A promising method for reducing disproportionate placement in special education. The Journal of Negro Education, 81, 283-296.

41.

Reise

S. P.

Moore

T. M.

Haviland

M. G.

(2010). Bifactor Models and Rotations: Exploring the Extent to Which Multidimensional Data Yield Univocal Scale Scores. Journal of Personality Assessment, 92(6), 544-559. doi:10.1080/00223891.2010.496477

42.

Reise

Morizot

Hays

(2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16, 19-31.

43.

Reynolds

C. R.

Kamphaus

R. W.

(2004). Behavior Assessment System for Children–Second Edition (BASC-2). Circle Pines, MN: Pearson.

44.

Rodriguez

Reise

S. P.

Haviland

M. G.

(2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21, 137-150. doi:10.1037/met0000045

45.

Sbarra

D. A.

Pianta

R. C.

(2001). Teacher ratings of behavior among African American and Caucasian children during the first two years of school. Psychology in the Schools, 38, 229-238.

46.

Smith

G. T.

McCarthy

D. M.

Anderson

K. G.

(2000). On the sins of short-form development. Psychological Assessment, 12, 102-111. doi:10.1037/1040-3590.12.1.102

47.

Steiger

J. H.

(1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245-251.

48.

Sugai

Horner

(2002). The evolution of discipline practices: School-wide positive behavior supports. Child & Family Behavior Therapy, 24, 23-50.

49.

Townsend

B. L.

(2000). The disproportionate discipline of African American learners: Reducing school suspensions and expulsions. Exceptional Children, 66, 381-391.

50.

Vannest

(2012, Winter). Implementing interventions and progress monitoring subsequent to universal screening. School Psychology Forum, 6, 119-136.

51.

Walker

Severson

Seeley

(2008). Universal, school-based screening for the early detection of behavioral problems contributing to later destructive outcomes. In Shinn

Walker

(Eds.), Interventions for achievement and behavior problems in a three-tier model including response to intervention (pp. 677-702). Silver Spring, MD: National Association of School Psychologists.

52.

Watkins

M. W.

(2013). Omega [Computer software]. Phoenix, AZ: Ed & Psych Associates.

53.

The White House. (2013). President Obama applauds commitments to raise awareness and increase understanding of mental health at White House conference (Office of the Secretary). Retrieved from https://www.whitehouse.gov/the-press-office/2013/06/03/fact-sheet-president-obama-applauds-commitments-raise-awareness-and-incr

54.

Wiesner

Schanding

(2013). Exploratory structural equation modeling, bifactor models, and standard confirmatory factor analysis models: Application to the BASC-2 Behavioral and Emotional Screening System Teacher Form. Journal of School Psychology, 51, 751-763.

55.

Youngstrom

Loeber

Stouthamer-Loeber

(2000). Patterns and correlates of agreement between parent, teacher, and male adolescent ratings of externalizing and internalizing problems. Journal of Consulting and Clinical Psychology, 68, 1038-1050. doi:10.1037/0022-006X.68.6.1038

56.

Ysseldyke

J. E.

Algozzine

(1982). Critical issues in special and remedial education. Boston, MA: Houghton Mifflin.