Administration and Scoring Errors on the Woodcock–Johnson IV Tests of Achievement: Before and During COVID-19

Abstract

Eighty Woodcock–Johnson IV Tests of Achievement protocols from 40 test administrators were examined to determine the types and frequencies of administration and scoring errors made. Non-critical errors (e.g., failure to record verbatim) were found on every protocol (M = 37.2). Critical (e.g., standard score, start point) errors were found on 98.8% of protocols (M = 15.3). Additionally, a series of paired samples t-test were conducted to determine differences in total, critical, and non-critical errors pre- and during-COVID-19. No statistic differences were found. Our findings add to a growing body of research that suggests that errors on norm-referenced tests of achievement are pervasive. However, the frequency of errors did not appear to be affected by COVID-19 stressors or social distancing requirements. Implications of these findings for training and practice are discussed. Suggestions for future research are also provided.

Keywords

achievement tests COVID-19 Woodcock–Johnson errors norm-referenced assessment

Get full access to this article

View all access options for this article.

References

Alfonso

V. C.

Johnson

Patinella

Rader

D. E.

(1998). Common WISC-III examiner errors: Evidence from graduate students in training. Psychology in the Schools, 35(2), 119–125. https://doi.org/10.1002/(sici)1520-6807(199804)

Benson

N. F.

Floyd

R. G.

Kranzler

J. H.

Eckert

T. L.

Fefer

S. A.

Morgan

G. B.

(2019). Test use and assessment practices of school psychologists in the United States: Findings from the 2017 national survey. Journal of School Psychology, 72, 29–48. https/doi.org/10.1016/j.jsp.2018.12.004

Breaux

K. C.

Lichtenberger

E. O.

(2016). Essentials of KTEA-3 and WIAT-III assessment. John Wiley & Sons

Education Week (2020). Map: Coronavirus and school closures. https://www.edweek.org/ew/section/multimedia/map-coronavirus-and-school-closures.html

Farmer

R. L.

McGill

R. J.

Dombrowski

S. C.

McClain

M. B.

Harris

Lockwood

A. B.

Powell

S. L.

Pynn

Smith-Kellen

Loethen

Benson

N. F.

Stinnett

T. A.

(2020). Teleassessment with children and adolescents during the coronavirus (COVID-19) pandemic and beyond: Practice and policy implications. Professional Psychology: Research and Practice, 51(5), 477–487. https://doi.org/10.1037/pro0000349

Field

(2018). Discovering statistics using IBM SPSS statistics. Sage.

Harrison

G. L.

Goegan

L. D.

Macoun

S. J.

(2019). Common examiner scoring errors on academic achievement measures. Canadian Journal of School Psychology, 34(2), 98–112. https://doi.org/10.1177/0829573518763484

Jenkins

J. R.

Hudson

R. F.

Johnson

E. S.

(2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review, 36(4), 582–600. https://doi.org/10.1080/02796015.2007.12087919

Kauffman

J. M.

Nelson

C. M.

Simpson

R. L.

Ward

D. M.

(2017). Contemporary issues. In Kauffman

J. M.

Callahan

D. P.

Pullen

P. C.

(Eds.), Handbook of special education (pp. 16–28). Routledge.

10.

Kaufman

A. S.

Kaufman

N. L.

(2014). Kaufman test of educational achievement (3rd ed.). Pearson.

11.

Lobello

S. G.

Holley

(1999). WPPSI-R administration, clerical, and scoring errors by student examiners. Journal of Psychoeducational Assessment, 17(1), 15–23. https://doi.org/10.1177/073428299901700102

12.

Lockwood

Farmer

Winans

Sealander

(2021). Specific learning disability identification practices in the U.S.A: A survey of special education administrators. Contemporary School Psychology, 26, 535–544. https://doi.org/10.1007/s40688-021-00375-4

13.

Lockwood

A. B.

Farmer

R. L.

Bohan

K. J.

Winans

Sealander

(2021). Academic achievement test use and assessment practices: A national survey of special education administrators. Journal of Psychoeducational Assessment, 39(4), 436–451. https://doi.org/10.1177/0734282920984290

14.

Lockwood

A. B.

Farmer

R. L.

Schmitt

Sealander

Lanterman

Adkins

(2022). The course on norm-referenced academic assessment: A survey of special education faculty. Psychology in the Schools, 59(2), 398–412. https://doi.org/10.1002/pits.22616

15.

Lockwood

A. B.

Klatka

Freeman

Farmer

R. L.

Benson

(2023). School psychology trainees’ administration and scoring errors on The Woodcock Johnson IV Tests of Achievement. Journal of Psychoeducational Assessment, 41(1), 36–48. https://doi.org/10.1177/07342829221124355

16.

Lockwood

A. B.

Sealander

Gross

T. J.

Lanterman

(2020). Teacher trainees’ administration and scoring errors on the Kaufman test of educational achievement. Journal of Psychoeducational Assessment, 38(5), 551–563. https://doi.org/10.1177/0734282919871144

17.

Loe

S. A.

(2014). Examiner errors on the Reynolds Intellectual Assessment Scales committed by graduate student examiners. Psychology in the Schools, 51(1), 97–106. https://doi.org/10.1002/pits.21738

18.

Maki

K. E.

Floyd

R. G.

Roberson

(2015). State learning disability eligibility criteria: A comprehensive review. School Psychology Quarterly: The Official Journal of the Division of School Psychology, American Psychological Association, 30(4), 457–469. https://doi.org/10.1037/spq0000109

19.

Morgan

P. L.

Frisco

M. L.

Farkas

Hibel

(2010). A propensity score matching analysis of the effects of special education services. The Journal of Special Education, 43(4), 236–254. https://doi.org/10.1177/0022466908323007

20.

Mrazik

Janzen

T. M.

Dombrowski

S. C.

Barford

S. W.

Krawchuk

L. L.

(2012). Administration and scoring errors of graduate students learning the WISC-IV: Issues and controversies. Canadian Journal of School Psychology, 27(4), 279–290. https://doi.org/10.1177/0829573512454106

21.

National Center for Education Statistics . (2019). Education demographic and geographic estimates. https://nces.ed.gov/Programs/Edge/ACSDashboard/

22.

National Center for Education Statistics . (2021, July 28). The condition of education: Students w/disabilities. https://nces.ed.gov/programs/coe/indicator_cgg.asp

23.

Oak

Viezel

K. D.

Dumont

Willis

(2019). Wechsler administration and scoring errors made by graduate students and school psychologists. Journal of Psychoeducational Assessment, 37(6), 679–691. https://doi.org/10.1177/0734282918786355

24.

Schrank

F. A.

Mather

McGrew

K. S.

(2014). Woodcock-Johnson IV tests of achievement. Riverside.

25.

Sherrets

Gard

Langner

(1979). Frequency of clerical errors on WISC protocols. Psychology in the Schools, 16(4), 495–496. https://doi.org/10.1002/1520-6807(197910)

26.

Slate

J. R.

Jones

C. H.

Murray

R. A.

(1991). Teaching administration and scoring of the Wechsler Adult Intelligence Scale—Revised: An empirical evaluation of practice administrations. Professional Psychology: Research and Practice, 22(5), 375–379. https://doi.org/10.1037/0735-7028.22.5.375

27.

Slate

J. R.

Jones

C. H.

Murray

R. A.

Coulter

(1993). Evidence that practitioners err in administering and scoring the WAIS—R. Measurement and Evaluation in Counseling and Development, 25(4), 156–161.

28.

Styck

K. M.

Walsh

S. M.

(2016). Evaluating the prevalence and impact of examiner errors on the Wechsler scales of intelligence: A meta-analysis. Psychological Assessment, 28(1), 3–17. https://10.1037/pas0000157

29.

Torgesen

J. K.

(2002). Empirical and theoretical support for direct diagnosis of learning disabilities by assessment of intrinsic processing weaknesses. In Bradley

Danielson

Hallahan

D. P.

(Eds.), Identification of learning disabilities: Research to practice (pp. 565–613). Erlbaum.

30.

Wechsler

(2009). Wechsler individual achievement test (3rd ed.). Pearson.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.31 MB