Sixty-three Woodcock–Johnson IV Tests of Achievement protocols, administered by 26 school psychology trainees, were examined to determine the frequency of examiner errors. Errors were noted on all protocols and ranged from 8 to 150 per administration. Critical (e.g., start, stop, and calculation) errors were noted on roughly 97% of protocols. Wilcoxon signed-rank tests indicated multiple subtests were more prone to both critical and non-critical (e.g., failure to record answers verbatim, failure to record qualitative observations) errors; critical errors were generally more common on subtests with objective scoring criteria (i.e., Written Expression and Spelling) and non-critical errors were more frequently observed on subtests that required the recording of answers verbatim. Based on these findings, we encourage trainers to place increased scrutiny on trainee’s objective scoring performance and on requiring recording responses verbatim. Areas of needed future research studies are also discussed.
BelkM. S.LobelloG.RayG. E.ZacharP. (2002). WISC-III administration, clerical, and scoring errors made by student examiners. Journal of Psychoeducational Assessment, 20(3), 290–300. https://doi.org/10.1177%2F073428290202000305
3.
BenjaminiY.YekutieliD. (2001). The control of the false discovery rate in multiple testing under dependency. Annals of Statistics, 29(4), 1165–1188. https://www.jstor.org/stable/2674075
4.
BensonN. F.FloydR. G.KranzlerJ. H.EckertT. L.FeferS. A.MorganG. B. (2019). Test use and assessment practices of school psychologists in the United States: Findings from the 2017 National Survey. Journal of School Psychology, 72, 29–48. https://doi.org/10.1016/j.jsp.2018.12.004
5.
BensonN. F.MakiK. E.FloydR. G.EckertT. L.KranzlerJ. H.FeferS. A. (2020). A national survey of school psychologists’ practices in identifying specific learning Disabilities. School Psychology, 35(2), 146–157. https/doi:10.1037/spq0000344
6.
BreauxK. C.LichtenbergerE. O. (2016). Essentials of KTEA-3 and WIAT-III assessment. John Wiley & Sons.
FlanaganD. P.AlfonsoV. C. (2017). Essentials of WISC-V assessment. John Wiley & Sons.
9.
HarrisonG. L.GoeganL. D.MacounS. J. (2019). Common examiner scoring errors on academic achievement measures. Canadian Journal of School Psychology, 34(2), 98–112. https://doi.org/10.1177/0829573518763484
10.
HigginsE.RaskindM.GoldbergR.HermanK. (2002). Stages of acceptance of a learning disability: The impact of labeling. Learning Disability Quarterly, 25(1), 3–18. https://doi.org/10.2307%2F1511187
11.
Individuals with Disabilities Education Improvement Act (IDEA). (2004). Individuals with Disabilities Education Improvement Act (IDEA) of 2004, Pub. L. No. 108-446,1118Stat. 2647; 2004 enacted H. R. 1350; 108 Enacted H. R. 1350. Final Regulations Implementing IDEA 2004 Were Published in the Federal Register, Monday, August 14, 2006, pp. 46540-46845.
12.
KaufmanA. S.KaufmanN. L. (2014). Kaufman test of educational achievement (3rd ed.). Pearson.
13.
LoBelloS. G.HolleyG. (1999). WPPSI-R administration, clerical, and scoring errors by student examiners. Journal of Psychoeducational Assessment, 17(1), 15–23. https://doi.org/10.1177/073428299901700102
14.
LockwoodA.BensonN.FarmerR.KlatkaK. (2022). Test use and assessment practices of school psychology training programs: Findings from a 2020 survey of U.S. faculty. Psychology in the schools, 59(4), 1–28. https://doi.org/10.1002/pits.22639
15.
LockwoodA.FarmerR.BohanK.WinansS.SealanderK. (2021). Academic achievement test use and assessment practices: A national survey of special education administrators. Journal of Psychoeducational Assessment, 39(4), 436–451. https://doi.org/10.1177%2F0734282920984290
16.
LockwoodA.FarmerR.WinansS.SealanderK. (2021). Specific learning disability identification practices in the U.S.A: A survey of special education administrators. Contemporary School Psychology. Advance online publication. https://doi.org/10.1007/s40688-021-00375-4
17.
LockwoodA. B.FarmerR. L. (2020). The cognitive assessment course: Two decades later. Psychology in the Schools, 57(2), 265–283. https://doi.org/10.1002/pits.22298
18.
LockwoodA. B.SealanderK.GrossT. J.LantermanC. (2020). Teacher trainees’ administration and scoring errors on the Kaufman test of educational achievement. Journal of Psychoeducational Assessment, 38(5), 551–563. https://doi.org/10.1177/0734282919871144
19.
LoeS. A. (2014). Examiner errors on the Reynolds Intellectual Assessment Scales committed by graduate student examiners. Psychology in the Schools, 51(1), 97–106. https://doi.org/10.1002/pits.21738
20.
LoeS. A.KadlubekR. M.MarksW. J. (2007). Administration and scoring errors on the WISC-IV among graduate student examiners. Journal of Psychoeducational Assessment, 23(3), 237–247. https://psycnet.apa.org/doi/10.1177/0734282906296505
21.
LosenD. J.WelnerK. G. (2001). Disabling discrimination in our public schools: Comprehensive legal challenges to inappropriate and inadequate special education services for minority children. Harvard Civil Rights-Civil Liberties Law Review, 36(2), 407–460.
22.
MakiK. E.AdamsS. R. (2018). A current landscape of specific learning disability identification: Training, practices, and implications. Psychology in the Schools, 56(1), 18–31. https://doi.org/10.1002/pits.22179
23.
MatherN.WendlingB.J. (2014). Examiner’s manual. Woodcock–Johnson IV tests of academic achievement. Riverside Publishing.
24.
MrazikM.JanzenT. M.DombrowskiS. C.BarfordS. W.KrawchukL. L. (2012). Administration and scoring errors of graduate students learning the WISC-IV: Issues and controversies. Canadian Journal of School Psychology, 27(4), 279–290. https://doi.org/10.1177/0829573512454106
25.
OakE.ViezelK. D.DumontR.WillisJ. (2019). Wechsler administration and scoring errors made by graduate students and school psychologists. Journal of Psychoeducational Assessment, 37(6), 679–691. https://doi.org/10.1177/0734282918786355
26.
RamosE.AlfonsoV. C.SchermerhornS. M. (2009). Graduate students’ administration and scoring errors on the woodcock-Johnson III tests of cognitive abilities. Psychology in the Schools, 46(7), 650–657. https://doi.org/10.1002/pits.20405
27.
SchrankF. A.MatherN.McGrewK. S. (2014). Woodcock-Johnson IV tests of achievement. Riverside.
28.
SherretsS.GardG.LangnerH. (1979). Frequency of clerical errors on WISC protocols. Psychology in the Schools, 16(4), 495–496.
29.
SlateJ. R.JonesC. H.MurrayR. A. (1991). Teaching administration and scoring of the Wechsler Adult Intelligence Scale-Revised: An empirical evaluation of practice administration. Professional Psychology: Research and Practice, 22(5), 375–379. https://doi.org/10.1037/0735-7028.22.5.375
30.
SlateJ. R.JonesC. H.MurrayR. A.CoulterC. (1993). Evidence that practitioners err in administering and scoring the WAIS—R. Measurement and Evaluation in Counseling and Development, 25(4), 156–161.
31.
StyckK. M.WalshS. M. (2016). Evaluating the prevalence and impact of examiner errors on the wechsler scales of intelligence: A meta-analysis. Psychological Assessment, 28(1), 3–17. https://10.1037/pas0000157
32.
WaughK. C.GronlundN. E. (2013). Assessment of student achievement (10th ed.). Allyn & Bacon Publishing.
33.
WechslerD. (2009). Wechsler Individual Achievement Test (3rd ed.). Pearson.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
