In order to make assessments as widely accessible as possible, including to young learners from diverse backgrounds with a wide range of individual needs and characteristics, some developers of standardized tests have resorted to offering accessibility tools (e.g., magnifying/zoom) and accommodations (e.g., extended response time) to test takers. These solutions have some limitations stemming from the fact that they are retroactively applied to tests. One possible avenue to meet the accessibility needs of diverse students is to proactively address accessibility in the development of test content for all learners. In this article, we report on the development and piloting of a systematic accessibility review process intended for all test content at an organization producing large-scale standardized English proficiency tests for elementary and secondary education students in the United States. We describe the theoretical and research foundations related to fairness, accessibility, and universal design that guided our development of the accessibility review process followed by the process used to develop the tool. The application of the accessibility checklist to a kindergarten English language proficiency assessment is described in detail. Finally, we share some considerations for how the accessibility checklist could be used in other assessment development contexts.
AgrawalJ.BarrioB. L.KresslerB.HsiaoY.-J.ShanklandR. K. (2019). International policies, identification, and services for students with learning disabilities: An exploration across 10 countries. Learning Disabilities: A Contemporary Journal, 17(1), 95–114. https://files.eric.ed.gov/fulltext/EJ1218057.pdf
2.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Psychological Association.
Christensen, L.Shyyan, V.CuéllarD.MitchellJ. D.TaylorD. M.Rhoad-DrogalisA.HoM. (forthcoming). Assessing English learners with disabilities: A glossary of terms. University of Wisconsin–Madison, Wisconsin Center for Education Research, Advancing Alternate English Language Learning Assessment project: https://advancingaltella.org/resources/
7.
ChristensenL.ShyyanV.JohnstoneC. (2014). Universal design considerations for technology-based, large-scale, next-generation assessments. Perspectives on Language and Literacy, 40(1), 23–31. https://app.box.com/s/m1wnd1m0svl9l0bz0op4
ELPA21. (2022). Accessibility and accommodations manual. Regents of the University of California.
10.
EvansD.HumphreysS.GrayG. (2015). Australian National Curriculum: Applications of the principles of UDL. In GardnerJ. E.HardinD. (Eds.), Implementing universal design for learning (pp. 3–5). The Universal Design for Learning Implementation and Research Network. https://jas3703.files.wordpress.com/2015/12/fc411-proceedings15.pdf
11.
HannaE. I. (2004). Inclusive design for maximum accessibility: A practical approach to universal design (PEM Research Report 05-04). Pearson Educational Measurement.
12.
JohnstoneC. J.Bottsford-MillerN. A.ThompsonS. J. (2006). Using the think aloud method (cognitive labs) to evaluate test design for students with disabilities and English language learners (Technical Report 44). National Center on Educational Outcomes. https://files.eric.ed.gov/fulltext/ED495909.pdf
13.
KimA. A.ChapmanM.KondoA.WilmesC. (2020). Examining the assessment literacy required for interpreting score reports: A focus on educators of K–12 English learners. Language Testing, 37(1), 54–75. https://doi.org/10.1177/0265532219859881
14.
KoprivaR. (2001, June22–23). ELL validity research designs for state academic assessments: An outline of five research designs evaluating the validity of large-scale assessments for English language learners and other test takers. Paper prepared at the Council of Chief State School Officers Meeting, Houston, TX, United States.
15.
KritzerJ. B. (2011). Special education in China. Eastern Education Journal, 40(1), 57–63.
16.
LazarusS. S.JohnstoneC. J.LiuK. K.ThurlowM. L.HinkleA. R.BurdenK. (2022). An updated state guide to universally designed assessments (NCEO Report 431). National Center on Educational Outcomes. https://nceo.umn.edu/docs/OnlinePubs/NCEOReport431.pdf
17.
LuJ.JiangH.HuangY. (2002). Inclusive EFL teaching for young students with special needs: A case in China. Children, 9, 749. https://doi.org/10.3390/children9050749
McKenzieJ. A.DaltonE. M. (2020). Universal design for learning in inclusive education policy in South Africa. African Journal of Disability, 9, a776. https://doi.org/10.4102/ajod.v9i0.776
Smarter Balanced. (2022). Bias and sensitivity guidelines. University of California, Santa Cruz.
24.
StoryM. F.MuellerJ. L.MaceR. L. (1998). The universal design file: Designing for people of all ages and abilities. The Center for Universal Design. https://files.eric.ed.gov/fulltext/ED460554.pdf
25.
TaylorL.ChenN. (2016). Assessing students with learning and other disabilities/special needs. In TsagariD.BanerjeeJ. (Eds.), Handbook of second language assessment (pp. 377–396). De Gruyter Mouton. https://doi.org/10.1515/9781614513827-025
26.
ThompsonS. J.JohnstoneC. J.ThurlowM. L. (2002). Universal design applied to large scale assessments (Synthesis Report 44). National Center on Educational Outcomes. https://www.cehd.umn.edu/NCEO/OnlinePubs/Synth44.pdf
ThurlowM. L.LazarusS. S.ChristensenL. L.ShyyanV. (2016). Principles and characteristics of inclusive assessment systems in a changing assessment landscape (NCEO Report 400). National Center on Educational Outcomes. https://nceo.umn.edu/docs/OnlinePubs/Report400/NCEOReport400.pdf
29.
ThurlowM. L.LiuK. K.WardJ. M.ChristensenL. (2013). Assessment principles and guidelines for ELLs with disabilities. Improving the Validity of Assessment Results for English Language Learners with Disabilities (IVARED). https://files.eric.ed.gov/fulltext/ED609832.pdf
WIDA. (2022). ACCESS for ELLs interpretive guide for score reports: Grades K–12 Spring 2022. Board of Regents of the University of Wisconsin System.
36.
ZiekyM. (2006). Fairness review in assessment. In DowningS. M.HaladynaT. M. (Eds.), Handbook of test development (1st ed., pp. 359–376). Lawrence Erlbaum Associates.
