Alternate assessments are the means through which students with significant cognitive disabilities participate in accountability testing, thus measurement validity of alternate assessments is a critical aspect of state educational accountability systems. When evaluating the validity of assessment systems, it is important to take a broad view of validity that acknowledges its many facets. Evidence regarding six aspects of validity of Utah's Alternate Assessment (UAA) is presented in this paper. These six aspects are: (a) test content, (b) performance standards, (c) administration of the test, (d) reliability of scoring, (e) stability of scores, and (f) impact of use of UAA. Results of the validity study conducted on UAA are presented along with recommendations for improving the system based on these results.
Get full access to this article
View all access options for this article.
References
1.
American Psychological AssociationTechnical recommendations for psychological tests and diagnostic techniquesPsychological Bulletin51201–2381954
2.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education.Standards for educational and psychological testingAmerican Psychological AssociationWashington, DC1999Standards for educational and psychological testing
3.
BrownL.NietupskiJ.Hamre-NietupskiS.ThomasM. A.Criterion of ultimate functioningHey, don't forget about me!: Education's investment in the severely, profoundly, and multiply handicappedThe Council for Exceptional ChildrenReston, VA2–151976
4.
BurgessP.KennedyS.University of KentuckyWhat gets tested, gets taught; who gets tested, gets taught: Curriculum framework development process. Lexington: Mid-South Regional Resource Centerhttp://www.ihdi.uky.edu/MSRRC/Publications/whatgets.htm1998. March 15, 2005
5.
CrooksT. J.KaneM. T.CohenA. S.Threats to the valid use of assessmentsAssessment in Education3265–2851996
6.
Individuals with Disabilities Education Act Amendments of 1997, 20 U.S.C. 1400. et seq.
7.
Individuals with Disabilities Education Improvement Act of 2004, P.L. 108-446, 20 U.S.C. $ 1400 et seq.
8.
JohnsonE.ArnoldN.Validating and alternate assessmentRemedial and Special Education25266–2752004
9.
KaneM. T.An argument-based approach to validityPsychological Bulletin112527–5351992
10.
KleinertH. L.GarrettB.TowlesE.GarrettM.Nowak-DrabikK.WaddellC.Alternate assessment scores and life outcomes for students with significant disabilities: Are they related? Assessment for Effective Intervention2819–302002
11.
KleinertH. L.KearnsJ. F.A validation study of the performance indicators and learner outcomes of Kentucky's alternate assessment for students with significant disabilitiesJournal of the Association for Persons with Severe Handicaps24100–1101999
12.
KleinertH. L.KennedyS.KearnsJ. F.The impact of alternate assessments: A statewide teacher surveyJournal of Special Education3393–1021999
13.
MessickS.LinnR. L.ValidityEducational measurementAmerican Council on Education and MacmillanNew York13–1031993rd ed.
14.
MessickS.Standards of validity and the validity of standards in performance assessment145–81995
15.
MessickS.Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaningAmerican Psychologist50741–7491995
16.
No Child Left Behind Act of 2001, 20 U.S.C. 6301 et seq.2002
17.
ShepardL. A.Darling-HammondL.Evaluating test validityReview of research in educationAmerican Educational Research AssociationWashington, DC19405–4501993
18.
SpoonerF.TestD. W. E. C. Cipani & F. Spooner Curricular and instructional approaches for persons with severe disabilitiesAllyn & BaconNeedham Heights, MA149–1831994Domestic and community living skills
19.
StokesT. F.BaerD. M.An implicit technology of generalizationJournal of Applied Behavior Analysis10349–3671977
20.
ThompsonS. J.ThurlowM. L.JohnstoneC. J.AltmanJ. R.MN: University of Minnesota2005 State special education outcomes: Steps forward in a decade of change. Minneapolis06 - 25-06National Center on Educational Outcomeshttp://education.umn.edu/NCEO/OnlinePubs/20052005
21.
StatereportTindalG.McdonaldM.TedescoM.GlasgowA.AlmondP.CrasfordL.HollenbeckK.Alternate assessments in reading and math: development and validation for students with significant disabilitiesExceptional Children69481–4942003
22.
Title I -Improving the Academic Achievement of the Disadvantaged; Final Rule. 68 FedReg68697December 9,2003
23.
TurnerM. D.BaldwinL.KleinertH. L.KearnsJ. F.The relationship of a statewide alternate assessment for students with severe disabilities to other measures of instructional effectivenessJournal of Special Education3469–762000
24.
WehmanP. P. Wehman & J. Kregel Functional curriculum for elementary, middle, and secondary age students with special needsPro-EdAustin, TX1–181997Curriculum design
25.
YsseldykeJ.OlsenK.Putting alternate assessments into practice: What to measure and possible sources of dataExceptional Children65175–1851999
