This study provides preliminary evidence for reliability and validity of the Hawaii Early Learning Profile Strands 0-3 (HELP Strands 0-3), an assessment instrument for young children. First, the degree of interobserver agreement for a sample of representative HELP items was examined; results indicated that HELP scoring was dependable and consistent across 82 providers. Second, content validity was evaluated by having 12 early childhood experts align HELP items with their related strands (i.e., specific developmental areas) and rank the developmental order of items within each strand. The experts agreed with the HELP item-to-strand alignment and with the developmental order of items. Finally, convergent and discriminant validity evidence was provided by correlating HELP domain scores with Battelle Developmental Inventory–Second Edition (BDI-2) domain scores. Evidence for convergent validity was found between similar domains; discriminant validity was evidenced by low correlations between unrelated domains of HELP and BDI-2.
AlwinD. F. (2007). Margins of error: A study of reliability in survey measurement (Vol. 547). Hoboken, NJ: John Wiley.
2.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3.
BagnatoS. J.MurphyJ. P. (1989). Validity of curriculum-based scales with young neurodevelopmentally disabled children: Implications for team assessment. Early Education and Development, 1, 50-63. doi:10.1207/s15566935eed0101_5
4.
BagnatoS. J.NeisworthJ. T.Pretty-FrontczakK. (2010). LINKing authentic assessment and early childhood intervention: Best measures for best practices (2nd ed.). Baltimore, MD: Paul H. Brookes.
5.
BayleyN. (1969). Bayley Scales of Infant Development. San Antonio, TX: Psychological Corporation.
6.
BayleyN. (2005). Bayley Scales of Infant and Toddler Development–Third Edition (Bayley-III). San Antonio, TX: Harcourt Assessment.
7.
BlissS. L. (2007). Test Reviews: Newborg, J. (2005). Battelle Developmental Inventory−Second Edition. Itasca, IL: Riverside. Journal of Psychoeducational Assessment, 25, 409-415.
8.
CampbellD. T.FiskeD. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
9.
CohenJ. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46. doi:10.1177/001316446002000104
EmamK. E. (1999). Benchmarking kappa: Interrater agreement in software process assessments. Empirical Software Engineering, 2, 113-133. doi:10.1023/A:1009820201126
12.
FaulF.ErdfelderE.LangA. G.BuchnerA. G. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavioral Research Methods, 39, 175-191. doi:10.3758/BF03193146
13.
FleissJ. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378-382. doi:10.1037/h0031619
14.
FurunoS.O’ReillyK.HosakaC. M.InatsukaT.Zeisloft-DalbeyB. (2014). HELP® Checklist. Palo Alto, CA: VORT Corporation. (Original work published 1985)
15.
HeromanC.BurtsD. C.BerkeK.-L.BickartT. S. (2010). GOLD®: Objectives for development & learning. Baltimore, MD: Paul H. Brookes.
16.
Individuals with Disabilities Education Improvement Act, H.R. 1350, 108th Congress (2004).
17.
JosephG. E.McCutchenD. (2013). Inter-rater reliability and concurrent validity study of the Washington Kindergarten Inventory of Developing Skills (WaKIDS). Center for Research and Professional Development, University of Washington. Retrieved from https://depts.washington.edu/cqel/PDFs/CQELReports/WaKIDS_Report072613.pdf
18.
KinderCharts®. (2016). Management reporting system for the HELP Strands 0-3. Available from http://www.kindercharts.net/
19.
KnoblochH.StevensF.MaloneA. F. (1980). The Gesell developmental schedules–Revised manual of developmental diagnosis. New York, NY: Harper & Row.
20.
LambertR. G.KimD.-H.BurtsD. C. (2013). Technical manual for the Teaching Strategies GOLD® assessment system. Charlotte: Center for Educational Measurement and Evaluation, University of North Carolina.
21.
MacyM. G.BrickerD. D.SquiresJ. K. (2005). Validity and reliability of a curriculum-based assessment approach to determine eligibility for part C services. Journal of Early Intervention, 28(1), 1-16.
22.
MarshH. M. (1982). Validity of students’ evaluations of college teaching: A multitrait-multimethod analysis. Journal of Educational Psychology, 74, 264-279.
23.
McMillanJ.SchumacherS. (2001). Research in education (5th ed.). New York, NY: Longman.
PeabodyJ. W.LuckJ.GlassmanP.DresselhausT. R.LeeM. (2000). Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality. Journal of the American Medical Association, 283, 1715-1722. doi:10.1001/jama.283.13.1715
28.
WatkinsM. W.PachecoM. (2001). Interobserver agreement in behavioral research: Importance and calculation. Journal of Behavioral Education, 10, 205-212.
