Norm Block Sample Sizes

Abstract

The representativeness, recency, and size of norm samples strongly influence the accuracy of inferences drawn from their scores. Inadequate norm samples may lead to inflated or deflated scores for individuals and poorer prediction of developmental and academic outcomes. The purpose of this study was to apply Kranzler and Floyd’s method for estimating norm block sample sizes via a review of the most prominent, individually administered intelligence tests. A rigorous, double-coding process was used to obtain these estimated sample sizes for 17 intelligence tests (10 full-length multidimensional tests, 4 nonverbal intelligence tests, and 3 brief intelligence tests). Overall, 47% of the tests failed to meet the minimum standard of at least 30 participants per norm block across age groups, and estimated norm block sizes were smallest for elementary school–age children. These results can inform intelligence test selection by practitioners and researchers, and they should be considered by test publishers when developing, revising, and reporting information about their tests.

Keywords

intelligence psychometrics normative samples test development

Get full access to this article

View all access options for this article.

References

Aiken

L. R.

(2000). Psychological testing and assessment (10th ed.). New York, NY: John Wiley.

Alfonso

V. C.

Flanagan

D. P.

(2008). Assessment of preschool children: A framework for evaluating the adequacy of the technical characteristics of norm-referenced instruments. In Mowder

Rubinson

Yasik

(Eds.), Evidence based practice in infant and early childhood psychology (pp. 129-166). New York, NY: John Wiley.

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

Anastasi

Urbina

(1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall.

Bracken

B. A.

McCallum

R. S.

(1998). Universal Nonverbal Intelligence Test. Chicago, IL: Riverside.

Cohen

R. J.

Swerdlik

M. E.

Smith

D. K.

(2012). Psychological testing and assessment: An introduction to tests and measurement (8th ed.). New York, NY: McGraw-Hill.

Elliott

C. D.

(2007). Differential Ability Scales–Second Edition. San Antonio, TX: Harcourt Assessment.

Flanagan

D. P.

Ortiz

S. O.

Alfonso

V. C.

Mascolo

J. T.

(2002). The achievement test desk reference (ATDR): Comprehensive assessment and learning disabilities. Boston, MA: Allyn & Bacon.

Glutting

J. J.

Adams

Sheslow

(2000). Wide Range Intelligence Test. Wilmington, DE: Wide Range.

10.

Hammill

D. D.

Brown

Bryant

B. R.

(1992). A consumer’s guide to test in print (2nd ed.). Austin, TX: Pro-Ed.

11.

Kaufman

A. S.

Kaufman

N. L.

(2004a). Kaufman Assessment Battery for Children, Second Edition. Circle Pines, MN: American Guidance Service.

12.

Kaufman

A. S.

Kaufman

N. L.

(2004b). Kaufman Brief Intelligence Test, Second Edition. Circle Pines, MN: American Guidance Service.

13.

Kranzler

J. H.

Floyd

R. G.

(2013). Assessing intelligence in children and adolescents: A practical guide. New York, NY: Guilford Press.

14.

Lichtenberg

J. W.

Goodyear

R. K.

(Eds.). (1999). Scientist–practitioner perspectives on test interpretation. Boston, MA: Allyn & Bacon.

15.

Naglieri

J. A.

Das

J. P.

(1997). Cognitive Assessment System. Itasca, IL: Riverside.

16.

Naglieri

J. A.

Das

J. P.

Goldstein

(2014). Cognitive Assessment System, Second Edition. Austin, TX: Pro-Ed.

17.

Reynolds

C. R.

Kamphaus

R. W.

(2003). Reynolds Intellectual Assessment Scales. Lutz, FL: Psychological Assessment Resources.

18.

Roid

G. H.

(2003). Stanford–Binet Intelligence Scales, Fifth Edition. Itasca, IL: Riverside.

19.

Roid

G. H.

Miller

L. J.

(1997). Leiter International Performance Scale–Revised. Wood Dale, IL: Stoelting.

20.

Roid

G. H.

Miller

L. J.

Pomplun

Koch

(2013). Leiter International Performance Scale–Third Edition. Wood Dale, IL: Stoelting.

21.

Salvia

Ysseldyke

J. E.

Bolt

(2007). Assessment in special education and inclusive education (10th ed.). New York, NY: Houghton Mifflin.

22.

Sattler

J. M.

(2008). Assessment of children: Cognitive foundations (5th ed.). San Diego, CA: Author.

23.

Schrank

F. A.

McGrew

K. S.

Mather

(2014). Woodcock–Johnson IV Tests of Cognitive Abilities. Rolling Meadows, IL: Riverside.

24.

Wechsler

(2003). Wechsler Intelligence Scale for Children–Fourth Edition. San Antonio, TX: Psychological Corporation.

25.

Wechsler

(2008). Wechsler Adult Intelligence Scale–Fourth Edition. San Antonio, TX: Pearson Assessments.

26.

Wechsler

(2011). Wechsler Abbreviated Scale of Intelligence–Second Edition. San Antonio, TX: Pearson Assessments.

27.

Wechsler

(2012). Wechsler Preschool and Primary Scale of Intelligence–Fourth Edition. San Antonio, TX: Pearson Assessments.

28.

Wechsler

(2014). Wechsler Intelligence Scale for Children–Fifth Edition. San Antonio, TX: Psychological Corporation.

29.

Wechsler

Naglieri

J. A.

(2006). Wechsler Nonverbal Scale of Ability. San Antonio, TX: Psychological Corporation.

30.

Woodcock

R. W.

McGrew

K. S.

Mather

(2001). Woodcock–Johnson III Tests of Cognitive Abilities. Itasca, IL: Riverside.

31.

Zachary

R. A.

Gorsuch

R. L.

(1985). Continuous norming: Implications for the WAIS-R. Journal of Clinical Psychology, 41, 86-94.

32.

Zhu

Chen

H.-Y.

(2011). Utility of inferential norming with smaller sample sizes. Journal of Psychoeducational Assessment, 29, 570-580.