Sage Journals: Discover world-class research

Abstract

Pilot studies are often recommended by scholars and consultants to address a variety of issues, including preliminary scale or instrument development. Specific concerns such as item difficulty, item discrimination, internal consistency, response rates, and parameter estimation in general are all relevant. Unfortunately, there is little discussion in the extant literature of how to determine appropriate sample sizes for these types of pilot studies. This article investigates the choice of sample size for pilot studies from a perspective particularly related to instrument development. Specific recommendations are made for researchers regarding how many participants they should use in a pilot study for initial scale development.

Keywords

pilot study sample size instrument development

Get full access to this article

View all access options for this article.

References

Crocker, L. , & Algina, J. ( 1986). Classical and modern test theory. New York: Holt, Rinehart & Winston.

Duhachek, A. , & Iacobucci, D. ( 2004). Alpha’s standard error (ASE): An accurate and precise confidence interval estimate. Journal of Applied Psychology , 89, 792-808.

Fan, X. , & Thompson, B. ( 2001). Confidence intervals about score reliability coefficients, please: An EPM guidelines editorial. Educational and Psychological Measurement, 61, 517-531.

Feldt, L.S. , Woodruff, D.J. , & Salih, F.A. ( 1987). Statistical inference for coefficient alpha. Applied Psychological Measurement, 11, 93-103.

Hedges, L.V. , & Vevea, J.L. ( 1996). Estimating effect size under publication bias: Small sample properties and robustness of a random effects selection model. Journal of Educational and Behavioral Statistics, 21, 299-332.

Hertzog, M.A. ( 2008). Considerations in determining sample size for pilot studies . Research in Nursing & Health, 31, 180-191.

Hill, R. ( 1998). What sample size is "enough" in internet survey research? Interpersonal Computing and Technology: An Electronic Journal for the 21st Century, 6(3-4). Retrieved July 12, 2008, from http://www.emoderators.com/ipct-j/1998/n3-4/hill.html

Isaac, S. , & Michael, W.B. ( 1995). Handbook in research and evaluation. San Diego, CA: Educational and Industrial Testing Service s.

Julious, S.A. ( 2005). Sample size of 12 per group rule of thumb for a pilot study. Pharmaceutical Statistics, 4, 287-291.

10.

Light, R.J. , Singer, J.D. , & Willett, J.B. ( 1990). By design: Planning research on higher education. Cambridge, MA: Harvard University Press.

11.

Lowry, R. ( 2008). VassarStats: Website for statistical calculation. Retrieved July 12, 2008, from http://faculty.vassar.edu/lowry/rho.html

12.

Mooney, C.Z. , & Duval, R.D. ( 1993). Bootstrapping: A nonparametric approach to statistical inference. Newbury Park, CA: Sage .

13.

Treece, E.W. , & Treece, J.W. ( 1982). Elements of research in nursing (3rd ed.). St. Louis, MO: Mosby.

14.

van Belle, G. ( 2002). Statistical rules of thumb. New York : John Wiley.

Initial Scale Development: Sample Size for Pilot Studies

Abstract

Keywords

Get full access to this article

References