Establishing the Validity and Reliability of the Student Practice Evaluation Form–Revised (SPEF-R) in Occupational Therapy Practice Education

Abstract

This study investigated construct validity and internal consistency of the Student Practice Evaluation Form–Revised Edition Package (SPEF-R) which evaluates students’ performance on practice education placements. The SPEF-R has 38 items covering eight domains, and each item is rated on a 5-point rating scale. Data from 125 students’ final placement evaluations in their final year study were analyzed using the Rasch measurement model. The SPEF-R exhibited satisfactory rating scale performance and unidimensionality across the eight domains, providing construct validity evidence. Only 2 items misfit Rasch model’s expectations (both related to students’ performance with client groups, which were often rated as not observed). Additionally, the internal consistency of each SPEF-R domain was found to be excellent (Cronbach’s α = .86 to .91) and all individual items had reasonable to excellent item-total correlation coefficients. The study results indicate that the SPEF-R can be used with confidence to evaluate students’ performance during placements, but continued validation and refinement are required.

Keywords

assessment internal consistency construct validity occupational therapy practice education instrumentation Rasch measurement model SPEF-R

Get full access to this article

View all access options for this article.

References

Allison

Turpin

(2004). Development of the student placement evaluation form: A tool for assessing student fieldwork performance. Australian Occupational Therapy Journal, 51, 125–132.

Andrich

(1978). Application of a psychometric rating model to ordered categories which are scored with successive integers. Applied Psychological Measurement, 2, 581–594.

Bond

T. G.

Fox

C. M.

(2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.

Brown

(2010). Construct validity: A unitary concept for occupational therapy assessment and measurement. Hong Kong Journal of Occupational Therapy, 20, 30–42.

Cohn

E. S.

Crist

(1995). Back to the future: New approaches to fieldwork education. American Journal of Occupational Therapy, 49, 103–106.

Dalton

Davidson

Keating

(2011). The Assessment of Physiotherapy Practice (APP) is a valid measure of professional competence of physiotherapy students: A cross-sectional study with Rasch analysis. Journal of Physiotherapy, 57, 239–246.

Duncan

P. W.

Bode

R. K.

Lai

S. M.

Perera

(2003). Rasch analysis of a new stroke-specific outcome scale: The Stroke Impact Scale. Archives of Physical Medicine and Rehabilitation, 84, 950–963.

Higgs

Barnett

Billett

Hutchings

Trede

(Eds.). (2012). Practice-based education: Perspectives and strategies. Rotterdam, The Netherlands: Sense Publishers.

Iramaneerat

Yudkowsky

Myford

C. M.

Downing

S. M.

(2008). Quality control of an OSCE using generalizability theory and many-faceted Rasch measurement. Advances in Health Science Education, 13, 479–493.

10.

Lim

S. M.

Rodger

Brown

(2009). Using the Rasch analysis to establish the construct validity of rehabilitation assessment tools. International Journal of Therapy and Rehabilitation, 16, 251–260.

11.

Linacre

J. M.

(1998). Detecting multidimensionality: Which residual data-type works best? Journal of Outcome Measurement, 2, 266–283.

12.

Linacre

J. M.

(2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3, 85–106.

13.

Linacre

J. M.

(2011). User's guide to WINSTEPS. Chicago, IL: MESA Press.

14.

McAllister

(2008). Introduction to the use of Rasch analysis to assess patient performance. International Journal of Therapy and Rehabilitation, 15, 482–490.

15.

Nunnally

J. C.

Bernstein

I. H.

(1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.

16.

Raîche

(2005). Critical eigenvalue sizes in standardized residual principal components analysis (PCA). Rasch Measurement Transactions, 22, 1162.

17.

Rasch

(1960). Probabilistic models for some intelligent and attainment tests. Copenhagen, Denmark: Dermarks Paedagogiske Institute.

18.

Rodger

Webb

Devitt

Gilbert

Wrightson

McKeeken

(2008). Clinical education and practice placements in the allied health professions: An international perspective. Journal of Allied Health, 37, 53–62.

19.

Smith

E. V.

(2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3, 205–231.

20.

Streiner

D. L.

Norman

G. R.

(2008). Health measurement scales: A practical guide to their development and use (4th ed.). Oxford, England: Oxford University Press.

21.

Tennant

Conaghan

P. G.

(2007). The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis and Rheumatism, 57, 1358–1362.

22.

Thompson

M. M.

Ryan

A. G.

(1996). The influence of fieldwork on the professional socialisation of occupational therapy students. British Journal of Occupational Therapy, 59, 95–104.

23.

Turpin

Fitzgerald

Rodger

(2011). Development of the student practice evaluation form revised edition package. Australian Occupational Therapy Journal, 58, 67–73.

24.

Turpin

Rodger

Fitzgerald

Jones

Cuffe

(2008). Student practice evaluation form-revised edition package. Brisbane, Australia: The University of Queensland.

25.

World Federation of Occupational Therapists. (2002). Revised minimum standards for the education of occupational therapists. Forrestfield, Australia: Author.