This study examined the validity and reliability of the Assessment of Work Performance (AWP) using Rasch analysis. The AWP was administered to 365 clients with a variety of work-related problems. Rasch analysis and principal component analysis were used to examine the appropriateness of the rating scales and unidimensionality of AWP items. The person-response validity, internal consistency, targeting appropriateness, and differential item function were also analyzed. The Rasch analysis confirmed the 4-point rating scale, and the item set met the criteria of unidimensionality. The AWP exhibited satisfactory person-response validity and internal consistency. Among the three subdomains, the targeting of item-difficulty was sufficient in the motor skills and process skills subdomains. Differential item functioning was found across gender and diagnoses. This study presented evidence to support that the AWP functioned as a reliable and valid assessment in assessing work performance.
ArnadóttirG., & FisherA. G. (2008). Rasch analysis of the ADL scale of the A-ONE. American Journal of Occupational Therapy, 62, 51–60.
2.
BedellJ. R.HunterR. H., & CorriganP. W. (1997). Current approaches to assessment and treatment of persons with serious mental illness. Professional Psychology: Research and Practice, 28, 217–228.
3.
BioD. S., & GattazW. F. (2011). Vocational rehabilitation improves cognition and negative symptoms in schizophrenia. Schizophrenia Research, 126, 265–269.
4.
BlythF. M.MarchL. M.NicholasM. K., & CousinsM. J. (2003). Chronic pain, work performance and litigation. Pain, 103, 41–47.
5.
BondT. G. (2003). Validity and assessment: A Rasch measurement perspective. Metodología de las Ciencias del Comportamiento, 5, 179–194.
6.
BondT. G., & FoxC. M. (2007). Applying the Rasch Model: Fundamental measurement in the human sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
7.
ConradK. J.DennisM. L.BezruczkoN.FunkR. R., & RileyB. B. (2007). Substance use disorder symptoms: Evidence of differential item functioning by age. Journal of Applied Measurement, 8, 373–387.
8.
de VriesH. J.BrouwerS.GroothoffJ. W.GeertzenJ. H., & RenemanM. F. (2011). Staying at work with chronic nonspecific musculoskeletal pain: A qualitative study of workers' experiences. BMC Musculoskeletal Disorders, 3, 126.
9.
DonnellC. M.LustigD. C., & StrauserD. R. (2004). The working alliance: Rehabilitation outcomes for persons with severe mental illness. Journal of Rehabilitation, 70, 12–18.
10.
EaglyA. H., & MladinicA. (1994). Are people prejudiced against women? Some answers from research on attitudes, gender stereotypes, and judgments of competence. European Review of Social Psychology, 5, 1–35.
11.
EckesT. (2005). Examining rater effects in TestDaF Writing and Speaking Performance Assessment: A many-facet Rasch analysis. Language Assessment Quarterly, 2, 197–221.
12.
FanC. W.ChangY., & PanA. W. (2007). Predictors of employment for patients with psychiatric disorders: A literature review. Taiwan Occupational Therapy Journal: Practice and Research, 3, 61–71.
13.
FanC. W., & PanA. W. (2009). The use of the Model of Human Occupation to classify domains of vocational assessments for individuals with mental illness: A literature review. Taiwan Occupational Therapy Journal: Practice and Research, 5, 51–64.
14.
FinchT. L.MairF. S.O'DonnellC.MurrayE., & MayC. R. (2012). From theory to ‘measurement’ in complex interventions: Methodological lessons from the development of an e-health normalisation instrument. BMC Medical Research Methodology, 12, 69. doi:10.1186/1471-2288-12-69.
15.
FischlC., & FisherA. G. (2007). Development and Rasch analysis of the assessment of computer-related skills. Scandinavian Journal of Occupational Therapy, 14, 126–135.
16.
ForkmannT.BoeckerM.NorraC.EberleN.KircherT.SchauerteP.WirtzM. (2009). Development of an item bank for the assessment of depression in persons with mental illnesses and physical diseases using Rasch analysis. Rehabilitation Psychology, 54, 186–197.
17.
FranchignoniF.GiordanoA., & FerrieroG. (2009). Consideration about the use and misuse of Rasch analysis in rehabilitation outcome studies. European Journal of Physical and Rehabilitation Medicine, 45, 289–292.
18.
GodinG.Belanger-GravelA.EcclesM., & GrimshawJ. (2008). Healthcare professionals' intentions and behaviors: A systematic review of studies based on social cognitive theories. Implementation Science, 3, 36. doi: 10.1186/1748-5908-3-36.
19.
GraueM. E. (1993). Integrating theory and practice through instructional assessment. Educational Assessment, 1, 283–309.
20.
HarveyP. D.GreenM. F.KeefeR. S. E., & VelliganD. I. (2004). Cognitive functioning in schizophrenia: A consensus statement on its role in the definition and evaluation of effective treatments for the illness. Journal of Clinical Psychiatry, 65, 361–372.
21.
HarwellM. R., & GattiG. G. (2001). Rescaling ordinal data to interval data in educational research. Review of Educational Research, 71, 105–131.
22.
HeilmanM. E. (2001). Description and prescription: How gender stereotypes prevent women's ascent up the organizational ladder. Journal of Social Issues, 57, 657–674.
23.
HenryA. D.BanksS.ClarkR., & HimmelsteinJ. (2007). Mobility limitations negatively impact work outcomes among Medicaid enrollees with disabilities. Journal of Occupational Rehabilitation, 17, 355–369.
24.
HenryA. D., & LuccaA. M. (2004). Facilitators and barriers to employment: The perspectives of people with psychiatric disabilities and employment service providers. Work: A Journal of Prevention, Assessment & Rehabilitation, 22, 169–182.
25.
HoneyA. (2003). The impact of mental illness on employment: Consumers' perspectives. Work: A Journal of Prevention, Assessment & Rehabilitation, 20, 267–276.
26.
JoshiR. J. (1993). Gender differences in determinants of job performance. Indian Journal of Industrial Relations, 28, 238–247.
27.
KielhofnerG. (2008). Model of Human Occupation: Theory and Application (4th ed.). Philadelphia: Lippincott, Williams & Wilkins.
28.
LaiJ. S. & EtonD. T. (2002). Clinically meaningful gaps. Rasch Measurement Transaction, 15, 580.
29.
LinacreJ. M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3, 85–106.
30.
LinacreJ. M. (2005). WINSTEPS Rasch measurement computer program, version 3.56. Chicago, IL: Winsteps.com.
31.
LinacreJ. M. (2011a). A user's guide to WINSTEPS. Chicago, IL: MESA Press.
32.
LinacreJ. M. (2011b). A user's guide to FACETS. Chicago, IL: MESA Press.
33.
LinacreJ. M. (2011c). FACETS Rasch measurement computer program, version 3.68.1. Chicago, IL: Winsteps.com.
34.
LindleR. S.MetterE. J.LynchN. A.FlegJ. L.FozardJ. L.TobinJ. & HurleyB. F. (1997). Age and gender comparisons of muscle strength in 654 women and men aged 20–93 yr. Journal of Applied Physiology, 83, 1581–1587.
35.
LittleK.HendersonC.BrohanE., & ThornicroftG. (2011). Employers' attitudes to people with mental health problems in the workplace in Britain: Changes between 2006 and 2009. Epidemiology and Psychiatric Sciences, 20, 73–81.
36.
MadelineE., & HeilmanM. E. (2001) Description and prescription: How gender stereotypes prevent women's ascent up the organizational ladder. Journal of Social Issues, 57, 657–674.
37.
MastersG. N., & WrightB. D. (1997). The partial credit model. In: Van Der LindenW. J., & HambletonR. K. (eds.). The Handbook of Item Response Theory. New York: Springer; 101–138.
38.
McFaddenS.MacDonaldA.FogartyA.LeS., & MerrittB. K. (2010). Vocational assessment: A review of the literature from an occupation-based perspective. Scandinavian Journal of Occupational Therapy, 17, 43–48.
39.
McHorneyC. A., & TarlovA. R. (1995). Individual-patient monitoring in clinical practice: Are available health status surveys adequate?Quality of Life Research, 4, 293–307.
40.
MueserK. T.AaltoS.BeckerD. R.OgdenJ. S.WolfeR. S.SchiavoD.XieH. (2005). The effectiveness of skills training for improving outcomes in supported employment. Psychiatric Services, 56, 1254–1260.
41.
NormanG. R.SloanJ. A., & WyrwichK. W. (2003). Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation. Medical Care, 41, 582–592.
42.
RaschG. (1980). Probabilistic models for some intelligence and attainment tests. Chicago, IL: The University of Chicago Press.
43.
RazzanoL. A.CookJ. A.Burke-MillerJ. K.MueserK. T.Pickett-SchenkS. A.GreyD. D., & CareyM. A. (2005). Clinical factors associated with employment among people with severe mental illness: Findings from the Employment Intervention Demonstration program. Journal of Nervous and Mental Disease, 193, 705–713.
44.
RosenG. A. (1978). The problem and utility of work sample reliability data. Vocational Evaluation & Work Adjustment Bulletin, 11, 45–50.
45.
RosenheckR.LeslieD.KeefeR.McEvoyJ.SwartzM.PerkinsD.LiebermanJ. (2006). Barriers to employment for people with schizophrenia. American Journal of Psychiatry, 163, 411–417.
46.
SandqvistJ.LeeJ., & KielhofnerG. (2010). A user's guide to Assessment of Work Performance (AWP). Chicago, IL: University of Illinois at Chicago: Model of Human Occupation Clearinghouse.
47.
SandqvistJ. L. (2007). Development and evaluation of validity and utility of the instrument Assessment of Work Performance (AWP) (Doctoral dissertation). Retrieved from Linköping University Medical Dissertations http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-10577.
48.
SandqvistJ. L.BjorkM. A.GullbergM. T.HenrikssonC. M., & GerdleB. U. C. (2009). Construct validity of the Assessment of Work Performance (AWP). Work: A Journal of Prevention, Assessment & Rehabilitation, 32, 211–218.
49.
SandqvistJ. L.GullbergM. T.HenrikssonC. M., & GerdleB. U. C. (2008). Content validity and utility of the Assessment of Work Performance (AWP). Work: A Journal of Prevention, Assessment & Rehabilitation, 30, 441–450.
50.
SandqvistJ. L., & HenrikssonC. M. (2004). Work functioning: A conceptual framework. Work: A Journal of Prevention, Assessment & Rehabilitation, 23, 147–157.
51.
SandqvistJ. L.TornquistK. B., & HenrikssonC. M. (2006). Assessment of Work Performance (AWP): Development of an instrument. Work: A Journal of Prevention, Assessment & Rehabilitation, 26, 379–387.
52.
ShinS. H. (2009). How to treat omitted responses in Rasch model-based equating. Practical Assessment Research & Evaluation, 14(1). Available online: http://pareonline.net/getvn.asp?v=14&n=1
