Objectives: The purpose of this article is to create transparency for the psychometric methods employed for the development of the Association of Social Work Boards’ (ASWB) exams. Results: The article includes an assessment of the macro (political) and micro (statistical) environments of testing social work competence. The seven-step process used to ensure content validity is discussed. The types of reliability and validity methods employed to assess ASWB exams are discussed. Examples are offered to illustrate the statistical methods employed for selecting good items (questions, some of which are not in question form) and eliminating poor ones. A discussion of the finances of reliability and validity research is included. Conclusion: Readers will have a deeper understanding of how exams are constructed. The information housed within this article may facilitate preparing students for the exams.
ACT (1997, November). Discussion paper on procedures for testing ESL candidates for social work licensure, prepared for the American Association of State Social Work Boards (AASSWB) . Unpublished manuscript.
2.
ACT (1998, November). Readability analysis of licensure exams for the American Association of State Social Work Boards (AASSWB). Unpublished manuscript.
3.
ACT. (2008, August). Annual technical report, prepared for the Association of Social Work Boards .
4.
AERA (American Educational Research Association), APA (American Psychological Association), & NCME (National Council on Measurement in Education). (1999). Standards for educational and psychological testing. Washington, DC: Author.
5.
Association of Social Work Boards. (2003, Summer). The Itemizer: News for item-writers.
6.
Association of Social Work Boards. (2004a). The exam ‘‘blue book .’’Culpeper, VA: Author.
7.
Association of Social Work Boards. (2004b). Analysis of the practice of social work 2003: Final report. Culpeper, VA: Author.
8.
Association of Social Work Boards. (2004c, Summer). The Itemizer: News for item-writers.
9.
Association of Social Work Boards. (2005, Winter). The Itemizer: News for item-writers.
10.
Association of Social Work Boards. (2007a). The item writing guide.
11.
Association of Social Work Boards. (2007b). Item writer contract.
12.
Association of Social Work Boards. (ND). ( 2007). The questionnaire for the task analysis. Retrieved June 10, 2007, from http://www.aswb.org/Practice_analysis_files/Web_form_b.pdf
13.
Association of Social Work Boards. (NDb). 2007 pass rates. Retrieved March 4, 2009, from http://www.aswb.org/SWLE/ 2007passrates.asp
14.
Association of Social Work Boards. (2008, December). The year in review. Association News, p. 2.
15.
Brennan, R. ( 2001). An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement , 38, 295-317.
16.
Cizek, G.J. ( 2008). Confidential report: Review of the ASWB licensure examinations. Unpublished paper. Chapel Hill: University of North Carolina.
17.
DePoy, E., & Gitlin, L.N. ( 1998). Introduction to research: Understanding and applying multiple strategies. St. Louis: Mosby.
18.
Downing, S. M., & Haladyna, T. M. (Eds.). (2006). Handbook of test development . Mahwath, NJ: Lawrence Erlbaum Associates.
19.
Haladyna, T.M. ( 2000). Confidential report: Evaluation of the ASWB licensure examination. Unpublished paper. Phoenix: Arizona State University.
20.
Haertel, E.H. ( 2006). Reliability. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 99-101). Westport, CT: American Council on Education/Praeger.
21.
Marlow, C.R. ( 2005). Research methods for generalist social work. Belmont, CA: Brooks/Cole.
22.
Marson, S. ( 2005). Social work. In K. Kemp-Leonard (Ed.), The encyclopedia of social measurement (Vol 3, pp. 539-546). NY: Elsevier Academic Press.
23.
Marson, S. ( 1981). The validity of the ACSW examination. Unpublished paper . Raleigh: North Carolina State University.
24.
Mittal, N. ( 2004). Diversity issues in the examination process: A psychometric perspective. Paper presented to the ASWB Spring Education Meeting, Calgary, Canada.
25.
Mittal, N., Cartmill, S., & Vincent, E. ( 2005). Increasing the validity of the standard-setting process for licensure examinations. Paper presented at American Educational Research Association, Montreal, Quebec , Canada.
26.
Pincus, A., & Minahan, A. ( 1973). Social work practice: Model and method. Itasca, IL: F.E. Peacock.
27.
Royce, D. ( 2008). Research methods in social work. Belmont, CA: Brooks/Cole.
28.
Rubin, A., & Babbie, E. ( 2008). Research methods for social work. Belmont, CA: Brooks/Cole.
29.
Thorndike, R.L. ( 1971). Educational measurement (2nd ed., p. 515). Washington, DC: American Council on Education.
30.
Thyer, B.A., & Biggerstaff, M.A. (1989). Professional social work credentialing and legal regulation: A review of critical issues and an annotated bibliography. Springfield, IL: Charles C. Thomas.
