This article (a) discusses the assumptions underlying the use of rating scales, (b) describes the use of information available within the context of Rasch measurement that may be useful for optimizing rating scales, and (c) demonstrates the process in two studies. Participants in the first study were 330 fourth- and fifth-grade students. Participants provided responses to the Index of Self-Efficacy for Writing. Based on category counts, average measures, thresholds and category fit statistics, the responses on the original 10-point scale were better represented by a 4-point scale. The modified 4-point scale was given to a replication sample of 668 fourth- and fifth-grade students. The rating scale structure was found to be congruent with the results from the first study. In addition, the item fit statistics and item hierarchy indicated the writing self-efficacy construct to be stable across the two samples. Combined, these results provide evidence for the generalizability of the findings and hence utility of this scale for use with samples of respondents from the same population.
Get full access to this article
View all access options for this article.
References
1.
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
2.
Andrich, D. (1988). Rasch models for measurement (Sage University Paper on Quantitative Applications in the Social Sciences, Series No. 07-068). Newbury Park, CA: Sage.
3.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191-215.
4.
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
5.
Bandura, A. (1993). Perceived self-efficacy in cognitive development and functioning. Educational Psychologist, 28, 117-148.
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
8.
Flower, L., & Hayes, J. (1981). Images, plans, and prose: The representation of meaning in writing. Written Communication, 1, 229-244.
9.
Graham, S., & Harris, K. R. (1989). Components analysis of cognitive strategy instruction: Effects on learning disabled students' compositions and self-efficacy. Journal of Educational Psychology, 81, 353-361.
Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3, 103-122.
12.
Linacre, J. M., & Wright, B. D. (1999). WINSTEPS computer program. Chicago: MESA Press.
13.
Maurer, T. J., & Pierce, H. R. (1998). A comparison of Likert scale and traditional measures of self-efficacy. Journal of Applied Psychology, 83, 324-329.
14.
Merbitz, C., Morris, J., & Grip, J. C. (1989). Ordinal scales and foundations of misinference. Archives of Physical Medicine and Rehabilitation, 70, 308-312.
15.
Miller, G. A. (1956). The magic number seven plus or minus two: Some limits on our capacity for processing information. Psychological Bulletin, 63, 81-97.
16.
Pajares, F., Hartley, J., & Valiante, G. (2000, April). Response format in writing self-efficacy assessment: Greater discrimination increases prediction. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
17.
Pajares, F., & Johnson, M. J. (1996). Self-efficacy beliefs and the writing performance of entering high school students. Psychology in the Schools, 33, 163-175.
18.
Pajares, F., & Kranzler, J. (1995). Self-efficacy beliefs and general mental ability in mathematical problem-solving. Contemporary Educational Psychology, 26, 426-443.
19.
Pajares, F., & Miller, M. D. (1994). The role of self-efficacy and self-concept beliefs in mathematical problem solving. Journal of Educational Psychology, 86, 193-203.
20.
Pajares, F., & Miller, M. D. (1995). Mathematics self-efficacy and mathematics outcomes: The need for specificity of assessment. Journal of Counseling Psychology, 42, 190-198.
21.
Pajares, F., Miller, M. D., & Johnson, M. J. (1999). Gender differences in writing self-beliefs of elementary school children. Journal of Educational Psychology, 91, 50-61.
22.
Pintrich, P. R., & Schunk, D. H. (1995). Motivation in education: Theory, research, and applications. Englewood Cliffs, NJ: Prentice Hall.
23.
Schunk, D. H. (1991). Goal setting and self-evaluation: A social cognitive perspective of self-regulation. In L. M. Maehr & P. R. Pintrich (Eds.), Advances in motivation and achievement (Vol. 7, pp. 85-113). Greenwich, CT: JAI Press.
24.
Schunk, D. H., & Rice, J. M. (1993). Strategy fading and progress feedback: Effects on self-efficacy and comprehension among students receiving remedial reading instruction. Journal of Special Education, 27, 257-276.
25.
Schunk, D. H., & Swartz, C. W. (1993a). Goals and progress feedback: Effects on self-efficacy and writing achievement. Contemporary Educational Psychology, 18, 337-354.
26.
Schunk, D. H., & Swartz, C. W. (1993b). Writing strategy instruction with gifted students: Effects of goals and feedback on self-efficacy and skills. Roeper Review: A Journal of Gifted Education, 15, 225-230.
27.
Shell, D. F., Colvin, C., & Bruning, R. H. (1995). Self-efficacy, attributions, and outcome expectancy mechanisms in reading and writing achievement: Grade-level and achievement-level differences. Journal of Educational Psychology, 87, 386-398.
28.
Streiner, D. L., & Norman, G. R. (1995). Health measurement scales: A practical guide to their development and use (2nd ed.). Oxford, UK: Oxford University Press.
29.
Swartz, C. W. (1994). The Index of Self-Efficacy for Writing. Clinical Center for the Study of Development and Learning. Chapel Hill, NC.
30.
Wewers, M. E., & Lowe, N. K. (1990). A critical review of visual analogue scales in the measurement of clinical phenomena. Research in Nursing and Health, 13, 227-236.
31.
Wright, B. D. (1991). Factor item analysis versus Rasch item analysis. Rasch Measurement Transactions, 5, 134-135.
32.
Wright, B. D. (1996). Comparing Rasch measurement and factor analysis. Structural Equation Modeling, 3, 3-24.
33.
Wright, B. D., & Linacre, J. M. (1989). Observations are always ordinal: Measurements, however, must be interval. Archives of Physical Medicine and Rehabilitation, 70, 857-860.
34.
Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370.
35.
Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. Chicago: MESA Press.
36.
Wright, B. D., & Stone, M. H. (1988a). Reliability in Rasch measurement: Research memorandum 53. Chicago: MESA Press.
37.
Wright, B. D., & Stone, M. H. (1988b). Validity in Rasch measurement: Research memorandum 54. Chicago: MESA Press.
38.
Zhu, W., Updyke, W. F., & Lewandowski, C. (1997). Post-hoc Rasch analysis of optimal categorization of an ordered-response scale. Journal of Outcome Measurement, 1(4), 286-304.
39.
Zimmerman, B. J., & Martinez-Pons, M. (1990). Self-regulated learning and academic achievement: An overview. Educational Psychologist, 25, 3-17.
