Sage Journals: Discover world-class research

Abstract

This study sought to determine the change in level of leadership skills of participants in a community leadership program and the degree of response shift (change in level of understanding of leadership skills) in the self-report measures employed. While most of the participants reported increases in their leadership skills at the end of the program, differences were found between their self-report ratings using the pretest/posttest approach and the then/posttest approach. The degree of response shift (pre/then comparison) was also evident. The findings from this study together with other studies cited suggest that when employing self-report measures, the then/post approach provides a less conservative and more accurate means of assessing leadership skill development than would the traditional pretest/posttest approach. Suggestions for reducing the effects of response shift are also offered.

Get full access to this article

View all access options for this article.

References

Bolton, E.B. , (1991). Developing local leaders: Results of a structured learning experience. Journal of Community Development Society . 22(1): 119-143.

Caporaso, J.A. (1973). Quasi-experimental approaches to social science: perspectives and problems. In: A. J. Caporaso & L. L. Roos , Jr. (Eds.), Quasi-Experimental Approaches: Testing Theory and Evaluating Policy. Evanston, III.:Northwestern University Press.

Campbell, D.T. & Stanley, J.C. (1963). Experimental and quasi-experimental design for research and teaching. In: N.L. Gage (Ed.), Handbook of Research on Teaching. Chicago, II.: Rand McNally.

Campbell, J.P. (1971). Personnel training and development. Annual Review of Psychology 22: 526-602.

Cronbach, L.J. & Furby, L. (1970). How we should measure "change"--or should we? Psychological Bulletin 74:68-80.

Howell, R.E. , Weir, I.L. & Cook, A.K. (1979). Public Affairs Leadership Development. Pullman: Washington State University, Rural Sociology .

Howard, G.S. & Dailey, P.R. (1979). Response-shift bias: a source of contamination in self report measures. Journal of Applied Psychology 64(2): 144-150.

Howard, G.S. , Ralph, K.M. , Gulanick, N.A. , Maxwell, S.E. , Nance, D.W. & Gerber, S.K. (1979). Internal invalidity in pretest/posttest self report evaluations and a re-evaluation of retrospective pre-tests. Applied Psychological Measurement 3:1-23.

Neale, J.M. & Leibert, R.M. (1973). Science and Behavior: An Introduction to Research Methods. Englewood Cliffs, N. J.: Prentice Hall.

10.

Pohl, N.F. (1982). Using retrospective pre-ratings to counteract response-shift confounding. Journal of Experimental Education 50(4): 211-214.

11.

Rockwell, S.K. & Kohn, H. (1989). Post-then pre evaluation. Journal of Extension 27(2):19-21.

12.

Rohs, F.R. & Langone, C.A. (1993). Assessing leadership and problem-solving skills and their impacts in the community. Evaluation Review 17(1):109-115.

13.

Rohs, F.R. & Langone, C.A. (1996). Measuring leadership skills development: A comparison of methods. Proceedings of the Association of Leadership Educators, Burlington, Vermont. (In press).

14.

Shuffstal, W. & Gregory, D. (1990). Assessing leadership development needs in four Pennsylvania counties: a solution. Proceedings of the Association of Leadership Educators, Milwaukee, Wisconsin, 285-292.

15.

Sprangers, M. & Hoogstraten, J. (1988). Response-style effects, response-shift bias and a bogus pipeline: a replication. Psychological Reports 62: 11-16.

16.

Williams, A.S. & Faulkner, L.G. (1986). Leadership Training for Public Affairs Participation:

17.

FCL Regional Evaluation Report, 1982-1986. Bozeman, Mt .:Montana State University.

Increased Accuracy in Measuring Leadership Impacts

Abstract

Get full access to this article

References