Measured change to assess the effectiveness of an organizational intervention program may be a function of behavioral change, scale recalibration, and concept redefinition. A number of techniques including the Ideal Scale Approach have been proposed to detect change due to scale recalibration. A methodology is proposed for the manipulation of scale recalibration so that these detection methods can be experimentally evaluated. An illustration of the use of this methodology to evaluate an adaptation of the Ideal Scale Approach is presented.
Get full access to this article
View all access options for this article.
References
1.
Armenakis, A. , Buckley, M., and Bedeian, A. (1986). Survey research measurement issues in evaluating change: A laboratory investigation. Applied Psychological Measurement, 10, 147-157.
2.
Borman, W. , Hough, L., and Dunnette, M. (1976). Performance ratings: An investigation of reliability, accuracy, and relationships between individual differences and rater error (vol. 1). Minneapolis Personnel Decisions, Inc.
3.
Buckley, M. and Armenakis, A. (1987). Detecting scale recalibration in survey research: A laboratory investigation. Group and Organization Studies, 12, 464-481.
4.
Cook, T. and Campbell, D. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin.
5.
Golembiewski, R. and Billingsley, K. (1980). Measuring change in OD panel designs: A response to critics. Academy of Management Review, 5, 97-103.
6.
Golembiewski, R. , Billingsley, K., and Yeager, S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs. The Journal of Applied Behavioral Science, 12, 133-157.
7.
Granier, M. (1987). A laboratory investigation of ideal and typical scales in detecting simulated scale recalibration in survey research methodology. Unpublished Ph.D. Dissertation, Auburn University, AL.
8.
Schmitt, N. (1982). The use and analysis of covariance structures to assess beta and gamma change. Multivariate Behavioral Research, 17, 343-358.
9.
Schmitt, N. and Stutts, D. (1985). Factors defined by negatively keyed items: The results of careless respondents?Applied Psychological Measurement, 9, 367-373.
10.
Schriesheim, C. , Eisenbach, R., and Hill, K. (1989, August). An experimental investigation of item reversal effects on questionnaires. Paper presented at the 49th Academy of Management Meeting, Washington, DC.
11.
Terborg, J. , Howard, G., and Maxwell, S. (1980). Evaluating planned organizational change: A method for assessing alpha, beta, and gamma change. Academy of Management Review, 5, 109-121.
12.
van de Vliert, E. , Huismans, S., and Stock, J. (1985). The criterion approach to unraveling beta and alpha change. Academy of Management Review, 10, 296-274.
13.
Zmud, R. and Armenakis, A. (1978). Understanding the measurement of change. Academy of Management Review, 3, 661-669.
