The adequate measurement of abstract constructs is perhaps the greatest challenge to understanding the behavior of people in organizations. Problems with the reliability and validity of measures used on survey questionnaires continue to lead to difficulties in interpreting the results of field research. Price and Mueller suggest that measurement problems may be due to the lack of a well-established framework to guide researchers through the various stages of scale development. This article provides a conceptual framework and a straightforward guide for the development of scales in accordance with established psychometric principles for use infield studies
Get full access to this article
View all access options for this article.
References
1.
American Psychological Association (APA)
. (1995). Standards for educational and psychological testing. Washington, DC: Author.
2.
Anderson J. C.
, & Gerbing, D. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. Journal of Applied Psychology, 76, 732-740.
3.
Bagozzi, R. P.
, Yi, Y., & Phillips, L. W. (1991). Assessing construct validity in organizational research. Administrative Science Quarterly, 36, 421-458.
4.
Barrett, G. V.
(1972). New research models of the future for industrial and organizational psychology. Personnel Psychology, 25, 1-17.
5.
Bass, B. M.
, Cascio, W. F., & O'Connor, E. J. (1974). Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 59, 313-320.
6.
Becker, T. E.
, & Vance, R. J. (1993). Construct validity of three types of organizational citizenship behavior: An illustration of the direct product model with refinements. Journal of Management, 19, 663-682.
7.
Butler, J. K.
(1991). Toward understanding and measuring conditions of trust: Evolution of a conditions of trust inventory. Journal of Management, 17, 643-663.
8.
Byrne, B. M.
(1989). A primer of LISREL. New York: Springer-Verlag.
9.
Campbell, J. P.
(1976). Psychometric theory. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology. Chicago: Rand McNally.
10.
Campbell, J. P.
, & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
11.
Carmines, E. G.
, & McIver, J. (1981). Analyzing models with unobserved variables: Analysis of covariance structures. In G. Bohmstedt & E. Borgatta (Eds.), Social measurement: Current issues. Beverly Hills, CA: Sage.
12.
Carmines, E. G.
, & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills, CA: Sage.
13.
Cattell, R. B.
(1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276.
14.
Churchill, G. A.
(1979). A paradigm for developing better measures of marketing constructs. Journal of Marketing Research, 16, 64-73.
15.
Cohen, J.
(1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.
16.
Cook, J. D.
, Hepworth, S. J., & Warr, P. B. (1981). The experience of work. San Diego: Academic Press.
17.
Cortina, J. M.
(1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98-104.
18.
Cronbach, L. J.
, & Meehl, P. C. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
19.
Crowne, D.
, & Marlowe, D. (1964). The approval motive: Studies in evaluative dependence. New York: John Wiley.
20.
Edwards, A. L.
(1957). Techniques of attitude scale construction. Norwalk, CT: Appleton-Century-Crofts.
21.
Ford, J. K.
, MacCallum, R. C., & Tait, M. (1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39, 291-314.
22.
Gerbing, D. W.
, & Anderson, J. C. (1988). An updated paradigm for scale development incorporating unidimensionality and its assessment. Journal of Marketing Research, 25, 186-192.
23.
Ghiselli, E. E.
, Campbell, J. P., & Zedeck, S. (1981). Measurement theory for the behavioral sciences. San Francisco: W. H. Freeman.
24.
Grover, S. L.
(1991). Predicting the perceived fairness of parental leave policies. Journal of Applied Psychology, 76, 247-255.
25.
Guadagnoli, E.
, & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265-275.
26.
Harrison, D. A.
, & McLaughlin, M. E. (1991). Exploring the cognitive processes underlying responses to self-report instruments: Effects of item content on work attitude measures. Proceedings of the 1991 Academy of Management annual meetings, 310-314.
27.
Harrison, D. A.
, & McLaughlin, M. E. (1993). Cognitive processes in self-report responses: Tests of item context effects in work attitude measures. Journal of Applied Psychology, 78, 129-140.
28.
Harvey, R. J.
, Billings, R. S., & Nilan, K. J. (1985). Confirmatory factor analysis of the job diagnostic survey: Good news and bad news. Journal of Applied Psychology, 70, 461-468.
29.
Hayduk, L. A.
(1987). Structural equation modeling with LISREL. Baltimore: Johns Hopkins University Press.
30.
Hinkin, T. R. (1985). Development and application of new social power measures in superior-subordinate relationships. Unpublished doctoral dissertation, University of Florida.
31.
Hinkin, T. R.
(1995). A review of scale development in the study of behavior in organizations. Journal of Management, 21, 967-988.
32.
Hinkin, T. R.
, & Schriesheim, C. A. (1989). Development and application of new scales to measure the French and Raven (1959) bases of social power. Journal of Applied Psychology, 74, 561-567.
33.
Hoelter, J. W.
(1983). The analysis of covariance structures: Goodness-of-fit indices. Sociological Methods and Research, 11, 325-344.
34.
Hollenbeck, J. R.
, Klein, H. J., O'Leary, A. M., & Wright, P. M. (1989). Investigation of the construct validity of a self-report measure of goal commitment. Journal of Applied Psychology, 74, 951-956.
35.
Hunt, S. D.
(1991). Modern marketing theory. Cincinnati, OH: South-Western.
36.
Ironson, G. H.
, Smith, P. C., Brannick, M. T., Gibson, W. M., & Paul, K. B. (1989). Construction of a job in general scale: A comparison of global, composite, and specific measures. Journal of Applied Psychology, 74, 193-200.
37.
Jöreskog, K. G.
, & Sörbom, D. (1989). LISREL 7: A guide to the program and applications. Chicago: SPSS.
38.
Kavanagh, M. J.
, MacKinney, A. C., & Wolins, L. (1971). Issues in managerial performance: Multitrait-multimethod analysis of ratings. Psychological Bulletin, 75, 34-49.
39.
Kerlinger, F.
(1986). Foundations of behavioral research (3rd ed.). New York: Holt, Rinehart & Winston.
40.
Kim, J.
, & Mueller, C. W. (1978). Introduction to factor analysis: What it is and how to do it. Beverly Hills, CA: Sage.
41.
Kipnis, D.
, Schmidt, S. M., & Wilkinson, I. (1980). Intraorganizational influence tactics: Explorations in getting one's way. Journal of Applied Psychology, 65, 440-452.
42.
Krzystofiak, F.
, Cardy, R. L., & Newman, J. (1988). Implicit personality and performance appraisal: The influence of trait inferences on evaluation behavior. Journal of Applied Psychology, 73, 515-521.
43.
Kumar, K.
, & Beyerlein, M. (1991). Construction and validation of an instrument for measuring ingratiatory behaviors in organizational settings. Journal of Applied Psychology, 76, 619-627.
44.
Likert, R.
(1932). A technique for the measurement of attitude scales. Archives of Psychology, 140.
45.
Lissitz, R. W.
, & Green, S. B. (1975). Effect of the number of scale points on reliability: A Monte Carlo approach. Journal of Applied Psychology, 60, 10-13.
46.
Long, J. S.
(1983). Confirmatory factor analysis. Beverly Hills, CA: Sage.
47.
Mackenzie, S. B.
, Podsakoff, P. M., & Fetter, R. (1991). Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance. Organizational Behavior and Human Decision Processes, 50, 123-150.
48.
Marsh, H. W.
, & Hocevar, D. (1988). Anew, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of Applied Psychology, 73, 107-117.
49.
Medsker, G. J.
, Williams, L. J., & Holohan, P. J. (1994). A review of current practices for evaluating causal models in organizational behavior and human resources management research. Journal of Management, 20, 439-464.
50.
Nunnally, J. C.
(1976). Psychometric theory (2nd ed.). New York: McGraw-Hill.
51.
Price, J. L.
, & Mueller, C. W. (1986). Handbook of organizational measurement. Marshfield, MA: Pitman.
52.
Rummel, R. J.
(1970). Applied factor analysis. Evanston, IL: Northwestern University Press.
53.
Schmitt, N. W.
, & Klimoski, R. J. (1991). Research methods in human resources management. Cincinnati, OH: South-Western.
54.
Schmitt, N. W.
, & Stults, D. M. (1985). Factors defined by negatively keyed items: The results of careless respondents?Applied Psychological Measurement, 9, 367-373.
55.
Schmitt, N. W.
, & Stults, D. M. (1986). Methodology review: Analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 10, 1-22.
56.
Schoenfeldt, L. F.
(1984). Psychometric properties of organizational research instruments. In T. S. Bateman & G. R. Ferris (Eds.), Method & analysis in organizational research (pp. 68-80). Reston, VA: Reston.
57.
Schriesheim, C. A.
, & Eisenbach, R. J. (1990). Item wording effects on exploratory factor-analytic results: An experimental investigation. Proceedings of the 1990 Southern Management Association annual meetings, 396-398.
58.
Schriesheim, C. A.
, Eisenbach, R. J., & Hill, K. D. (1989, August). An experimental investigation of item reversal effects on questionnaires. Paper presented at the annual meeting of the Academy of Management, Washington, D.C.
59.
Schriesheim, C. A.
, & Hinkin, T. R. (1990). Influence tactics used by subordinates: A theoretical and empirical analysis and refinement of the Kipnis, Schmidt, and Wilkinson subscales. Journal of Applied Psychology, 75, 246-257.
60.
Schriesheim, C. A.
, Powers, K. J., Scandura, T. A., Gardiner, C. C., & Lankau, M. J. (1993). Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey-type instruments. Journal of Management, 19, 385-417.
61.
Schwab, D. P.
(1980). Construct validity in organization behavior. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (Vol. 2, pp. 3-43). Greenwich, CT: JAI.
62.
Shore, L. M.
, & Tetrick, L. E. (1991). A construct validity study of the survey of perceived organizational support. Journal of Applied Psychology, 76, 637-643.
63.
Stone, E.
(1978). Research methods in organizational behavior. Glenview, IL: Scott, Foresman.
64.
Thacker, J. W.
, Fields, M. W., & Tetrick, L. E. (1989). The factor structure of union commitment: An application of confirmatory factor analysis. Journal of Applied Psychology, 74, 228-232.
65.
Thurstone, L. L.
(1947). Multiple-factor analysis. Chicago: University of Chicago Press.
66.
Viega, J. F.
(1991). The frequency of self-limiting behavior in groups: A measure and an explanation. Human Relations, 44, 877-894.
67.
Warwick, D. P.
, & Lininger, C. A. (1975). The sample survey: Theory and practice. New York: McGraw-Hill.
68.
Williamson, J. B.
, Karp, D. A., Dalphin, J. R., & Gray, P. S. (1982). The research craft (2nd ed.). Boston: Little, Brown.
