Sage Journals: Discover world-class research

Abstract

LISREL maximum likelihood confirmatory factor analyses (Jöreskog & Sörbom, 1984) were conducted to explore the effects of two questionnaire formats (grouping versus randomizing items) on the conver gent and discriminant validity of two sets of question naire measures. The first set of measures consisted of satisfaction scales that had demonstrated acceptable psychometric properties in earlier studies; the second set of scales were job characteristics measures that had shown discriminant validity problems in previous re search. Correlational data were collected from two groups of employed business administration students (N = 80 in each group) concurrently (Study 1) and at two points in time (Study 2). The results of the anal yses showed that the grouped format was superior to the random format, particularly with respect to the weaker measures (the job characteristics scales). The results also illustrated and supported the usefulness of LISREL confirmatory factor analysis in studies of con vergent and discriminant validity. Index terms: con firmatory factor analysis, convergent validity, discrim inant validity, LISREL analysis, questionnaire formats, scale validity.

Get full access to this article

View all access options for this article.

References

Baehr, M.E. (1953). A simplified procedure for the measurement of employee attitudes. Journal of Applied Psychology, 37, 163-167.

Bentler, P.M. , & Bonett, D.G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin , 88, 588-606.

Campbell, D.T. , & Fiske, D.W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.

Cattell, R.B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276.

Dunham, R.B. , Aldag, R.J. , & Brief, A.P. (1977). Dimensionality of task design as measured by the job diagnostic survey. Academy of Management Journal, 20, 209-223.

Gorsuch, R.L. (1974). Factor analysis. Philadelphia : Saunders.

Hackman, J.R. , & Oldham, G.R. (1975). Development of the Job Diagnostic Survey. Journal of Applied Psychology, 60, 159-179.

Harman, H.H. (1976). Modern factor analysis (3rd ed.). Chicago: University of Chicago Press.

Hendrickson, A.E. , & White, P.O. (1964). Promax: A quick method for rotation to oblique simple structure. British Journal of Statistical Psychology , 17, 65-70.

10.

Heywood, H.B. (1931). On finite sequences of real numbers. Proceedings of the Royal Society of London, 134, 486-501.

11.

Jöreskog, K.G. , & Sörbom, D. (1984). LISREL VI: Analysis of linear structural relationships by maximum likelihood, instrumental variables, and least squares methods. Mooresville IN: Scientific Software.

12.

Kavanagh, M.J. , Mac Kinney, A.C. , & Wollins, L. (1971). Issues in managerial performance: Multitrait-multimethod analyses of ratings. Psychological Bulletin, 75, 34-49.

13.

Kenny, D.A. (1976). An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix. Journal of Experimental Social Psychology, 12, 247-252.

14.

Kopelman, R.E. , Greenhaus, J.H. , & Connolly, T.F. (1983). A model of work, family, and inter-role conflict : A construct validation study. Organizational Behavior and Human Performance, 32, 198-215.

15.

Marsh, H.W. , & Hocevar, D. (1983). Confirmatory factor analyses of multitrait-multimethod matrices. Journal of Educational Measurement, 20, 231-248.

16.

McNemar, Q. (1969). Psychological statistics (4th ed.). New York: Wiley.

17.

Nunnally, J.C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

18.

Pierce, J.L. , & Dunham, R.B. (1978). The measurement of perceived job characteristics: The job diagnostic survey versus the job characteristics inventory. Academy of Management Journal, 21, 123-128.

19.

Rindskopf, D. (1983). Parameterizing inequality constraints on unique variances in linear structural models. Psychometrika, 48, 73-83.

20.

Robinson, J.P. , & Shaver, P.R. (1973). Measures of social psychological attitudes (rev. ed.). Ann Arbor: University of Michigan , Institute for Social Research, Survey Research Center.

21.

Rosenberg, M. (1965). Society and the adolescent self-image. Princeton NJ: Princeton University Press.

22.

Rummel, R.J. (1970). Applied factor analysis. Evanston IL: Northwestern University Press.

23.

Schmitt, N. , & Stults, D.M. (1986). Methodology review : Analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 10, 1-22.

24.

Schneider, B. , & Dachler, H.P. (1978). A note on the stability of the job descriptive index. Journal of Applied Psychology, 63, 650-653.

25.

Schriesheim, C.A. (1981a). The effect of grouping or randomizing items on leniency response bias. Educational and Psychological Measurement , 41, 401-411.

26.

Schriesheim, C.A. (1981b). Leniency effects on convergent and discriminant validity for grouped questionnaire items: A further investigation. Educational and Psychological Measurement, 41, 1093-1099.

27.

Schriesheim, C.A. , & De Nisi, A.S. (1980). Item presentation as an influence on questionnaire validity: A field experiment. Educational and Psychological Measurement, 40, 175-182.

28.

Schriesheim, C.A. , Kinicki, A.J. , & Schriesheim, J.F. (1979). The effect of leniency on leader behavior descriptions. Organizational Behavior and Human Performance, 23, 1-29.

29.

Schriesheim, C.A. , Kopelman, R.E. , & Solomon, E. (in press). The effect of grouped versus randomized questionnaire format on scale reliability and validity: A three-study investigation. Educational and Psychological Measurement.

30.

Solomon, E. , & Kopelman, R.E. (1984). Questionnaire format and scale reliability: An examination of three modes of item presentation. Psychological Reports, 54, 447-452.

31.

Widaman, K.F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement , 9, 1-26.

Grouped Versus Randomized Format: An Investigation of Scale Convergent and Discriminant Validity Using LISREL Confirmatory Factor Analysis

Abstract

Get full access to this article

References