Estimation of Reliability and Stability in Single-Indicator Multiple-Wave Models

Abstract

This article focuses on three main points: (1) Because a short-wave panel study such as the ALLBUS-Retest Study 1984 is suited optimally for reliability estimations, the quality of a larger number of items concerning attitudes about the welfare state and inequality and toward a minority group in West Germany (“guestworkers”) is investigated; (2) we show that most of the items are more reliable in the subgroup with high political interest than in the low-interest group; and (3) because we cannot rely on multiple indicators in most of the cases, methods and statistical models for the analysis of single indicators in multiple-wave panels are discussed. Because we can assume that the latent attitudes are continuous and the observed variables have ordered categories (at least), we confine our analyses to metric variable models. We show that (a) the assumptions underlying the classical models proposed by Heise (1969) and by Wiley and Wiley (1970, 1974) will often be violated if the times between the panel waves are very short; (b) frequently, models of parallel or tau-equivalent measurement, or some modifications of these models lead to parameter estimates that are more plausible from a theoretical point of view; (c) the ML- and ULS-estimators for these models can be easily calculated; (d) the use of polychoric correlation coefficients for these models is more appropriate if the observed variables have a badly skewed distribution and a small number of categories.

Get full access to this article

View all access options for this article.

References

ALWIN, D. F. and D. J. JACKSON (1980) “Measurement models for response errors in surveys: issues and applications,” pp. 69-119 in K. F. Schuessler (ed.) Sociological Methodology 1980. San Francisco: Jossey-Bass.

BECK, P. A. (1975) “Models for analyzing panel data: a comparative review.” Pol. Methodology 2: 357-380.

BENTLER, P. M. and D. G. BONETT (1980) “Significance tests and goodness of fit in the analysis of covariance structures.” Psych. Bul. 88: 588-606.

COLEMAN, J. S. (1964) Models of Change and Response Uncertainty. Englewood Cliffs, NJ: Prentice-Hall.

CONVERSE, P. E. (1964) “The nature of belief systems in mass publics,” pp. 206-261 in D. E. Apter (ed.) Ideology and Discontent. New York: Free Press.

CONVERSE, P. E. (1970) “Attitudes and non-attitudes: continuation of a dialogue,” pp. 168-189 in E. R. Tufte (ed.) The Quantitative Analysis of Social Problems. Reading, MA: Addison-Wesley.

CONVERSE, P. E. (1980) “Rejoinder to Judd and Milburn.” Amer. Soc. Rev. 45: 644-646.

CONVERSE, P. E. and G. B. MARKUS (1979) “Plus ca change...: the new CPS election study panel.” Amer. Pol. Sci. Rev. 73: 32-49.

FISHBEIN, M. (1967) “Attitudes and the prediction of behavior,” pp. 447-492 in M. Fishbein (ed.) Readings in Attitude Theory and Measurement. New York: John Wiley.

10.

HEISE, D. R. (1969) “Separating reliability and stability in test-retest-correlation.” Amer. Soc. Rev. 34: 93-101.

11.

HEISE, D. R. and G. W. BOHRNSTEDT (1970) “Validity, invalidity and reliability,” pp. 104-129 in E. F. Borgatta and G. W. Bohrnstedt (eds.) Sociological Methodology 1970. San Francisco: Jossey-Bass.

12.

JAGODZINSKI, W. (1981) “Sozialstruktur, wertorientierungen und parteibindung: zur problematik eines socialisationsmodells.” Zeitschrift für Soziologie 10: 170-191.

13.

JAGODZINSKI, W. (1984) “Wie transformiert man labile in stabile relationen? Zu den problemen der minderungskorrektur mit LISREL.” Zeitschrift für Soziologie 13: 225-242.

14.

JAGODZINSKI, W. (1986) “Maximum likelihood estimation and unweighted least squares estimation in the parallel measurement model.” Unpublished manuscript, Bremen.

15.

JOHNSON, D. R. and R. C. CREECH (1983) “Ordinal measures in multiple indicator models.” Amer. Soc. Rev. 48: 398-407.

16.

JÖRESKOG, K. G. (1971) “Statistical analysis of sets of congeneric tests.” Psychometrica 36: 109-133.

17.

JÖRESKOG, K. G. and D. SÖRBOM (1977) “Statistical models and methods for analysis of longitudinal data,” pp. 285-352 in D. J. Aigner and A. S. Goldberger (eds.) Latent Variables in Socio-Economic Models. Amsterdam: North Holland.

18.

JÖRESKOG, K. G. and D. SÖRBOM (1985) “LISREL VI User's Guide.” Uppsala.

19.

JUDD, C. M. , J. A. KROSNICK , and M. A. MILBURN (1981) “Political involvement and attitude structure in the general public.” Amer. Soc. Rev. 46: 660-669.

20.

JUDD, C. M. and M. A. MILBURN (1980) “The structure of attitude systems in the general public: comparisons of a structural equations model.” Amer. Soc. Rev. 45: 627-643.

21.

KESSLER, R. C. and D. F. GREENBERG (1981) Linear Panel Analysis: Models of Quantitative Change. New York: Academic Press.

22.

KLINGEMANN, H. D. (1979) “Measuring ideological conceptualizations,” pp. 215-254 in S. H. Barnes and M. Kaase (eds.) Political Action. Mass Participation in Five Western Democracies. Newbury Park, CA: Sage.

23.

KROMREY, H. (1980) Empirische Sozialisationsforschung: Modelle und Methoden der Datenerhebung und Auswertung. Opladen: Leske.

24.

LORD, F. M. and M. R. NOVICK (1968) Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.

25.

MARKUS, G. B. (1979) Analyzing Panel Data. Newbury Park: Sage.

26.

MARTIN, S. S. (1981) “New methods leads to familiar results: comment on Judd and Milburn (ASR 1980).” Amer. Soc. Rev. 46: 670-675.

27.

MILBURN, M. A. and C. M. JUDD (1981) “Interpreting new methods in attitude structure research (reply to Martin).” Amer. Soc. Rev. 46: 675-677.

28.

OLSSON, U. (1979) “Maximum likelihood estimation of the polychoric correlation coefficient.” Psychometrica 44: 443-460.

29.

OLSSON, U. , E. DRASGOW , and N. J. DORANS (1982) “The polyserial coefficient.” Psychometrica 47: 337-347.

30.

SARIS, W. E. , M. DE PIJPER , and J. MULDER (1978) “Optimal procedures for estimation factor scores.” Soc. Methods and Research 7: 85-105.

31.

SOBEL, M. E. and G. W. BOHRNSTEDT (1985) “Use of null models in evaluating the fit of covariance structure models,” pp. 152-178 in N. B. Tuma (ed.) Sociological Methodology 1985. San Francisco: Jossey-Bass.

32.

WEGENER, B. (1983) “Wer skaliert? Die meBfehler-testtheorie und die frage nach dem akteur,” pp. T1-T110 in J. Allmendinger et al. (eds.) ZUMA-Handbuch sozialwissenschaftlicher Skalen. Bonn: Informationszentrum Sozialwissenschaften.

33.

WHEATON, B. , B. MUTHEN , D. E. ALWIN , and G. F. SUMMERS (1977) “Assessing reliability and stability in panel models,” pp. 84-136 in D. R. Heise (ed.) Sociological Methodology 1978. San Francisco: Jossey-Bass.

34.

WIGGINS, L. F. (1973) Panel Analysis: Latent Probability Models for Attitude and Behavior Processes. New York: Elsevier.

35.

WILEY, D. E. and J. A. WILEY (1970) “The estimation of measurement error in panel data.” Amer. Soc. Rev. 35: 112-117.

36.

WILEY, J. A. and M. G. WILEY (1974) “A note on correlated errors in repeated measurements.” Soc. Methods and Research 3: 172-187.

37.

YULE, G. U. and M. G. KENDALL (1986) An Introduction to the Theory of Statistics (14th ed.) London: Griffin.