This article evaluates the quality of instruments for measuring support in social networks. The authors discuss the results of ten experiments designed to analyze the reliability of five measurement scales as well as two measurement methods for listing alters (free recall and recognition), type of network question (original, reciprocated), and characteristics of study design (time between instrument presentations). Analysis shows that the binary scale and the first presentation of measurement instruments are the least reliable. The most reliable were ordinal scales, among which the five-category ordinal scale with labels was the most reliable. The two data collection methods (free recall and recognition) and the two types of network questions (original, reciprocated) yield equally reliable data.
Get full access to this article
View all access options for this article.
References
1.
Andrews, F. M.
, J. N. Morgan, J. A. Sonquist, and L. Klem. 1973. Multiple classifications analysis. Ann Arbor, MI: Institute for Social Research.
2.
Antonucci, T. C.
, and J. S. Jackson. 1990. The role of reciprocity in social support. In Social support: An interactional view, edited by B. R. Sarason, I. G. Sarason, and G. R. Pierce, 173–198. New York: John Wiley.
3.
Bernard, H. R.
, P. D. Killworth, and L. Sailer. 1980. Informant accuracy in social network data IV: A comparison of clique-level structure in behavioral and cognitive network data. Social Networks2:191–218.
4.
Bernard, H. R.
, P. D. Killworth, and L. Sailer. 1982. Informant accuracy in social network data V: An experimental attempt to predict actual communication from recall data. Social Science Research11:30–66.
5.
Bernard, H. R.
, G. A. Shelley, and P. D. Killworth. 1987. How much of a network does the GSS and RSW dredge up?Social Networks9:49–61.
6.
Bondonio, D.1998. Predictors of accuracy in perceiving informal social network. Social Networks20:301–330.
7.
Brewer, D. D.
, A. K. Romney, and W. H. Batchelder. 1991. Consistency and consensus: A replication. Journal of Qualitative Anthropology3:195–205.
8.
Brewer, D. D.
, and C. M. Webster. 1997. Recall and recognition of friends by residents of a university dormitory. Paper presented at the Seventeenth International Sunbelt Social Network Conference, San Diego, California.
9.
Burt, R. S.1984. Network items and the general social survey. Social Networks6:293–339.
10.
Burt, R. S.1986. A note on sociometric order in the General Social Survey network data. Social Networks8:149–174.
11.
Campbell, D. T.
, and D. W. Fiske. 1959. Convergent and discriminant validation by the multitrait multimethod matrices. Psychological Bulletin56:81–105.
12.
Campbell, K. E.
, and A. L. Lee. 1991. Name generators in surveys of personal networks. Social Networks13:203–221.
13.
Casciaro, T.1998. Seeing things clearly: Social structure, personality, and accuracy in social network perception. Social Networks20 (4): 331–354.
14.
Cauce, A. M.
, M. Reid, S. Landesman, and N. Gonzales. 1990. Social support in young children: Measurement, structure, and behavioral impact. In Social support: An interactional view, edited by B. R. Sarason, I. G. Sarason, and G. R. Pierce, 64–94. New York: John Wiley.
15.
Cohen, S.
, and T. A. Wills. 1985. Stress, social support, and the buffering hypothesis. Psychological Bulletin98 (2): 310–357.
16.
Duck, S.1997. Handbook of communication and emotion: Research, theory, applications and contexts. 2d ed.Chichester, UK: John Wiley.
17.
Ferligoj, A.
, and V. Hlebec. 1993. (In)sensitivity of centrality measurements in social networks. In Developments in statistics and methodology, Metodološki zvezki, edited by A. Ferligoj and T. Kramberger, Vol. 9, 139–145. Ljubljana, Slovenia: FDV.
18.
Ferligoj, A.
, and V. Hlebec. 1995a. Evaluating network data quality: An application of MTMM approach. In The multitrait-multimethod approach to evaluate measurement instruments, edited by W. Saris and Á Münnich, 155–172. Budapest, Hungary: Eötvös University Press.
19.
Ferligoj, A.
, and V. Hlebec. 1995b. Reliability of network measurements. In Contributions to methodology and statistics, Metodološki zvezk, edited by A. Ferligoj and T. Kramberger, Vol. 10, 219–232. Ljubljana, Slovenia: FDV.
20.
Ferligoj, A.
, and V. Hlebec. 1998. Quality of scales measuring complete social networks. In Advances in methodology, data analysis and statistics, Metodološki zvezk, edited by A. Ferligoj, Vol. 14, 173–186. Ljubljana, Slovenia: FDV.
21.
Ferligoj, A.
, and V. Hlebec. 1999. Evaluation of social network measurement instruments. Social Networks21:111–130.
22.
Gallup, G.1947. The quintamensional plan of question design. Public Opinion Quarterly11:385–393.
23.
Goodenow, C.
, S. T. Reisine, and K. E. Grady. 1990. Quality of social support and associated social and psychological functioning in women with rheumatoid arthritis. Health Psychology9 (3): 266–284.
24.
Granovetter, M.1982. The strength of weak ties. In Social structure and network analysis, edited by P. V. Marsden and N. Lin, 105–130. Beverly Hills, CA: Sage.
25.
Hammer, M.1984. Explorations into the meaning of social network interview data. Social Networks6:341–371.
26.
Hlebec, V.1993. Recall versus recognition: Comparison of two alternative procedures for collecting social network data. In Developments in statistics and methodology, Metodološki zvezki, edited by A. Ferligoj and T. Kramberger, Vol. 9, 121–128. Ljubljana, Slovenia: FDV.
27.
Hlebec, V.1999. Evaluation of survey measurement instruments for measuring social networks. Lubljana, Slovenia: FDV.
28.
Jöreskog, K. G.
, and D. Sörbom. 1986. LISREL VI: Analysis of linear structural relationships by maximum likelihood, instrumental variables, and least squares methods. Uppsala, Sweden: University of Uppsala.
29.
Jung, J.1997. Balance and source of social support in relation to well-being. Journal of General Psychology124 (1): 77–90.
30.
Killworth, P. D.
, and H. R. Bernard. 1976. Informant accuracy in social network data. Human Organization35 (3): 269–286.
31.
Killworth, P. D.
, H. R. Bernard, C. McCarty, G. A. Shelley, and S. Robinson1990. Comparing four different methods for measuring personal social networks. Social Networks12:179–215.
32.
Macur, M.
, and V. Hlebec. 1996. A combined qualitative and quantitative approach for analyzing the informal leadership of a choral society. In Developments in data analysis, Metodološki zvezki, edited by A. Ferligoj and T. Kramberger, Vol. 12, 185–194. Ljubljana, Slovenia: FDV.
33.
Marsden, P. V.1987. Core discussion networks of Americans. American Sociological Review52:122–131.
34.
Marsden, P. V.
, and K. E. Campbell. 1984. Measuring ties strength. Social Forces63 (2): 482–501.
35.
Moreno, J. L.1953. Who shall survive? Foundations of sociometry, group psychotherapy and sociodrama. New York: Beacon House.
36.
Pattison, P.1994. Social cognition in context. In Advances in social network analysis: Research in the social and behavioral sciences, edited by S. Wasserman and J. Galaskiewicz, 79–109. Thousand Oaks, CA: Sage.
37.
Payne, S. L.1951. The art of asking questions. Princeton, NJ: Princeton University Press.
38.
Romney, A. K.
, and S. C. Weller. 1984. Predicting informant accuracy from patterns of recall among individuals. Social Networks6:59–77.
39.
Romney, A. K.
, S. C. Weller, and W. H. Batchelder. 1986. Culture as consensus: A theory of culture and informant accuracy. American Anthropologist88:313–338.
40.
Rook, K. S.
, and D. Dooley. 1985. Applying social support research: Theoretical problems and future directions. Journal of Social Issues41 (1): 5–28.
41.
Rugg, D.
, and H. Cantril. 1944. The wording of questions. In Gauging public opinion, edited by H. Cantril et al., 23–50. Princeton, NJ: Princeton University Press.
42.
Sarason, B. R.
, I. G. Sarason, and R.A.R. Gurung. 1997. Close personal relationships and health outcomes: A key to the role of social support. In Handbook of communication and emotion: Research, theory, applications and contexts, edited by S. Duck, 2d ed., 547–574. Chichester, UK: John Wiley.
43.
Sarason, B. R.
, I. G. Sarason, and G. R. Pierce. 1990. Social support: An interactional view. New York: John Wiley.
44.
Saris, W. E.
, and F. M. Andrews. 1991. Evaluation of measurement instruments using a structural modeling approach. In Measurement errors in surveys, edited by P. P. Biemer et al., 575–599. New York: John Wiley.
45.
Scherpenzeel, A.1995. A question of quality: Evaluating survey questions by multitrait-multimethod studies. Amsterdam: Royal PTT.
46.
Sudman, S.1985. Experiments in the measurement of the size of social networks. Social Networks7:127–151.
47.
Sudman, S.1988. Experiments in measuring neighbor and relative social networks. Social Networks10:93–108.
48.
Vaux, A.1988. Social support: Theory, research, and intervention. New York: Praeger.
49.
Wellman, B.
, and S. Wortley. 1990. Different strokes from different folks: Community ties and social support. American Journal of Sociology96 (3): 558–588.
