The authors developed hypotheses about the effectiveness of response rate techniques for organizational researchers surveying executives. Using meta-analytic procedures to test those hypotheses, the authors analyzed response rate data from 231 studies that surveyed executives and appeared in top management journals from 1992 to 2003. They found mean response rates to be declining over the period, yielding an overall 32% rate. Of the various methods suggested to increase response rates in other populations, none were found to be effective for executives. However, topical salience and sponsorship by an organization or person in the executive's social networks did bring about response rate increases. The authors provide recommendations about what (not) to do when trying to collectoriginal data from members of a firm's upper echelons.
Babbie, E. (1990). Survey research methods. Belmont, CA: Wadsworth.
2.
Barnard, C. I. (1938). The functions of the executive. Cambridge, MA: Harvard University Press.
3.
Baruch, Y. (1999). Response rate in academic studies: A comparative analysis. Human Relations, 52, 421-438.
4.
Bowen, S. A. (2002). Elite executives in issues management: The role of ethical paradigms in decision making. Journal of Public Affairs, 2, 240-254.
5.
Boyd, B. F., & Falk, J. (1996). Executive scanning and perceived uncertainty: A multidimensional model. Journal of Management, 22, 1-21.
6.
Boyd, B. K., & Reuning-Elliott, E. (1998). A measurement model of strategic planning. Strategic Management Journal, 19, 181-192.
7.
Brass, D. J. (1995). A social network perspective on human resources management. Research in Personnel and Human Resources Management, 13, 39-79.
8.
Brunsson, N. (1989). The organization of hypocrisy: Talk, decisions and actions in organizations. New York: John Wiley.
9.
Church, A. H. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62-79.
10.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
11.
Cook, T. D., & Campbell, D. T. (1976). The design and conduct of quasi-experiments and true experiments in field settings. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 223-326). Chicago: Rand-McNally.
12.
Cooper, C. L., & Payne, R. (1988). Causes, coping and consequences of stress at work. Chichester, UK: Wiley.
13.
Cordano, M., & Frieze, I. H. (2000). Pollution reduction preferences of U.S. environmental managers: Applying Ajzen's theory of planned behavior. Academy of Management Journal, 43, 627-641.
14.
Cycyota, C. S., & Harrison, D. A. (2002). Enhancing survey response rates at the executive level: Are employeeor consumer-level techniques effective?Journal of Management, 28, 151-177.
15.
Darlington, R. (1990). Regression and linear models. New York: McGraw-Hill.
16.
D’Aveni, R. A. (1995). Hypercompetitive rivalries. New York: Free Press.
17.
Dillman, D. A. (1978). Mail and telephone surveys: The total design method. New York: John Wiley.
18.
Dillman, D. A. (1991). The design and administration of mail surveys. Annual Review of Sociology, 17, 225-250.
19.
Dillman, D. A. (2000). Mail and Internet surveys: The tailored design method. New York: John Wiley.
20.
Dooley, R. S., Fryxell, G. E., & Judge, W. Q. (2000). Belaboring the not-so-obvious: Consensus, commitment, and strategy implementation speed and success. Journal of Management, 26, 1237-1257.
21.
Dutton, J. E., & Jackson, S. E. (1987). Categorizing strategic issues: Links to organizational action. Academy of Management Review, 12, 76-90.
22.
Eccles, R. G., & Nohria, N. (1992). Beyond the hype: Rediscovering the essence of management. Boston: Harvard Business School Press.
23.
Extejt, M. M., & Smith J. E. (1990). The behavioral sciences and management: An evaluation of relevant journals. Journal of Management, 16, 539-551.
24.
Falconer, D., & Hodgett, R. A. (1999). Why executives don’t respond to your survey. In Proceedings of the 10th Australasian Conference on Information Systems (pp. 279-285). Atlanta, GA: Association for Information Systems.
25.
Fombrun, C. J. (1996). Reputation: Realizing value from the corporate image. Boston: Harvard Business School Press.
26.
Fox, R. J., Crask, M. R., & Kim, J. (1988). Mail survey response rates: A meta-analysis of selected techniques for inducing responses. Public Opinion Quarterly, 52, 467-491.
27.
Franke, R. H., Edlund, T. W., & Oster F., III. (1990). The development of strategic management: Journal quality and article impact. Strategic Management Journal, 11, 243-253.
28.
Gibson, C. B., & Zellmer-Bruhn, M. E. (2001). Metaphors and meaning: An intercultural analysis of the concept of teamwork. Administrative Science Quarterly, 46, 274-304.
29.
Granovetter, M. (1973). The strength of weak ties. American Journal of Sociology, 78, 1360-1380.
30.
Granovetter, M. (1985). Economic action and social structure: The problem of embeddedness. American Journal of Sociology, 91, 481-510.
31.
Gupta, N., Shaw, J. D., & Delery, J. E. (2000). Correlates of response outcomes among organizational key informants. Organizational Research Methods, 3, 323-347.
32.
Hambrick, D. C., Finkelstein, S., & Mooney, A. C. (2005). Executive job demands: New insights for explaining strategic decisions and leader behaviors. Academy of Management Review, 30, 472-491.
33.
Hambrick, D. C., Geletkanycz, M. A., & Fredrickson. J. W. (1993). Top executive commitment to the status quo: Some tests of its determinants. Strategic Management Journal, 14, 401-418.
34.
Heberlein, T. A., & Baumgartner, R. (1978). Factors affecting response rates to mailed questionnaires: A quantitative analysis of published literature. American Sociological Review, 43, 447-462.
35.
Hertz, R., & Imber, J. B. (Eds.). (1995). Studying elites using qualitative methods. Thousand Oaks, CA: Sage.
36.
Hirsch, P. M. (1995). Tales from the field: Learning from researchers’ accounts. In R. Hertz, J. B. Imber (Eds.), Studying elites using qualitative methods (pp. 72-79). Thousand Oaks, CA: Sage.
37.
Hopkins, K. D., & Gullickson, A. R. (1993). Response rates in survey research: A meta-analysis of the effects of monetary gratuities. Journal of Experimental Education, 61, 52-62.
38.
Huselid, M. A., & Becker, B. E. (2000). Comment on “Measurement error in research on human resources and firm performance: How much error is there and how does it influence effect size estimates?” by Gerhart, Wright, McMahan, & Snell. Personnel Psychology, 53, 835-854.
39.
James, J. M., & Bolstein, R. (1990). The effect of monetary incentives and follow-up mailings on the response rate and response rate quality in mail surveys. Public Opinion Quarterly, 54, 346-361.
40.
Kelley, H. H., & Thibaut, J. W.1978. Interpersonal relationships: A theory of interdependence. New York: John Wiley.
41.
Kilduff, M., & Krackhardt, D. (1994). Bringing the individual back in: A structural analysis of the internal market for reputation in organizations. Academy of Management Journal, 37, 87-108.
42.
Klass, B.S. (1999). Containing compensation costs: Why firms differ in their willingness to reduce pay. Journal of Management, 25, 829-850.
43.
Kumar, N., Stern, L. W., & Anderson, J. C. (1993). Conducting interorganizational research using key informants. Academy of Management Journal, 36, 1633-1651.
44.
Lane, P. J., & Lubatkin, M. (1998). Relative absorptive capacity and interorganizational learning. Strategic Management Journal, 19, 461-477.
45.
Leong, F. T. L., & Austin, F. T. (1996). The psychology research handbook. Thousand Oaks, CA: Sage.
46.
Martin, W. S., Duncan, W. J., Powers, T. L., & Sawyer, J. C. (1989). Costs and benefits of selected response inducement techniques in mail survey research. Journal of Business Research, 19, 67-79.
47.
Mavis, B., & Brocato, J. (1998). Postal surveys versus electronic mail surveys. Evaluation and the Health Professions, 50, 395-401.
48.
Nahapiet, J., & Ghoshal, S. (1998). Social capital, intellectual capital, and the organizational advantage. Academy of Management Review, 23, 242-266.
49.
Nohria, N. (1994). Introduction: Is a network perspective a useful way of studying organizations? In N. Nohria & R. G. Eccles (Eds.), Networks and organizations: Structure, form and action (pp. 1-22). Boston: Harvard Business School Press.
50.
Norburn, D., & Birley, S. (1988). The top management team and corporate performance. Strategic Management Journal, 9, 225-237.
51.
Penrose, E. T. (1959). The theory of the growth of the firm. New York: John Wiley.
52.
Podsakoff, P. M., MacKenzie, S. B., Bachrach, D. G., & Podsakoff, N. P. (2005). The influence of management journals in the 1980's and 1990's. Strategic Management Journal, 26, 473-488.
53.
Polanyi, M.1961. The tacit dimension. Garden City, NJ: Doubleday.
54.
Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638-641.
55.
Rossi, P. H., Wright, J. D., & Anderson, A. B. (1983). Handbook of survey research. New York: Academic Press.
56.
Roth, P. L., & BeVier, C. A. (1998). Response rates in HRM/OB survey research: Norms and correlates, 19901994. Journal of Management, 24, 97-117.
57.
Schaefer, D. R., & Dillman, D. A. (1998). Development of a standard e-mail methodology: Results of an experiment. Public Opinion Quarterly, 62, 378-397.
58.
Starbuck, W. (2003). Impact rankings in 2002. Retrieved from http://www.stern.nyu.edu/%7Ewstarbuc/cites.html
59.
Steensma, H. K., Marino, L., Weaver, K. M., & Dickson, P. H. (2000). The influence of national culture on the formation of technological alliances by entrepreneurial firms. Academy of Management Journal, 43, 951-973.
60.
Sutcliffe, K. M. (1994). What executives notice: Accurate perceptions in top management teams. Academy of Management Journal, 37, 1360-1378.
61.
Thomas, R. J. (1993). Interviewing important people in big companies. Journal of Contemporary Ethnography, 22, 80-96.
62.
Thompson, K. M., & Bloom, D. L. (2000). Communication of risk assessment information to risk managers. Journal of Risk Research, 3,4-4.
63.
Tomaskovic-Devey, D., Leiter, J., & Thompson, S. (1994). Organizational survey nonresponse. Administrative Science Quarterly, 39, 439-457.
64.
Trieschmann, J. S., Dennis, A. R., Northcraft, G. B., & Niemi, A. W., Jr. (2000). Serving multiple constituencies in business schools: M.B.A. program versus research performance. Academy of Management Journal, 43, 1130-1142.
65.
Useem, M. (1995). Reaching corporate executives. In R. Hertz & J. B. Imber (Eds.), Studying elites using qualitative methods (pp. 18-39). Thousand Oaks, CA: Sage.
66.
Venkatraman, N., & Prescott, J. E. (1990). Environment-strategy co-alignment: An empirical test of its performance implications. Strategic Management Journal, 11, 1-24.
67.
Viswesvaran, C., Barrick, M. B., & Ones, D. S. (1993). How definitive are conclusions based on survey data: Estimating robustness to nonresponse. Personnel Psychology, 46, 551-567.
68.
Viswesvaran, C., & Ones, D. S. (1995). Theory testing: Combining psychometric meta-analysis and structural equations modeling. Personnel Psychology, 48, 865-885.
69.
Weiss, A. M., & Kurland, N. (1997). Holding distribution channel relationship together: The role of transactionspecific asset and length of prior relationship. Organization Science, 8, 612-623.
70.
Wright, P. M., Gardner, T. M., Moynihan, L. M., Park, H. J., Gerhart, B., & Delery, J. E. (2001). Measurement error in research on human resources and firm performance: Additional data and suggestions for future research. Personnel Psychology, 54, 875-902.
71.
Yammarino, F. J., Skinner, S. J., & Childers, T. L. (1991). Understanding mail survey response behavior. Public Opinion Quarterly, 55, 613-629.
72.
Yu, J., & Cooper, H. (1983). A quantitative review of research design efforts on response rates to questionnaires. Journal of Marketing Research, 20, 36-44.
73.
Zegers, F. E. (1991). Coefficients for inter-rater agreement. Applied Psychological Measurement, 15, 321-333.
