Building Consensus Using the Policy Delphi Method

Abstract

This article describes the use of the policy Delphi method in building consensus for public policy and proposes a technique for measuring the degree of consensus. The policy Delphi method is a systematic method for obtaining, exchanging, and developing informed opinion on an issue. It can be used to develop consensus either for or against policy issues. The method includes a multistage process involving the initial measurement of opinions (first stage), followed by data analysis, design of a new questionnaire, and a second measurement of opinions (second stage). The interquartile deviation is presented as one way of measuring consensus, and the McNemar test is described as a way to quantify the degree of shift in responses from the first to second stage. The application of the method is illustrated by a case example from a study of state legislators’ views on tobacco policy.

Get full access to this article

View all access options for this article.

References

Alexandrov, A. V. , Pullicino, P. M. , Meslin, E. M. , & Norris, J. W. (1996). Agreement on disease-specific criteria for do-not-resuscitate orders in acute stroke. Stroke, 27, 232-237.

Centers for Disease Control and Prevention . (1998). State-specific prevalence among adults of current cigarette smoking and smokeless tobacco use and per capita tax-paid sales of cigarettes—United States, 1997. Morbidity and Mortality Weekly Report, 47, 922-926.

Cookson, P. S. (1986). Charting the unknown: Delphi and policy Delphi strategies for international co-operation. International Journal of Lifelong Education, 5(1), 3-13.

Crisp, J. , Pelletier, D. , Duffield, C. , Adams, A. , & Nagy, S. (1997). The Delphi method? Nursing Research, 46, 116-118.

Critcher, C. , & Gladstone, B. (1998). Utilizing the Delphi technique in policy discussion: A case study of a privatized utility in Britain. Public Administration, 76, 431-449.

Dalkey, N. , & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9, 458-467.

Dunn, W. N. (1994). Public policy analysis: An introduction (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.

Hahn, E. J. , & Rayens, M. K. (1999). Consensus for tobacco policy among former state legislators using the policy Delphi method. Tobacco Control, 8, 137-140.

Hahn, E. J. , Toumey, C. P. , Rayens, M. K. , & McCoy, C. (1999). Kentucky legislators’ views on tobacco. American Journal of Preventive Medicine, 16(2), 81-88.

10.

Hakim, S. , & Weinblatt, J. (1993). The Delphi process as a tool for decision making. Evaluation and Program Planning, 16, 25-38.

11.

Jairath, N. , & Weinstein, J. (1994). The Delphi methodology: Part 1. A useful administrative approach. Canadian Journal of Nursing Administration, 7(3), 29-42.

12.

Linstone, H. A. , & Turoff, M. (Eds.). (1975). The Delphi method: Techniques and application. Reading, MA: Addison-Wesley.

13.

McKenna, H. P. (1989). The selection by ward managers of an appropriate nursing model for long-stay psychiatric patient care. Journal of Advanced Nursing, 14, 762-775.

14.

McKenna, H. P. (1994). The Delphi technique: A worthwhile research approach for nursing? Journal of Advanced Nursing, 19, 1221-1225.

15.

McNemar, Q. (1947). Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika, 12, 153-157.

16.

Moore, S. , Wolfe, S. M. , Lindes, D. , & Douglas, C. E. (1994). Epidemiology of failed tobacco control legislation. Journal of the American Medical Association, 272, 1171-1175.

17.

Rainhorn, J. D. , Brudon-Jakobowicz, P. , & Reich, M. R. (1994). Priorities for pharmaceutical policies in developing countries: Results of a Delphi survey. Bulletin of the World Health Organization, 72, 257-264.

18.

Raskin, M. S. (1994). The Delphi study in field instruction revisited: Expert consensus on issues and research priorities. Journal of Social Work Education, 30, 75-89.

19.

Spinelli, T. (1983). The Delphi decision-making process. Journal of Psychology, 113, 73-80.

20.

Strauss, H. J. , & Zeigler, L. H. (1975). The Delphi technique and its uses in social science research. Journal of Creative Behavior, 9(4), 253-259.

21.

U.S. Department of Agriculture . (1999). Economic Research Service[Online]. Available: http://www.econ.ag.gov/briefing/tobacco.

22.

Welch, C. E. (Ed). (1999). State legislated actions on tobacco issues. Washington, DC: American Lung Association.