A meta-evaluation is an assessment of evaluation practices. Meta-evaluations include assessments of validity and usefulness of two or more studies focused on the same issues. This article describes specific recommendations on how to achieve effective performance audits of government tourism-marketing departments and programs, as well as how to achieve effective tourism-marketing programs.
Get full access to this article
View all access options for this article.
References
1.
Armstrong, J. Scott (1982). “The Value of Formal Planning for Strategic Decisions: Review of Empirical Research.”Strategic Management Journal, 3: 197-211.
2.
Armstrong, J. Scott (1985). Long-Range Forecasting: From Crystal Ball to Computer. New York: John Wiley.
3.
Arnould, Eric J., and Melanie Wallendorf (1994). “Market-Oriented Ethnography: Interpretation Building and Marketing Strategy Formulation.”Journal of Marketing Research, 31 (November): 484-503.
4.
The Auditor (1994). Manual of Guides. Honolulu, Hawaii: The Auditor.
5.
Australia (1993). Evaluation of the Australian Tourist Commission’s Marketing Impact. Sydney: Australian Tourist Commission.
6.
Banks, Seymour (1965). Experimentation in Marketing. New York: McGraw-Hill.
7.
Bellavita, C., J. S. Wholey, and M. A. Abramson (1986). “Performance-Oriented Evaluation: Prospects for the Future.” In Performance and Credibility: Developing Excellence in Public and Nonprofit Organizations, edited by J. S. Wholey, M. A. Abramson, and C. Bellavita. Lexington, MA: Lexington Books, pp. 57-82.
8.
Bitner, Mary Jo, Bernard H. Booms, and Lois A. Mohr (1994), “Critical Service Encounters: The Employee’s View,”Journal of Marketing, 58 (October): 95-106.
9.
Boland, R. J., Jr. (1993). “Accounting and the Interpretive Act.”Accounting, Organizations, and Society, 18: 125-146.
10.
Bonoma, Thomas V. (1985). The Marketing Edge: Making Strategies Work. New York: Free Press.
11.
Brooks, Roger A. (1997). “Evaluation and Auditing in State Legislature.” In Evaluation for the 21st Century: A Handbook, edited by Eleanor Chelimsky and William R. Shadish. Thousand Oaks, CA: Sage, pp. 109-120.
12.
Bulkeley, William M. (1993). “Marketers Mine Their Corporate Databases.”Wall Street Journal, June 14, B6.
13.
Buzzell, Robert D., and Bradley T. Gale (1987). The PIMS Principles: Linking Strategy to Performance. New York: Free Press.
14.
Campbell, Donald T. (1969). “Reforms as Experiments.”American Psychologist, 24: 409-429.
15.
Originally published in M. Brenner, P. Marsh, and M. Brenner, eds., The Social Contexts of Method (London: Croom Helm, pp. 184-209).
Chen, H., and Peter H. Rossi (1983). “Evaluating with Sense: The Theory-Driven Approach.”Evaluation Review, 7: 283-302.
18.
Clifford, Donald K., Jr., and Richard E. Cavanagh (1985). The Winning Performance. Toronto: Bantam Books.
19.
Cook, Thomas D. (1997). “Lessons Learned in Evaluation over the Past 25 Years.” In Evaluation for the 21st Century, edited by Eleanor Chelimsky and William R. Shadish. Thousand Oaks, CA: Sage, pp. 15-46.
20.
Daft, R. L., and K. E. Weick (1984). “Toward a Model of Organizations as Interpretation Systems.”Academy of Management Review, 9: 284-295.
21.
Dybka, Jerry M. (1987). “A Look at the American Traveler: The U.S. Pleasure Travel Market Study.”Journal of Travel Research, 25 (Winter): 2-4.
22.
Faulkner, Bill (1997). “A Model for the Evaluation of National Tourism Destination Marketing Programs.”Journal of Travel Research, 35 (3): 23-32.
23.
Garvin, David A. (1987). “Competing on the Eight Dimensions of Quality.”Harvard Business Review, 65: 101-109.
24.
Geertz, Clifford (1973). The Interpretation of Cultures. New York: Basic Books.
25.
Gilovich, Thomas (1991). How We Know What Isn’t So. New York: Free Press.
26.
Goetsch, H. W. (1993). Developing, Implementing and Marketing an Effective Marketing Plan. Chicago: American Marketing Association; Lincolnwood, IL: NTC Business Books.
27.
Hall, Roger I., Peter W. Aitchison, and William L. Kocay (1994). “Causal Policy Maps of Managers: Formal Methods for Elicitation and Analysis.”System Dynamics Review, 10 (4): 337-360.
28.
Hawaii (1987). Management Audit of the Hawaii Visitors Bureau and the State’s Tourism Program. Report 87-14. February. Honolulu: Legislative Auditor of the State of Hawaii.
29.
Hawaii (1993). Management and Financial Audit of the Hawaii Visitors Bureau. Report 93-25. December. Honolulu: The Auditor, State of Hawaii.
Kay, John (1995). Why Firms Succeed. New York: Oxford University Press.
32.
Kotler, Philip (1997). Marketing Management. 9th ed.Upper Saddle River, NJ: Prentice Hall.
33.
Minnesota (1985). Economic Development. Saint Paul: Program Evaluation Division, Office of the Legislative Auditor, State of Minnesota.
34.
Mintzberg, Henri (1978). “Patterns in Strategy Formation.”Management Science, 24: 934-948.
35.
Missouri (1996). Special Review of the Department of Economic Development, Division of Tourism. Report 6-86. November 14. Jefferson City: Offices of the State Auditor of Missouri.
36.
North Carolina (1989). Performance Audit: Department of Commerce, Division of Travel and Tourism and North Carolina Film Office. Raleigh, NC: Office of the State Auditor.
37.
Patton, Michael Quinn (1997). Utilization-Focused Evaluation. 3ded.Thousand Oaks, CA: Sage.
38.
Pollitt, Christopher, and Hilkka Summa (1997). “Performance Auditing.” In Evaluation for the 21st Century. Thousand Oaks, CA: Sage, pp. 99-122.
39.
Price, Linda L., Eric J. Arnould, and Patrick Tierney (1995). “Going to Extremes: Managing Service Encounters and Assessing Provider Performance.”Journal of Marketing, 59 (April): 83-97.
40.
Ramond, Charles (1966). Measurement of Advertising Effectiveness. Menlo Park, CA: Stanford Research Institute.
41.
Schoenbachler, D. D., C. A. di Benedetto, G. L. Gordon, and P. F. Kaminski (1995). “Destination Advertising: Assessing Effectiveness with Split-Run Technique.”Journal of Travel & Tourism Marketing, 4 (2): 1-21.
42.
Scott, Mark C. (1998). Value Drivers. Chichester, UK: Wiley.
43.
Scriven, Michael S. (1969). “An Introduction to Meta-Evaluation.”Education Report, 2: 36-38.
44.
Scriven, Michael S. (1974). “Evaluation Perspectives and Procedures.” In Evaluation in Education: Current Application, edited by J. W. Popham. Berkeley, CA: McCutchan, pp. 3-93.
45.
Scriven, Michael S. (1995). “The Logic of Evaluation and Evaluation Practice.” In Reasoning in Evaluation: Inferential Links and Leaps, edited by D. M. Fournier. San Francisco: Jossey-Bass, pp. 49-70.
46.
Senge, Peter (1990). The Fifth Discipline. New York: Doubleday.
47.
Shadish, William R., Jr., Thomas D. Cook, and Laura C. Leviton (1991). Foundations of Program Evaluation. Newbury Park, CA: Sage.
48.
Shostack, G. Lynn (1987). “Service Positioning Through Structural Change.”Journal of Marketing, 51 (January): 34-53.
49.
Stake, Robert E. (1980). “Program Evaluation, Particularly Responsive Evaluation.” In Rethinking Educational Research, edited by W. B. Dockrell and D. Hamilton. London: Hodder and Stroughton, pp. 188-203.
50.
Stake, Robert, Christopher Migotsky, Rita Davis, Edith J. Cisneros, Gary DePaul, Christopher Dunbar, Jr., Raquel Farmer, Joan Feltovich, Edna Johnson, Brent Williams, Martha Zurita, and Iduina Chaves (1997). “The Evolving Syntheses of Program Value.”Evaluation Practice, 18 (2): 89-103.
51.
Stubbart, Charles, and Arkalgud Ramaprasad (1988). “Probing Two Chief Executives’ Schematic Knowledge on the U.S. Steel Industry by Using Cognitive Maps.”Advances in Strategic Management, 5: 139-164.
52.
Teas, R. Kenneth (1993). “Expectations, Performance Evaluation, and Consumers’ Perceptions of Quality.”Journal of Marketing, 57 (4): 18-34.
53.
Tennessee (1995). Performance Audit: Department of Tourist Development. Nashville: State of Tennessee, Comptroller of the Treasury, Department of Audit, Division of State Audit.
54.
Weick, Karl E. (1979). The Social Psychology of Organizing. New York: McGraw-Hill.
55.
Weick, Karl E. (1995). Sensemaking in Organizations. Thousand Oaks, CA: Sage.
56.
Weiss, Carol H. (1972). Evaluation Research: Methods for Assessing Program Effectiveness. Englewood Cliffs, NJ: Prentice Hall.
57.
Weiss, Carol H. (1987). “Evaluation Social Programs: What Have We Learned?”Society, 25 (1): 40-45.
58.
Wholey, J. S. (1977). “Evaluability Assessment.” In Evaluation Research Methods: A Basic Guide, edited by L. Rutman. Beverly Hills, CA: Sage.
59.
Wholey, J. S. (1983). Evaluation and Effective Public Management. Boston: Little, Brown.
60.
Woodside, Arch G. (1990). “Measuring Advertising Effectiveness in Destination Marketing Strategies.”Journal of Travel Research, 29 (2): 3-8.
61.
Woodside, Arch G. (1996). Measuring the Effectiveness of Image and Linkage Advertising. Westport, CT: Quorum Books.
62.
Woodside, Arch G., and William H. Motes (1981). “Sensitivities of Market Segments to Separate Advertising Strategies.”Journal of Marketing, 45 (Winter): 63-73.
63.
Woodside, Arch G., and Ilkka A. Ronkainen (1982). “Travel Advertising: Newspapers versus Magazines.”Journal of Advertising Research, 22 (June): 39-43.
64.
Woodside, Arch G., and Marcia Y. Sakai (1999). “Evaluating Government Tourism Planned and Realized Marketing Strategies.” Working paper, School of Marketing, University of New South Wales, Sydney, Australia.
65.
Woodside, Arch G., and Praveen K. Soni (1990). “Performance Analysis of Advertising in Competing Media Vehicles.”Journal of Advertising Research, 30 (February-March): 53-66.
