Evaluators designing evaluation studies that are responsive to the interests of the different stakeholding audiences have to cope with conflicts and constraints from the very beginning of their work. This article describes a tool for a stakeholder-orientated evaluation approach which combines Nominal Group Techniques and the Moderation Method. The tool is presented in a detailed scenario for an evaluation design context. The paper concludes with an assessment of the utility and areas of application of the RENOMO instrument.
Get full access to this article
View all access options for this article.
References
1.
AEA (1995) ‘Guiding Principles for Evaluators’, in W. R. Shadish (ed.) Guiding Principles for Evaluators. San Francisco, CA: Jossey-Bass.
2.
Bartunek, J. M. and J. K. Murninghan (1984) ‘The Nominal Group Technique: Expanding the Basic Procedure and Underlying Assumptions’, Group and Organization Studies9(3): 417–432.
3.
Beywl, W. (1988) Zur Weiterentwicklung der Evaluationsmethodologie. Frankfurt: Peter Lang.
4.
Carney, O. , J. McIntosh and A. Worth (1996) ‘The Use of the Nominal Group Technique in Research with Community Nurses’, Journal of Advanced Nursing23: 1024–1029.
5.
Cohn, R. C. (1975) Von der Psychoanalyse zur Themenzentrieten Interaktion. Stuttgart: Klett-Cotta.
6.
Delbeq, A. L. , A. Van de Ven and D. H. Gustafson (1975) Group Techniques for Program Planning: A Guide to Nominal Group and Delphi ProcessesGlenview: Scott Foresman.
7.
Fetterman, D. M. , S. J. Kaftarian and A. Wandersman (eds) (1995) Empowerment Evaluation: Knowledge and Tools for Self-Assessment and AccountabilityThousand Oaks, CA: Sage.
8.
Frankel, S. (1987) ‘NGT 1 MDS: An Adaptation of the Nominal Group Technique for Ill-Structured Problems’, Journal of Applied Behavioral Science23(4): 543–551.
9.
Greene, J. G. (1988) ‘Stakeholder Participation and Utilization in Program Evaluation’, Evaluation Review2: 91–116.
10.
Greene, J. C. (1994) ‘Qualitative Program Evaluation: Practice and Promise’, in N. K. Denzin and Y. S. Lincoln (eds) Handbook of Qualitative Research. Thousand Oaks, CA: Sage.
11.
Guba, E. G. and Y. S. Lincoln (1989) Fourth Generation Evaluation. Newbury Park, CA: Sage.
12.
Guba, E. G. and Y. S. Lincoln (1994) ‘Competing Paradigms in Qualitative Research’, in N. K. Denzin and Y. S. Lincoln (eds) Handbook of Qualitative Research. Thousand Oaks, CA: Sage.
13.
Habermas, J. (1984) The Theory of Communicative Action. Boston, MA: Beacon Press.
14.
Heiner, M. (ed.) (1996) Qualitätsentwicklung durch Evaluation. Freiburg: Lambertus.
15.
Klebert, K. , E. Schrader and W. G. Straub (1985) Moderationsmethode. Hamburg: Windmühle.
16.
Klebert, K. , E. Schrader and W. G. Straub (1987) Kurzmoderation. Anwendung der Moderationsmethode in Betrieb, Schule und Hochschule, Kirche und Politik, Sozialbereich und Familie bei Besprechungen und Praesentationen. Hamburg: Windmühle.
17.
Klebert, K. , E. Schrader and W. G. Straub (1992) Winning Group Results: Techniques for Guiding Group Thought and Decision Making Processes with the Moderation Method. Hamburg: Windmühle.
18.
Krueger, R. (1994) Focus Groups: A Practical Guide for Applied Research. Thousand Oaks, CA: Sage.
19.
Löhmer, Cornelia and Rüdiger Standhardt (eds) (1992) TZI: Pädagogisch-therapeutische Gruppenarbeit nach Ruth C. Cohn. Stuttgart: Klett-Cotta.
20.
Nevis, E. (1987) Organizational Consulting: A Gestalt Perspective. Cleveland: Gèstalt Institute of Cleveland Press.
21.
O’Neil, M. J. and L. Jackson (1983) ‘Nominal Group Technique: A Process for Initiating Curriculum Development in Higher Education’, Studies in Higher Education8(2): 129–138.
22.
Potter, P. (1997) ‘Responsive Evaluation als Katalysator für Selbst-Evaluationen’, Informationen zur Selbst-Evaluation 2.
23.
Schnelle, E. (1992) ’Wie die Werkstatt des Wandels entstand’ in Werkstatt des Wandels. Quickborn: Metaplan.
24.
Schobert, B. (1997) Aufgabenorientierte Gruppentechniken—ein Vergleich der Nominal Group Technique und der Moderationsmethode. Köln: dissertation.
25.
Scriven, M. (1996) ‘Evaluation—The State of the Art’, Evaluation News and Comment5(2).
26.
Shadish, W. , T. Cook and L. C. Leviton (1991) Foundations of Program Evaluation. Theories of Practice. Beverly Hills, CA: Sage.
27.
Stake, R. (1975) Evaluating the Arts in Education: A Responsive Approach. Columbus, OH: Merrill.
28.
Van de Ven, A. and A. L. Delbeq (1971) ‘Nominal vs. Interacting Group Processes for Committee Decision-Making Effectiveness’, Academy of Management Journal June: 203–12.
29.
Wohlgemüth, A. C. (ed.) (1993) Moderation in Organizationen. Problemloesungsmethode fuer Führungsleute und BeraterBern: Haupt.
30.
Wollmann, H. (1996) Begleitung und Bewertung in der EU Strukturfonds-Förderung—Möglichkeiten und GrenzenPaper presented at the European Conference on Evaluation Methods for Structural Funds Interventions. Berlin.
