No single evaluation method, or method of directing organizational change, can cope with every issue faced when evaluating, or intervening in, service systems for people with disabilities. By identifying the strengths as well as the weaknesses of various methods, we might find that they complement one another. This paper explores this complementarity of different methods, pointing the way to a more flexible, responsive and critically aware evaluation and change practice. A framework of four methods is presented: PASS/ING, Viable System Diagnosis, Strategic Assumption Surfacing and Testing, and Soft Systems Methodology. These may be used in conjunction with one another to address a variety of ethical and organizational issues in the evaluation and change of service systems for people with disabilities.
Get full access to this article
View all access options for this article.
References
1.
Bateson, G. (1979) Mind and Nature: A Necessary Unity. London: Wildwood House.
2.
Beer, S. (1979) The Heart of Enterprise. Chichester : Wiley.
3.
Beer, S. (1981) Brain of the Firm, 2nd edn. Chichester: Wiley.
4.
Beer, S. (1985) Diagnosing the System for Organizations. Chichester: Wiley.
5.
Bohm, D. (1980) Wholeness and the Implicate Order. London: Ark.
6.
Bohr, N. (1963) Essays 1958/1962 on Atomic Physics and Human Knowledge . London: Interscience.
7.
Brown, H. and H. Smith, eds (1992) Normalization: A Reader for the Nineties. London: Routledge.
8.
Burrell, G. and G. Morgan (1979) Sociological Paradigms and Organizational Analysis . London: Heinemann.
9.
Burton, M. (1983) 'Understanding Mental Health Services: Theory and Practice', Critical Social Policy3: 54-74.
10.
Checkland, P.B. (1981) Systems Thinking, Systems Practice. Chichester: Wiley.
11.
Checkland, P.B. and J. Scholes (1990) Soft Systems Methodology in Action. Chichester: Wiley.
12.
Churchman, C.W. (1979) The Systems Approach and its Enemies. New York: Basic Books.
13.
Eden, C., S. Jones and D. Sims (1983) Messing About in Problems. Oxford: Pergamon.
14.
Flood, R.L. (1990) Liberating Systems Theory. New York: Plenum.
15.
Flood, R.L. (1995) Solving Problem Solving. Chichester : Wiley.
16.
Flood, R.L. and M.C. Jackson (1988) 'Cybernetics and Organization Theory: A Critical Review', Cybernetics and Systems19: 13-33.
17.
Flood, R. L. and M. C. Jackson , eds (1991a) Critical Systems Thinking: Directed Readings. Chichester: Wiley.
18.
Flood, R.L. and M.C. Jackson (1991b) Creative Problem Solving: Total Systems Intervention . Chichester: Wiley.
19.
Flood, R. L. and N. R. A. Romm, eds (1995) ' Enhancing the Process of Choice in TSI, and Improving Chances of Tackling Coercion', Systems Practice8: 377-408.
20.
Flood, R.L. and N.R.A. Romm (1996) Critical Systems Thinking: Current Research and Practice. New York: Plenum.
21.
Gregory, A.J. (1991) 'Which Evaluation Method When? A Contingency Approach to Evaluation', in M. C. Jackson, G. J. Mansell, R. L. Flood , R. B. Blackham and S. V. E. Probert (eds) Systems Thinking in Europe, pp. 435-41. New York: Plenum .
22.
Gregory, A.J. (1994) 'Organizational Evaluation: A Complementarist Approach' , PhD thesis, University of Hull.
23.
Gregory, A.J. (1995) 'Critical Reflections on the Past, Present and Future Development of Organizational Evaluation', in K. Ellis, A. Gregory, B. Mears-Young and G. Ragsdell (eds) Critical Issues in Systems Theory and Practice , pp. 479-86. New York: Plenum.
24.
Gregory, A.J. and M.C. Jackson (1992a) 'Evaluating Organizations: A Systems and Contingency Approach', Systems Practice5: 37-60.
25.
Gregory, A.J. and M.C. Jackson (1992b) 'Evaluation Methodologies: A System for Use', Journal of the Operational Research Society43: 19-28.
26.
Gregory, W.J. (1992) 'Critical Systems Thinking and Pluralism: A New Constellation', PhD Thesis, City University, London.
27.
Gregory, W.J. (1996) 'Dealing with Diversity', in R. L. Flood and N. R. A. Romm (eds) Critical Systems Thinking: Current Research and Practice. New York: Plenum .
28.
Jackson, M.C. (1982) 'The Nature of Soft Systems Thinking: The Work of Churchman, Ackoff and Checkland', Journal of Applied Systems Analysis9: 17-29.
29.
Jackson, M.C. (1987) 'New Directions in Management Science', in M. C. Jackson and P. Keys (eds) New Directions in Management Science. Aldershot: Gower.
30.
Jackson, M.C. (1989) 'Assumptional Analysis: An Elucidation and Appraisal for Systems Practitioners', Systems Practice2: 11-28.
31.
Jackson, M.C. (1990) 'Beyond a System of Systems Methodologies', Journal of the Operational Research Society41: 657-68.
32.
Jackson, M.C. (1991) Systems Methodology for the Management Sciences . New York: Plenum.
33.
Jackson, M.C. and P. Keys (1984) 'Towards a System of Systems Methodologies', Journal of the Operational Research Society35: 473-86.
34.
Jackson, M.C. and S. Medjedoub (1988) 'Designing Evaluation Systems: Theoretical Groundings and a Practical Intervention', in R. Trappl (ed.) Cybernetics and Systems. Dordrecht : Reidel.
35.
Jackson, N. and P. Carter (1991) 'In Defence of Paradigm Incommensurability', Organization Studies12: 109-27.
36.
Kilmann, R.H. (1983) 'A Dialectical Approach to Formulating and Testing Social Science Theories: Assumptional Analysis', Human Relations36: 1-22.
37.
Mason, R.O. and I.I. Mitroff (1981) Challenging Strategic Planning Assumptions. New York: Wiley.
38.
Maturana, H.R. and F.J. Varela (1992) The Tree of Knowledge: The Biological Roots of Human Understanding, revised edn. Boston, MA: Shambhala.
39.
Midgley, G. (1990) 'Creative Methodology Design', Systemist12: 108-13.
40.
Midgley, G. (1992) 'Pluralism and the Legitimation of Systems Science' , Systems Practice5: 147-72.
41.
Midgley, G. (1995a) 'What is this Thing Called Critical Systems Thinking ?', in K. Ellis, A. Gregory, B. Mears-Young , and G. Ragsdell (eds) Critical Issues in Systems Theory and Practice, pp. 61-71. New York: Plenum.
42.
Midgley, G. (1995b) Mixing Methods: Developing Systemic Intervention , Research Memorandum No. 9. Hull: Centre for Systems Studies, University of Hull.
43.
Midgley, G. (1996a) 'The Ideal of Unity and the Practice of Pluralism in Systems Science', in R. L. Flood and N. R. A. Romm (eds) Critical Systems Thinking: Current Research and Practice. New York : Plenum (in press).
44.
Midgley, G. (1996b) 'Dealing with Coercion: Critical Systems Heuristics and Beyond', Systems Practice9 (in press).
45.
Nirje, B. (1960) 'The Normalization Principle and its Human Management Implications', in R. Kugel and W. Wolfensberger (eds) Changing Patterns in Residential Services for the Mentally Retarded, 1969 edn, pp. 179-95. Washington DC: President's Committee on Mental Retardation.
46.
Oliga, J.C. (1988) 'Methodological Foundations of Systems Methodologies' , Systems Practice1: 87-112.
Perrin, B. and Nirje, B. (1989) 'Setting the Record Straight: A Critique of some Frequent Misconceptions of the Normalization Principle', in A. Brechin and J. Warmsley (eds) Making Connections Reflecting on the Lives and Experiences of People with Learning Difficulties, pp. 220-8. Milton Keynes : Open University Press.
49.
Pilling, D. (1995) 'Do PASS and PASSING Pass? A Critique of PASS/ING ', in D. Pilling and G. Watson (eds) Evaluating Quality in Services for Disabled and Older People, pp. 50-60. London: Jessica Kingsley.
50.
Popper, K.R. (1959) The Logic of Scientific Discovery. New York: Harper.
51.
Robinson, T. (1989) 'Normalization: The Whole Answer?', in A. Brechin and J. Warmsley (eds) Making Connections: Reflecting on the Lives and Experiences of People with Learning Difficulties, pp. 247-52. Milton Keynes : Open University Press.
52.
Tsoukas, H. (1993) 'The Road to Emancipation is Through Organizational Development: A Critical Evaluation of Total Systems Intervention', Systems Practice6: 53-70.
53.
Ulrich, W. (1981) 'A Critique of Pure Cybernetic Reason: The Chilean Experience with Cybernetics', Journal of Apphed Systems Analysis8: 33-59.
54.
Ulrich, W. (1983) Critical Heuristics of Social Planning: A New Approach to Practical Philosophy. Berne: Haupt.
55.
Ulrich, W. (1988) 'Churchman's "process of unfolding"—Its significance for Policy Analyis and Evaluation', Systems Practice1: 415-28.
56.
von Bertalanffy, L. (1956) 'General Systems Theory', General Systems Yearbook1: 1-10.
57.
Weimer, W.B. (1979) Notes on the Methodology of Scientific Research . Hillsdale, NJ: LawrenceErlbaum.
58.
Wholey, J.S. (1983) Evaluation and Effective Public Management. Boston, MA: Little, Brown.
59.
Wolfensberger, W. (1972) The Principle of Normalization in Human Services . Toronto: National Institute on Mental Retardation.
60.
Wolfensberger, W. (1983) 'Social Role Valorization: A Proposed New Term for the Principle of Normalization', Mental Retardation21: 234-9.
61.
Wolfensberger, W. and I. Glenn (1975) Program Analysis of Service Systems, Volumes I and II, 3rd edn. Toronto: National Institute on Mental Retardation.
62.
Wolfensberger, W. and S. Thomas (1983) PASSING: A Method for Evaluating the Quality of Human Services according to the Principle of Normalization, 2nd edn. Toronto: National Institute on Mental Retardation.
63.
Zigler, E., R.M. Hodapp and M.R. Edison (1990) 'From Theory to Practice in the Care and Education of Mentally Retarded Individuals', American Journal on Mental Retardation95: 1-12.
