Organizational-level stress management interventions are usually evaluated using quasi-experimental methods. In order to test intervention effectiveness, such methods examine the outcomes of between-group differences in intervention exposure: participants are rarely asked about their experiences of the intervention. However, this approach has been criticized because it provides little or no information about why interventions succeed or fail. The aim of this study was to examine whether an analysis of participants' narratives of what had happened during an organizational-level intervention might prove useful during evaluation. Nurses working in a UK hospital (n = 26) who had received an intervention to help them balance their administrative and clinical workloads, provided information about their experiences of it, and how these experiences were related to the effectiveness of the intervention. Template analysis of the data in their narratives identified codes relating to: i) intervention contexts (both pre-intervention and during the intervention); ii) implementation processes (including how participants made use of the intervention); and iii) participants' perceptions of the intervention's impact. The results indicated that participants' accounts provided information that is not captured by the dominant evaluation paradigm. Specifically, these data can i) help organizations to make better use of interventions, and ii) enhance research into the links between intervention processes, contexts and outcomes.
Axtell, C., Holman, D. & Wall, T.Promoting innovation: A change study. Journal of Occupational and Organizational Psychology, 2006, 71(1), 509—16.
3.
Beehr, T.A. & O'Hara, K.Methodological designs for the evaluation of occupational stress interventions . In S.V. Kasl & C.L. Cooper (Eds), Stress and health: Issues in research methodology. Chichester: Wiley, 1987, pp. 79—112.
4.
Bond, F. & Bunce, D.Job control mediates change in a work reorganization intervention for stress reduction. Journal of Occupational Health Psychology , 2001, 6, 290—302.
5.
Bond, F. & Bunce, D.The role of acceptance and job control in mental health, job satisfaction and work performance. Journal of Applied Psychology, 2003, 88, 1057—67.
6.
Boyatzis, R.Transforming qualitative information: Thematic analysis and code development . Thousand Oaks, CA: Sage, 1998.
7.
Briner, R.B. Feeling and smiling: An overview of what we currently know about emotion at work. The Psychologist, 1999, 12, 16—19.
8.
Briner, R. & Reynolds, S.The costs, benefits and limitations of organizational level stress interventions . Journal of Organizational Behavior, 1999 , 20, 647—64.
9.
Cascio, W.F.Whither industrial and organizational psychology in a changing world of work ? American Psychologist, 1995, 50, 928—39.
10.
Chartered Institute of Personnel and Development (CIPD).Overview of CIPD surveys: A barometer of HR trends and prospects in 2007. London: Chartered Institute of Personnel and Development , 2007.
11.
Colarelli, S.M.Psychological intervention in organizations: An evolutionary perspective . American Psychologist, 1998, 53, 1044—56.
12.
Cook, T.D. & Campbell, D.T. Quasi-experimentation: Design and analysis issues for field settings. Chicago, IL: Rand McNally, 1979.
13.
Cook, T.R. & Shadish, W.R.Social experiments: Some developments over the last fifteen years. Annual Review ofPsychology, 1994, 45, 545—80.
14.
Cox, T.Stress research and stress management: Putting theory to work. Sudbury: HSE Books, 1993.
15.
Cox, T. & Mackay, C.J. A transactional approach to occupational stress. In E.N. Corlett & J. Richardson (Eds), Stress, work design and productivity. Chichester : Wiley, 1981, pp. 75—95.
16.
Cox, T., Griffiths, A.J. & Rial-Gonzalez, E.Research on work-related stress. Luxembourg: Office for Official Publications of the European Communities, 2000.
17.
Crabtree, B.F. & Miller, W.L. A template approach to text analysis: Developing and using codebooks . In B.F. Crabtree & W.L. Miller (Eds), Doing qualitative research . Newbury Park, CA: Sage, 1992, pp. 93—109.
18.
Dick, P.The social construction of the meaning of acute stressors: A qualitative study of the personal accounts of police officers using a stress counselling service . Work and Stress, 2000, 14, 226—44.
19.
Dobson, L.D. & Cook, T.J.Avoiding type III error in program evaluation: Results from a field experiment . Evaluation and Program Planning, 1980, 3, 269—376.
20.
Drummond, G.New theorizing about organizations. CurrentTopics in Management , 1998, 3, 93—122.
21.
Dunham, R.B., Pierce, J.L. & Castaneda, M.B.Alternative work schedules: Two field quasi-experiments . Personnel Psychology, 1987, 40, 215—42.
22.
Elliot, R., Fischer, C.T. & Rennie, D.L.Evolving guidelines for publication of qualitative research studies in psychology and related fields. Journal of Clinical Psychology , 1999, 38, 215—29.
23.
Ferguson, E. & Cox, T.Exploratory factor analysis: A user's guide. International Journal of Selection and Assessment, 1993, 1, 84—94.
24.
Fitzgerald, J. & Rasheed, J.M.Salvaging an evaluation from the swampy lowland. Evaluation and ProgrammingPlanning, 1998, 21, 199—209.
25.
French, J.R.P., Caplan, R.D. & van Harrison, R.The mechanisms of job stress and strain. New York: Wiley, 1982 .
26.
Green, J.C. & Caracelli, V.J.Defining and describing the paradigm issue in mixed-method evaluation. In J.C. Greene & V.J. Caracelli (Eds), Advances in mixed-method evaluation: The challenges and benefits of integrating diverse paradigms. San Francisco, CA: Jossey-Bass , 1997, pp. 5—18.
27.
Griffiths, A.J.Organizational interventions: Facing the limits of the natural science paradigm. Scandinavian Journal of Work, Environment and Health , 1999, 25, 589—96.
28.
Harachi, T.W., Abbot, R.D., Catalano, R.F., Haggerty, K.P. & Fleming, C.B.Opening the black box: Using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology , 1999, 27, 711—31.
29.
Harkness, A.M.B., Long, B.C., Bermbach, N., Patterson, K., Jordan, S. & Kahn, H.Talking about work stress: Discourse analysis and implications for stress interventions. Work and Stress, 2005 , 19, 121—36.
30.
Heaney, C.A., Israel, B.A., Schurman, S.J., Baker, E.A., House, J.S. & Hugentobler, M.Industrial relations, worksite stress reduction, and employee well-being: A participatory action research investigation. Journal of Organizational Behavior, 1993, 14, 495—510.
31.
Heaney, C.A., Price, F.H. & Raffety, J.Increasing coping resources at work: A field experiment to increase social support, improve work team functioning, and enhance employee mental health . Journal of Organizational Behaviour, 1995 , 16, 335—52.
32.
Hepburn, A. & Brown, S.D.Teacher stress and the management of accountability. Human Relations, 2001, 54, 691—715.
Jackson, S.Participation in decision-making as a strategy for reducing job-related strain . Journal of Applied Psychology, 1983 , 68, 3—19.
35.
Johnson, P. & Cassell, C.Epistemology and work psychology: New agendas. Journal of Occupational and Organizational Psychology, 2001, 74, 125—43.
36.
Karasek, R. & Theorell, T.Healthy work. New York: Basic Books , 1990.
37.
King, N.The qualitative research interview. In C . Cassell & G. Symon (Eds) Qualitative methods in organizational research: A practical guide . London: Sage, 1994, pp. 14—36.
38.
King, N.Template analysis. In G. Symon & C. Cassell (Eds), Qualitative methods and analysis in organizational research: A practical guide. London: Sage, 1998, pp. 118—34.
39.
Kompier, M.A.J. & Kristensen, T.Organizational work stress interventions in a theoretical, methodological and practical context. In J. Dunham (Ed.), Stress in the workplace: Past, present and future. London: Whurr Publishers, 2000, pp. 164—90.
40.
Kompier, M.A.J., Aust, B., van den Berg, A. & Siegrist, J.Stress prevention in bus drivers: Evaluation of 13 natural experiments . Journal of Occupational Health Psychology, 2000a, 5, 11—31.
41.
Kompier, M.A.J., Cooper, C.L. & Geurts, S.A.E. A multiple case study approach to work stress prevention in Europe . European Journal of Work and Organizational Psychology , 2000b, 9, 371—400.
42.
Kompier, M.A.J., Geurts, S.A.E., Gründemann, R.W.M., Vink, P. & Smulders, P.G.W.Cases in stress prevention: The success of a participative and stepwise approach. Stress Medicine, 1998, 14, 155—68.
43.
Kvale, S.Interviews. Thousand Oaks: Sage , 1996.
44.
Landsbergis, P.A. & Vivona-Vaughan, E. Evaluation of an occupational stress intervention in a public agency. Journal of Organizational Behavior, 1995, 16, 29—48.
45.
Lazarus, R.Psychological stress and the coping process. New York: McGraw-Hill, 1966.
46.
Lazarus, R.S. & Folkman, S.Stress, appraisal and coping. New York: Springer, 1984.
47.
Lipsey, M.W.Key issues in intervention research: A programme evaluation perspective . American Journal of Industrial Medicine, 1996, 29, 298—302.
48.
Madill, A., Jordan, A. & Shirley, C.Objectivity and reliability in qualitative analysis: Realist, contextualist and radical constructionist methodologies. British Journal of Psychology, 2000, 91, 1—20.
49.
Meijman, T., Mulder, G., Dormolen, M. van & Cremer, R.Workload of driving examiners: A psychosocial field study. In H. Kragt (Ed.) Enhancing industrial performance: Experiences of integrating the human factor. London: Taylor & Francis, 1992 , pp. 245—58.
50.
Michie, S., Wren, B. & Williams, S.Reducing absenteeism in hospital cleaning staff: Pilot of a theory based intervention . Occupational and Environmental Medicine , 2004, 61, 345—9.
51.
Mikkelsen, A., Saksvik, P.O. & Landsbergis, P.The impact of a participatory organizational intervention on job stress in community health care institutions. Work and Stress, 2000, 14, 156—70.
52.
Miles, M.B. & Huberman, M.A.Qualitative data analysis: An expanded sourcebook . Thousand Oaks, CA: Sage, 1994.
53.
Morgan, S.J. & Symon, G.The experience of outsourcing transfers: Implications for guidance and counselling . British Journal of Guidance and Counselling , 2006, 34, 191—208.
54.
Murphy, L.R.Stress management in work settings: A critical review of health effects . American Journal of Health Promotion, 1996 , 11, 112—35.
55.
Nielsen, K., Fredslund, H., Christensen, K.B. & Albertsen, K.Success or failure? Interpreting and understanding the impact of interventions in four similar worksites. Work and Stress, 2006, 20, 272—87.
56.
Nytro, K., Saksvik, P.O., Mikkelsen, A., Bohle, P. & Quinlan, M.An appraisal of key factors in the implementation of occupational stress interventions . Work and Stress, 2000 , 14, 213—25.
57.
Parkes, K.R. & Sparkes, T.J.Organizational interventions to reduce work stress: Are they effective? A review of the literature. Sudbury: HSE Books, 1998.
58.
Petterson, H., Donnersvard, H.A., Lagerstrom, M. & Toomingas, A.Evaluation of an intervention programme based on empowerment for eldercare nursing staff. Work and Stress, 2006, 20, 353—69.
59.
Pierce, J.L. & Newstrom, J.W.The design of flexible work schedules and employee responses: Relationships and processes. Journal of Occupational Behavior, 1983, 4, 247—62.
60.
Randall, R., Griffiths, A. & Cox, T.Evaluating organizational stress-management interventions using adapted study designs. European Journal of Work and Organizational Psychology , 2005, 14, 23—41.
61.
Reynolds, S.Psychological well-being at work: Is prevention better than cure? Journal of Psychosomatic Research, 1997, 43, 93—102.
62.
Saksvik, P.O., Nytro, K., Dahl-Jorgensen, C. & Mikkelsen, A.A process evaluation of individual and organizational occupational stress and health interventions. Work and Stress, 2002, 16, 37—57.
63.
Schaubroeck, J. & Merritt, D.E.Divergent effects of job control on coping with work stressors: The key role of self-efficacy. Academy of Management Journal, 1997, 40, 738—54.
64.
Schaubroeck, J., Ganster, D.C., Sime, W.E. & Ditman, D. A field study testing supervisory role clarification. Personnel Psychology, 1993, 46, 1—25.
65.
Schweiger, D.M. & Denisi, A.S.Communication with employees following a merger: A longitudinal field experiment . Academy of Management Journal, 1991, 34, 110—35.
66.
Semmer, N.Job stress interventions and organization of work. In L . Tetrick & J.C. Quick (Eds), Handbook of occupational health psychology. Washington, DC: American Psychological Association , 2003, pp. 325—53.
67.
Semmer, N.K.Job stress interventions and the organization of work. Scandinavian Journal of Work Environment and Health, 2006, 32, 515—27.
68.
Smith, J.A., Jarman, M. & Osborn, M.Doing interpretative phenomenological analysis. In M . Murray & K. Chamberlain (Eds), Qualitative health psychology: Theories and methods . London: Sage, 1999, pp. 218—40.
69.
Smith, M.J. & Zehel, D.A stress reduction intervention programme for meat processors emphasizing job design and work organization. In V. Di Martino (Ed.), Preventing stress at work: Conditions of work digest 11(2). Geneva: International Labour Office, 1991, pp. 93—113.
70.
Swanson, V. & Power, K.Employees' perceptions of organizational restructuring: The role of social support. Work and Stress, 2001, 15, 161—78.
71.
Symon, G. & Cassell, C.Reflections on the use of qualitative methods. In G . Symon & C. Cassell (Eds), Qualitative methods and analysis in organizational research: A practical guide . London: Sage, 1998, pp. 1—9.
72.
Symon, G. & Clegg, C.Constructing identity and participation during technological change . Human Relations, 2005, 58, 1141—66.
73.
Taris, T.W., Kompier, M.A.J., Geurts, S.A.E., Schreurs, P.J.G., Schaufeli, W.B., de Boer, E., de, Sepmeijer, K.J. & Wattez, C. Stress management interventions in the Dutch Domiciliary care sector: Findings from 81 organizations. International Journal of StressManagement , 2003, 10, 297—325.
74.
Tetrick, L.Organization of work: Implications for safety and health and research direction . Paper presented at the APA/NIOSH Work, Stress & Health 1999 Conference, Baltimore, MD, March 1999.
75.
Van derHek, H. & Plomp, H.N.Occupational stress management programmes: A practical overview of published effect studies. Occupational Medicine, 1997 , 47, 133—41.
76.
Wagner, J.A. IiiParticipation's effect on performance and satisfaction: A reconsideration of research evidence. Academy of Management Review, 1994, 19, 312—30.
77.
Wall, T.D., Kemp, N.J., Jackson, P.R. & Clegg, C.W.Outcomes of autonomous work groups: A long-term field experiment. Academy of Management Journal, 1986, 29, 280—304.
78.
Weick, K.E., Sutcliffe, K.M. & Obstfeld, D.Organizing and the process of sensemaking. Organization Science , 2005, 16, 409—21.
79.
Weiner, B.An attributional theory of motivation and emotion. New York: Springer-Verlag, 1986.
80.
Yin, R.K.Case study research: Design and methods, 2nd edn. Thousand Oaks, CA: Sage , 1994.
81.
Yin, R.K. & Kaftarian, S.J. Introduction: Challenges of community-based program outcome evaluations. Evaluation and Program Planning, 1997, 20, 293—7.
82.
Zapf, D., Dormann, C. & Frese, M.Longitudinal studies in organizational stress research: A review of the literature with reference to methodological issues. Journal of Occupational Health Psychology, 1996, 1, 145—69.
