An Ethnographic Evaluation of a Computer-Supported Product Development System

Abstract

This paper addresses the evaluation of a computer-supported collaborative work (CSCW) system, designed using a context-based participatory approach, to support product development. The evaluation focused on the effectiveness and acceptance of the CSCW system in its intended use environment. Users were asked to use the system for a period of 60 business days to perform actual product development tasks. The frequency of use of the system and several subjective measures were recorded at fixed intervals during the evaluation. The highest usage was during the fourth (final) period of the evaluation and the lowest usage was during the second. Users tended to agree that the development capability and the potential benefits to the organization of the CSCW system exceeded those of the existing system. The results support the use of a context-based participatory approach to developing features of a CSCW system that meet not only functional needs, but also socio-technical ones. Through the evaluation, it was possible to determine tasks that were appropriate and others that were inappropriate for future integration into the CSCW system. The evaluation methodology also identified issues that hindered the adoption of the CSCW system. Strategies for adoption that deal with these issues are proposed.

Get full access to this article

View all access options for this article.

References

D'Souza

M. E.

(1996). The development and evaluation of a computer-supported collaborative work system to enhance product development. Unpublished doctoral dissertation. Clemson University, Clemson, SC.

D'Souza

M. E.

Greenstein

J. S.

(1996). A field study of the product development process as a first step in the design of a system to support concurrent engineering. In Proceedings of the Human Factors and Ergonomics Society 40′ Annual Meeting (pp. 781–785). Santa Monica, CA: Human Factors Society.

D'Souza

M. E.

Greenstein

J. S.

(1997). A context-based quasi-experimental evaluation of a computer-supported product development system. In Proceedings of the Human Factors and Ergonomics Society 41s' Annual Meeting. Santa Monica, CA: Human Factors Society.

Forsythe

Ashby

M. R.

(1996). Human factors in agile manufacturing. Ergonomics in Design, January, pp. 15–21.

Francik

Rudman

S. E.

Cooper

Levine

(1991). Putting innovation to work: Adoption strategies for multimedia communication systems. Communications of the ACM, Vol. 34, No. 12, pp. 53–63.

Hughes

J. A.

King

Rodden

Andersen

(1995). The role of ethnography in interactive systems design. Interactions, April, pp. 56–65.

Hughes

J. A.

Somerville

Bentley

Randall

(1993). Designing with ethnography: making work visible. Interacting with Computers, Vol. 5, No. 2, pp. 239–253.

Ishii

Kobayashi

Arita

(1994). Iterative design of seamless collaboration media. Communications of the ACM, Vol. 37, No. 8, pp. 83–97.

Ulrich

K. T.

Eppinger

S. D.

(1995). Product design and development. New York: McGraw-Hill.