A Context-Based Quasi-Experimental Evaluation of a Computer-Supported Product Development System

Abstract

This paper deals with the design and development of a computer-supported collaborative work (CSCW) system to support product development, and its evaluation using a quasi-experimental approach in an industrial environment. The evaluation compared the performance of eight different subgroups using the CSCW system with their performance using the existing product development system. Task completion time, non-value added (NVA) time, and certain subjective measures were recorded for each of the two systems tested. Despite their minimal experience with the CSCW system, the subgroups took less time to perform five of the eight tasks with the CSCW system than with the existing system. These time savings were primarily a consequence of a substantial reduction in NVA activities. The mean percentage of total task time devoted to NVA activities dropped from 44% with the existing system to 6% with the CSCW system. Users also rated the CSCW system more favorably than the existing system in terms of the subjective measures.

Get full access to this article

View all access options for this article.

References

Ackerman

M. S.

(1994). Augmenting the organizational memory: A field study of Answer Garden. Proceedings of CSCW '94 (pp. 243–252). New York: ACM.

Carroll

J. M.

Alpert

S. R.

Karat

Van Deusen

Rosson

M. B.

(1994). Raison d'etre: Capturing design history and rationale in multimedia narratives. Proceedings of CHI '94 (pp. 192–197). New York: ACM.

D'Souza

M.E.

Greenstein

J.S.

(1996). A field study of the product development process as a first step in the design of a system to support concurrent engineering. In Proceedings of the Human Factors and Ergonomics Society 40th Annual Meeting (pp. 781–785). Santa Monica, CA: Human Factors and Ergonomics Society.

Forsythe

Ashby

M.R.

(1996). Human factors in agile manufacturing. Ergonomics in Design, January, pp. 15–21.

Francik

Rudman

S. E.

Cooper

Levine

(1991). Putting innovation to work: Adoption strategies for multimedia communication systems. Communications of the ACM, Vol. 34, No. 12, pp. 53–63.

Ishii

Kobayashi

Arita

(1994). Iterative design of seamless collaboration media. Communications of the ACM, Vol. 37, No. 8, pp. 83–97.

Ramage

(1995). Evaluation of cooperative systems project. Http://www.comp.lanes.ac.uk/computing/research/cscg/projects/evaluation/index.html.

Rosenthal

Rosnow

R. L.

(1991). Essentials of behavioral research: Methods and data analysis (pp. 439–456). New York: McGraw-Hill.

Ulrich

K. T.

Eppinger

S. D.

(1995). Product design and development. New York: McGraw-Hill.