Testing and evaluation (T&E) will be successful if its plans, methods, and analysis components perform adequately despite departures from ideal conditions. A framework of robust T&E approaches is presented that is aimed at avoiding or gracefully accommodating such departures (e.g., resource losses and schedule changes). Broadening this framework, illustrative tools and other guidance are described for building robust T&E plans, methods, and analysis components. The T&E practitioner can use this broadened framework of robust approaches, tools, and guidance to ensure acceptable results despite departures from the ideal.
Get full access to this article
View all access options for this article.
References
1.
Basu, A. D. (1988). Reliability, probabilistic. In S. Kotz, N. L. Johnson, and C. B. Read (Eds.), Encyclopedia of statistical sciences (Vol. 8, pp. 24–29). New York: Wiley.
2.
Bittner, A. C., Jr. (1990). Human factors measurement: Nature, problems, and strengthening. In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 1127–1131). Santa Monica, CA: Human Factors Society.
3.
Bittner, A. C., Jr. (1991a). Analysis of learning-curve asymptotes: Ergonomic applications. In W. Karwowski and J. W. Yates (Eds.), Advances in industrial ergonomics and safety III (pp. 769–776). London: Taylor & Francis.
4.
Bittner, A. C., Jr. (1991b). Robust testing and evaluation. In Proceedings of the Human Factors Society 35th Annual Meeting (pp. 1332–1335). Santa Monica, CA: Human Factors Society.
5.
Bittner, A. C., Jr., Carter, R. C., Kennedy, R. S., Harbeson, M. M., and Krause, M. (1986). Performance evaluation tests for environmental research (PETER): Evaluation of 114 measures. Perceptual and Motor Skills, 63, 683–708.
6.
Bittner, A. C., Jr., and Guignard, J. C. (1985). Human factors engineering principles for minimization of adverse ship motion effects: Theory and practice. Naval Engineers Journal, 97(4), 205–213.
7.
Bittner, A. C., Jr., and Guignard, J. C. (1988). Shipboard evaluation of motion sickness incidence. In F. Aghazadeh (Ed.), Trends in ergonomics/human factors V (pp. 529–541). New York: North-Holland.
8.
Bittner, A. C., Jr., Guignard, J. C., and Morrissey, S. J. (1987). Workstation design to minimize motion sickness: An illustration. In J. M. Flach (Ed.), Proceedings of the Fourth Midcentral Ergonomics/Human Factors Conference (pp. 387–393). Urbana: University of Illinois, Institute of Aviation.
9.
Bittner, A. C., Jr., and Morrissey, S. J. (1990). Integrated performance and workload modeling for industrial and other system applications. In B. Das (Ed.), Advances in industrial ergonomics and safety II (pp. 857–864). London: Taylor & Francis.
10.
Bramwell, A., Bittner, A. C., Jr., and Morrissey, S. J. (in press). Repeated measures analysis: Issues and options. International Journal of Industrial Ergonomics.
11.
Byers, J. C., Bittner, A. C., Jr., Hill, S. G., Zaklad, A. L., and Christ, R. E. (1988). Workload assessment of a remotely piloted vehicle (RPV) system. In Proceedings of the Human Factors Society 32nd Annual Meeting (pp. 1145–1149). Santa Monica, CA: Human Factors Society.
12.
Cavallero, R. F., Ehrhardt, L. E., and Bittner, A. C., Jr. (1977). An empirical investigation of remotely piloted vehicle (RPV) displays and controls (TP-77-21). Point Mugu, CA: Pacific Missile Test Center.
