Multivariate classification models play an increasingly important role in human factors research. In the past, these models have been based primarily on discriminant analysis and logistic regression. Models developed from machine learning research offer the human factors professional a viable alternative to these traditional statistical classification methods. To illustrate this point, two machine learning approaches - genetic programming and decision tree induction - were used to construct classification models designed to predict whether or not a student truck driver would pass his or her commercial driver license (CDL) examination. The models were developed and validated using the curriculum scores and CDL exam performances of 37 student truck drivers who had completed a 320-hr driver training course. Results indicated that the machine learning classification models were superior to discriminant analysis and logistic regression in terms of predictive accuracy. Actual or potential applications of this research include the creation of models that more accurately predict human performance outcomes.
Get full access to this article
View all access options for this article.
References
1.
Al-Ghamdi, A. S. (2002). Using logistic regression to estimate the influence of accident factors on accident severity. Accident Analysis and Prevention, 34, 729–741.
2.
Avolio, B. J., Kroeck, K. G., & Panek, P. E. (1985). Individual differences in information-processing ability as a predictor of motor vehicle accidents. Human Factors, 27, 577–587.
3.
Babski-Reeves, K. L., & Crumpton-Young, L. L. (2002). Comparisons of measures for quantifying repetition in predicting carpal tunnel syndrome. International Journal of Industrial Ergonomics, 30, 1–6.
4.
Byrnes, M., & Fox, D. (Eds). (1999). Bumper-to-bumper: The complete guide to tractor-trailer operations (3rd ed.). Corpus Christi, TX: Byrnes & Associates.
5.
Carnahan, B. J., Norman, B., & Redfern, M. S. (2001). Incorporating physical demand criteria into assembly line balancing. IIE Transactions, 33, 875–887.
6.
Carnahan, B. J., & Redfern, M. S. (1998a). Application of genetic algorithms to the design of lifting tasks. International Journal of Industrial Ergonomics, 21, 145–158.
7.
Carnahan, B. J., & Redfern, M. S. (1998b). Building a low back injury risk classifier using evolutionary computation. In Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (pp. 881–885). Santa Monica, CA: Human Factors and Ergonomics Society.
8.
Carnahan, B. J., Redfern, M. S., & Norman, B. (2000). Designing safe job rotation schedules using optimization and heuristic search. Ergonomics, 43, 543–560.
9.
Clancy, E. A. (1997). Factors influencing the resubstitution accuracy in multivariate classification analysis. Ergonomics, 40, 417–427.
10.
Clarke, D. D., Forsyth, R., & Wright, R. (1998a). Behavioural factors in accidents at road junctions: The use of a genetic algorithm to extract descriptive rules from police case files. Accident Analysis and Prevention, 30, 223–234.
11.
Clarke, D. D., Forsyth, R., & Wright, R. (1998b). Machine learning in road accident research: Decision trees describing road accidents during cross-flow turns. Ergonomics, 41, 1060–1079.
12.
Deery, H. A., & Fildes, B. N. (1999). Young novice driver subtypes: Relationship to high-risk behavior, traffic accident record, and simulator driving performance. Human Factors, 41, 628–643.
13.
French, D. J., West, R. J., Elander, J., & Wilding, J. M. (1993). Decision-making style, driving style, and self-reported involvement in road traffic accidents. Ergonomics, 36, 627–644.
14.
Goldberg, D. E. (1989). Genetic algorithms in search, optimization, and machine learning.New York: Addison Wesley.
15.
Hanson, J. P., Redfern, M. S., & Mazumdar, H. (1999). Predicting slips and falls considering required and available friction, Ergonomics, 42, 1619–1633.
16.
Hennekens, C. H., & Buring, J. E. (1987). Epidemiology in medicine.Boston: Little, Brown.
17.
Huberty, C. J., & Lowman, L. L. (1997). Discriminant analysis via statistical packages. Educational and Psychological Measurement, 57, 759–784.
18.
Kishore, J. K., Patnaik, L. M., Mani, V., & Agrawal, V. K. (2000). Application of genetic programming for multicategory pattern classification. IEEE Transactions on Evolutionary Computation, 4, 242–258.
19.
Koza, J. R. (1992). Genetic programming: On the programming of computers by means of natural selection. Cambridge, MA: MIT Press.
20.
Koza, J. R. (1994). Genetic programming II: Automatic discovery of reusable programs. Cambridge, MA: MIT Press.
21.
Koza, J. R., Bennett, F. H., Andre, D., & Keane, M. A. (1999). Genetic programming III: Darwinian invention and problem solving. San Francisco: Morgan Kaufmann.
22.
Lubin, B., Fielder, E. R., & Van Whitlock, R. (1999). Predicting discharge from airforce basic training by battery of affect. Journal of Clinical Psychology, 55, 71–78.
23.
Mackieh, A., & Cilingir, C. (1998). Effects of performance shaping factors on human error. International Journal of Industrial Ergonomics, 22, 285–292.
24.
Marras, W. S., Lavender, S. A., Leurgans, S., Sudhakar, L. R., Allread, W. G., Fathallah, F., & Ferguson, S. (1993). The role of dynamic three dimensional trunk motion in occupationally related low back disorders. Spine, 18, 617–628.
25.
Matias, A. C., Salvendy, G., & Kuczez, T. (1998). Predictive models of carpal tunnel syndrome causation among VDT operators. Ergonomics, 41, 213–226.
26.
McFadden, M. (1997). Predicting pilot-error incidents of U.S. airline pilots using logistic regression. Applied Ergonomics, 28, 209–212.
27.
Meadows, M. L., Stradling, S. G., & Lawson, S. (1998). The role of social deviance and violations in predicting road traffic accidents in a sample of young offenders. British Journal of Psychology, 89, 417–431.
28.
Montana, D. J. (1995). Strongly typed genetic programming. Evolutionary Computation, 3, 199–230.
29.
Myers, R. H. (1990). Traditional and modern regression with applications (2nd ed.). Belmont, CA: Duxbury.
30.
Myers, R. S., Ball, K. K., Kalina, T. D., Roth, D. L., & Goode, K. T. (2000). Relation of useful field of view and other screening tests to on-road driving performance. Perceptual and Motor Skills, 91, 279–290.
31.
Pham, D. T., & Onder, H. H. (1992). A knowledge-based system for optimizing workplace layouts using a genetic algorithm. Ergonomics, 35, 1479–1487.
32.
Porter, B. E., & England, K. J. (2000). Predicting red-light running behavior: A traffic safety study in three urban settings. Journal of Safety Research, 31, 1–8.
33.
Quinlan, J. R. (1986). Induction of decision trees. Machine Learning, 1, 81–106.
34.
Quinlan, J. R. (1993). C4.5: Programs for machine learning.San Mateo, CA: Morgan Kaufmann.
35.
Rayson, M., Holliman, D., & Belyavin, A. (2000). Development of physical selection procedures for the British Army Phase 2: Relationship between physical performance test and criterion tasks. Ergonomics, 43, 73–105.
36.
Reason, J., Manstead, A., Stradling, S., Baxter, J., & Campbell, K. (1990). Errors and violations on the roads: A real distinction?Ergonomics, 33, 1315–1332.
37.
Sebald, A. V., & Fogel, L. J. (Eds.). (1994). Proceedings of the 3rd Conference on Evolutionary Computation.Princeton, NJ: World Scientific.
38.
Simon, F., & Corbett, C. (1996). Road traffic offending, stress, age, and accident history among male and female drivers. Ergonomics, 39, 757–780.
39.
Sohn, S., & Shin, S. (2001). Pattern recognition for road traffic accident severity in Korea. Ergonomics, 44, 107–117.
40.
Vergara, M., & Page, A. (2002). Relationship between comfort and back posture and mobility in sitting posture. Applied Ergonomics, 33, 1–8.
41.
Verwey, W. B., & Zaidel, D. M. (2000). Predicting drowsiness accidents from personal attributes, eye blinks, and ongoing behavior. Personality and Individual Differences, 28, 123–142.
