Artificial neural networks are rapidly gaining popularity in the hard sciences and in social science. This article discusses neural networks as tools business researchers can use to analyze data. After providing a brief history of neural networks, the article describes limitations of multiple regression. Then, the characteristics and organization of neural networks are presented, and the article shows why they are an attractive alternative to regression. Shortcomings and applications of neural networks are reviewed, and neural network software is discussed.
Get full access to this article
View all access options for this article.
References
1.
Al-Deek, H. M. (2001). Comparison of two approaches for modeling freight movement at seaports. Journal of Computing in Civil Engineering, 15, 284-291.
2.
Bansal, A., Kauffman, R., & Weitz, R. (1993). Comparing the modeling performance of regression and neural networks as data quality varies: A business value approach. Journal of Management Information Systems, 10, 11-32.
3.
Barkema, H., & Vermeulen, F. (1998). International expansion through start-up or acquisition: A learning perspective. Academy of Management Journal, 41, 7-26.
4.
Bartlett, P. L. (1998). The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network. IEEE Transactions on Information Theory, 44, 525-536.
5.
Brass, D. J., Butterfield, K. D., & Skaggs, B. C. (1998). Relationships and unethical behavior: A social network perspective. Academy of Management Review, 23, 14-31.
6.
Brockman, J. (2002). Making sense of procedural fairness: How high procedural fairness can reduce or heighten the influence of outcome favorability. Academy of Management Review, 27, 58-76.
7.
Chang, C. A., & Su, C.-T. (1995). A comparison of statistical regression and neural network methods in modeling measurement errors for computer vision inspection systems. Computers and Industrial Engineering, 28, 593-605.
8.
Chatman, J. A., Polzer, J. T., Barsade, S. G., & Neale, M. A. (1998). Being different yet feeling similar: The influence of demographic composition and organizational culture on work processes and outcomes. Administrative Science Quarterly, 43, 749-780.
9.
Chen, L., & Sakaguchi, T. (2000). Data mining methods, applications, and tools. Information Systems Management, 17, 65-70.
10.
Cheng, B., & Titterington, D. M. (1994). Neural networks: A review from a statistical perspective. Statistical Science, 9, 2-54.
11.
Chiang, W. C., Urban, T. L., & Baldridge, G.W. (1996). A neural network approach to mutual fund net asset value forecasting. Omega: International Journal of Management Science, 24, 205-215.
12.
Cybenko, G. (1989). Approximation by superpositions of a sigmoidal function. Mathematical Control Signal Systems, 2, 303-314.
13.
Deckro, R. F., & Herbert, J. E. (1984). Goal programming approaches to solving linear decision rule based aggregate production planning models. IEEE Transactions, 16, 308-316.
14.
Denton, J. W. (1995). How good are neural networks for causal forecasting? Journal of Business Forecasting Methods and Systems, 14(2), 17-21.
15.
De Veaux, R. D. (1995). A guided tour of modern regression methods. American Statistical Association, Proceedings of the Section on Physical and Engineering Sciences, pp. 286-295.
16.
Duliba, K. A. (1991). Contrasting neural nets with regression in predicting performance in the transportation industry. Proceedings of the 24th Annual Hawaii International Conference on System Sciences, 4, 163-170.
17.
Fahlman, S. E. (1988). An empirical study of learning speed in backpropagation (Tech. Rep. No. CMU-CS-88-162). Pittsburgh, PA: Carnegie Mellon University.
18.
Garson, G. D. (1995). A comparison of neural network and expert systems algorithms with common multivariate procedures from analysis of social science data. Social Science Computer Review, 9, 399-435.
19.
Garson, G. D. (1998). Neural networks: An introductory guide for social scientists. London: Sage.
20.
Gencay, R., & Selcuk, F. (2001). Neural Network Toolbox 3.0 for MATLAB. International Journal of Forecasting, 17, 305-317.
21.
Gibson, C. B. (1999). Do they do what they believe they can? Group efficacy and effectiveness across tasks and cultures. Academy of Management Journal, 42, 138-152.
22.
Goldberg, L. R. (1970). Man versus model of man: A rationale plus some evidence for a method of improving clinical inferences. Psychological Bulletin, 73, 422-432.
23.
Golomb, D., & Hertz, J. (1997). How well can we estimate the information carried in neuronal responses from limited samples? Neural Computation, 9, 649-665.
24.
Gorr, W. L. (1994). Research prospective on neural network forecasting. International Journal of Forecasting, 10, 1-4.
25.
Gorr, W. L., Daniel, N., & Szczypula, J. (1994). Comparative study of artificial neural network and statistical models for predicting student grade point averages. International Journal of Forecasting, 10, 17-34.
26.
Gupta, A., & Lam, M. S. (1996). Estimating missing values using neural networks. Journal of the Operational Research Society, 47, 229-238.
27.
Hagiwara, M. (1993). Removal of hidden units and weights for backpropagation networks. Proceedings of the International Joint Conference on Neural Networks, 1, 351-354.
28.
Hall, Q. P., & Krumm, K. (1999). Developing product return and sales forecasts using neural nets. Proceedings of the 28th Annual Meeting of the Western Decision Sciences Institute, pp. 609-613.
29.
Hardgrave, B. C., Wilson, R. L., & Walstrom, K. A. (1994). Predicting graduate student success: A comparison of neural networks and traditional techniques. Computers and Operations Research, 21, 249-263.
30.
Harrington, P. (1993). Sigmoid transfer functions in backpropagation neural networks. Analytical Chemistry, 65, 2167-2168.
31.
Hernandez, E., & Arkun, R. (1992). Study of the control relevant properties of backpropagation neural network models of nonlinear dynamical systems. Computers and Chemical Engineering, 16, 227-240.
32.
Hill, T., Marquez, L., O’Connor, M., & Remus, W. (1994). Artificial neural network models for forecasting and decision making. International Journal of Forecasting, 10, 5-15.
33.
Holcomb, T. R., & Morari, M. (1992). PLS/neural networks. Computers and Chemical Engineering, 16, 393-411.
34.
Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, USA, 81, 2554-2558.
35.
Hornik, K., Stinchcombe, M., & White, H. (1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2, 359-366.
36.
Hwang, J., Lay, S., Maechler, M., Martin, R. D., & Schimert, J. (1994). Regression modeling in backpropagation and projection pursuit learning. IEEE Transactions on Neural Networks, 5, 342-353.
37.
Intrator, O., & Intrator, N. (1993). Using neural networks for interpretation of nonlinear models. American Statistical Association, Proceedings of the Statistical Computing Section, pp. 244-249.
38.
Jain, B. A., & Nag, B. N. (1997). Performance evaluation of neural network decision models. Journal of Management Information Systems, 14, 201-217.
39.
Johnson, D. E. (1989, November). Harnessing the power of multiple regression. Chemical Engineering, pp. 176-188.
40.
Joseph, B., Wang, F. H., & Shieh, S. S. (1992). Exploratory data analysis: A comparison of statistical methods with artificial neural networks. Computers and Chemical Engineering, 16, 413-423.
41.
Kruschke, J. K. (1989). Improving generalization in backpropagation networks with distributed bottlenecks. Proceedings of the IEEE/INNS International Joint Conference on Neural Networks, 1, 443-447.
42.
Kung, S. Y., & Hwang, J. N. (1988). An algebraic projection analysis for optimal hidden units size and learning rate in backpropagation learning. Proceedings of the IEEE/INNS International Conference on Neural Networks, 1, 363-370.
43.
Kuo, C., & Reitsch, A., (1995). Neural networks vs. conventional methods of forecasting. Journal of Business Forecasting Methods and Systems, 14(4), 17-22.
44.
Kuo, R. J. (2001). A sales forecasting system based on fuzzy neural network with initial weights generated by genetic algorithm. European Journal of Operational Research, 129, 496-517.
45.
Laguna, M., & Marti, M. (2002). Neural network prediction in a system for optimizing simulations. IIE Transactions, 34, 273-282.
46.
Landis, R. S., & Dunlap, W. P. (2000). Moderated multiple regression tests are criterion specific. Organizational Research Methods, 3, 254-266.
47.
Larkey, L. K. (1996). Toward a theory of communicative interactions in culturally diverse workgroups. Academy of Management Review, 21, 463-491.
48.
Lee, C. W. (1997). Training feedforward neural networks: An algorithm giving improved generalization. Neural Networks, 10, 61-68.
49.
Lee, T. H., & Jung, S.-C. (2000). Forecasting creditworthiness: Logistic versus artificial neural net. Journal of Business Forecasting Methods and Systems, 18(4), 28-30.
50.
Lippman, R. P. (1987, April). An introduction to computing with neural nets. IEEE ASSP Magazine, pp. 4-22.
51.
Littell, B. (2000). How will intelligent systems and expert systems impact the estate planning field? Journal of Financial Service Professionals, 54, 26-27.
52.
Looney, C. G. (1996). Advances in feedforward neural networks: Demystifying knowledge acquiring black boxes. IEEE Transactions on Knowledge and Data Engineering, 8, 211-226.
53.
Lu, M., AbouRizk, S. M., & Hermann, U. H. (2001). Sensitivity analysis of neural networks in spool fabrication productivity studies. Journal of Computing in Engineering, 15, 299-308.
54.
Mantel, R. J., & Galman, G. J. (1982). Optimal linear decision rules for a work force smoothing model with seasonal demand. International Journal of Production Economics, 6, 167-174.
55.
Marquez, L., Hill, T., Worthley, R., & Remus, W. (1991). Neural network models as an alternative to regression. Proceedings of the 24th Annual Hawaii International Conference on System Sciences, 4, 129-135.
56.
Masahiko, A. (1989). Mapping abilities of three layer neural networks. Proceedings of the IEEE/INNS International Joint Conference on Neural Networks, 1, 419-423.
57.
Mavrovouniotis, M. L., & Chang, S. (1992). Hierarchical neural networks. Computers and Chemical Engineering, 16, 347-369.
58.
McCulloch, W. S., & Pitts, W. (1943). A logical calculus of ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5, 115-133.
59.
McCormack, C., & Doherty, J. (1993). Neural network super architectures. Proceedings of the International Joint Conference on Networks, 1, 301-304.
60.
McCullagh, P., & Nelder, J. A. (1989). Generalized linear models (2nd ed.). London: Chapman & Hall.
61.
Minsky, M., & Papert, S. (1969). Perceptrons. Cambridge, MA: MIT Press.
62.
Mitchell, R. (2001). The ghosts in the machine: Can technology find terrorists? American Spectator, 34(8), 52-59.
63.
Moskowitz, H., & Miller, J. G. (1975). Information systems and decision systems for production planning. Management Science, 22, 359-371.
64.
Mukesh, D. (1997, March). Hate statistics? Try neural networks. Chemical Engineering, pp. 96-104.
65.
Neal, W. D., & Wurst, J. (2001). Advances in market segmentation. Marketing Research, 13, 14-18.
66.
Nguyen, N., & Cripps, A. (2001). Predicting housing value: A comparison of multiple regression analysis and artificial neural networks. Journal of Real Estate Research, 22, 313-336.
67.
Oja, E., & Wang, L. (1996). Robust fitting by nonlinear neural units. Neural Networks, 9, 435-444.
68.
O’Neill, H. M., Pouder, R. W., & Buchholtz, A. K. (1998). Patterns in the diffusion of strategies across organizations: Insights from the innovation diffusion literature. Academy of Management Review, 23, 98-114.
69.
Parker, D. B. (1985). Learning-logic (Tech. Rep. No. 47). Cambridge, MA: MIT Center for Computational Research in Economics and Management Science.
70.
Pelled, L. H., Eisenhardt, K. M., & Xin, K. R. (1999). Exploring the black box: An analysis of work group diversity, conflict, and performance. Administrative Science Quarterly, 44, 1-28.
71.
Pethokoukis, J. M. (2002). Robotrading 101: Sophisticated computer programs take the human element out of picking winners on Wall Street. U.S. News and World Report, 132(3), 23-24.
72.
Phua, P. K., Ming, D., & Lin, W. (2001). Neural network with genetically evolved algorithms for stocks prediction. Asia-Pacific Journal of Operational Research, 18, 103-108.
73.
Porac, J. F., Wade, J. B., & Pollock, T. G. (1999). Industry categories and the politics of the comparable firm in CEO compensation. Administrative Science Quarterly, 44, 112-144.
74.
Racine, J. (2001). On the nonlinear predictability of stock returns using financial and economic variables. Journal of Business and Economic Statistics, 19, 380-382.
75.
Refenes, A. N., Zapranis, A., & Francis, G. (1994). Stock performance modeling using neural networks: A comparative study with regression models. Neural Networks, 7, 375-388.
76.
Remus, W. E. (1984). An empirical investigation of the impact of graphical and tabular data presentations on decision making. Management Science, 30, 533-542.
77.
Remus, W., & Hill, T. (1990). Neural network models of managerial judgment. Proceedings of the 23rd Annual Hawaii International Conference on System Sciences, pp. 340-344.
78.
Riedmiller, M., & Braun, H. (1993). A direct adaptive method for backpropagation learning: The RPROP algorithm. Proceedings of the IEEE International Conference on Neural Networks, 1, 586-591.
79.
Robbins, H., & Munro, S. (1951). A stochastic approximation method. Annals of Mathematical Statistics, 22, 400-407.
80.
Rosenblatt, F. (1962). Principles of neurodynamics. New York: Spartan.
81.
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition. (pp. 318-362). Cambridge, MA: MIT Press.
82.
Rumelhart, D. E., Widrow, B., & Lehr, M. A. (1994). The basic ideas in neural networks. Communications of the ACM, 37(3), 87-92.
83.
Sarle, W. S. (1994). Neural networks and statistical models. Proceedings of the SAS Users Group International Conference, pp. 1528-1550.
Seitsma, J., & Dow, R. J. F. (1988). Neural net pruning—Why and how? Proceedings of the IEEE International Conference on Neural Networks, 1, 325-333.
86.
Sexton, R. S., Dorsey, R. E., & Johnson, J. D. (1998). Toward global optimization of neural networks. Decision Support Systems, 22, 171-185.
87.
Somers, M. J. (2001). Thinking differently: Assessing nonlinearities in the relationship between work attitudes and job performance using a Bayesian neural network. Journal of Occupational and Organizational Psychology, 74, 47-61.
88.
Sparrowe, R. T., Liden, R. C., Wayne, S. J., & Kraimer, M. L. (2001). Social networks and the performance of individuals and groups. Academy of Management Journal, 44, 316-325.
89.
Specht, D. F. (1991). A general regression neural network. IEEE Transactions on Neural Networks, 2, 568-576.
90.
Spining, M. T., Darsey, J. A., Sumpter, B. G., & Noid, D. W. (1994). Opening up the black box of artificial neural networks. Journal of Chemical Education, 71, 406-411.
91.
Stager, F., & Agarwal, M. (1997). Three methods to speed up the training of feedforward and feedback perceptrons. Neural Networks, 10, 1435-1443.
92.
Stern, H. S. (1996). Neural networks in applied statistics. Technometrics, 38, 205-214.
93.
Tam, K. Y., & Kiang, M. Y. (1992). Managerial applications of neural networks: The case of bank failure predictions. Management Science, 38, 926-947.
94.
Taylor, S. M., Masterson, S. S., Renard, M. K., & Tracy, K. B. (1998). Manager’s reactions to procedurally just performance management systems. Academy of Management Journal, 41, 568-579.
95.
Tzafestas, S. G., Dalianis, P. J., & Anthopoulos, G. (1996). On the overtraining phenomenon of backpropagation neural networks. Mathematics and Computers in Simulation, 40, 507-521.
96.
Wade-Benzoni, K. A., Hoffman, A., Thompson, L. L., Moore, D. A., Gillespie, J. J., & Bazerman, M. H. (2002). Barriers to resolution in ideologically based negotiations: The role of values and institutions. Academy of Management Review, 27, 41-57.
97.
Walter, J. T., & Levy, E. (1979). Limitations in the logic of regression forecasting. American Statistical Association, Proceedings of the Business and Economic Statistics Section, pp. 541-545.
98.
Wang, S. (1998). An insight into the standard backpropagation model for regression analysis. Omega: International Journal of Management Science, 26, 133-140.
99.
Warner, B., & Misra, M. (1996). Understanding neural networks as statistical tools. American Statistician, 50, 284-293.
100.
Werbos, P. J. (1988). Generalization of backpropagation with application to a recurrent gas market model. Neural Networks, 1, 339-356.
101.
Werbos, P. J. (1991). Links between artificial neural networds (ANN) and statistical pattern recognition. In I. K. Sethi & A. K. Jain, Artificial neural networks and statistical pattern recognition: Old and new connections (pp. 11-31). New York: Elsevier Science.
102.
White, H. (1989, December). Neural network learning and statistics. AI Expert, pp. 48-52.
103.
White, H. (1992). Artificial neural networks: Approximation and learning theory. Oxford, UK: Blackwell.
104.
Wu, F. Y., & Yen, K. K. (1992). Application of neural network in regression analysis. Computers and Industrial Engineering, 23, 93-99.
105.
Yu, X. H., & Chen, G. A. (1997). Efficient backpropagation learning using optimal learning rate and momentum. Neural Networks, 10, 517-527.
106.
Zhang, G., Patuwo, B. E., & Hu, M. Y. (1998). Forecasting with artificial neural networks: The state of the art. International Journal of Forecasting, 14, 35-62.
107.
Zhang, J., & Morris, A. J. (1998). A sequential learning approach for single hidden-layer neural networks. Neural Networks, 11, 65-80.
