Automatic Learning Using Neural Networks and Adaptive Regression

Barnard E Casasent D , Invariance and Neural Nets, IEEE Trans. on Neural Networks, Vol. 2, No. 5, Sept 1991, pp. 498–508.

Bates D M Watts D G (1988), Non-Linear Regression Analysis and Its Applications, Wiley, 1988.

Bishop C M , Neural Networks for Pattern Recognition, Oxford Univ Press, 1995.

Breiman L Friedman J H Olshen R A Stone C J , Classification and Regression Trees, Chapman & Hall, 1984.

Bridle J S , Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition. In: Soulie Fogleman F. Herault J (eds), Neurocomputing: Algorithms, Architectures and Applications, Springer-Verlag, 1990, pp. 227–236.

Bridle J S , Training Stochastic Model Recognition Algorithms as Networks Can Lead to Maximum Mutual Information Estimation of Parameters. In: Touretzky D S (ed), Advances in Neural Information Processing Systems 2, Morgan Kaufmann, 1990, pp. 211–217.

Craven M W Shavlik J W , (1993). Learning Symbolic Rules Using Artificial Neural Networks. In: Procs of 10th Intl Conf on Machine Learning, Univ of Massachusetts, June 27–29 1993, Morgan Kaufmann, pp. 73–80.

Denker J S Le Cun Y , Transforming Neural-Net Output Levels to Probability Distributions. In: Lippmann R P Moody J E Touretzky D S (eds), Advances in Neural Information Processing Systems 3, Morgan Kaufmann, 1991, pp. 853–859.

De Veaux R D Schumi J Schweinsberg J Ungar L H , Prediction intervals for neural networks via nonlinear regression, Technometrics, Vol. 40, 1998, pp. 273–282.

Duda R D Hart P E , Pattern Classification and Scene Analysis, Wiley, 1973.

Fahlman S E , Faster Learning Variations on Back-Propagation: An Empirical Study. In: Touretzty D Hinton G Sejnowski T (eds), Procs of 1988 Connectionist Models Summer School, Pittsburg, Morgan Kaufmann, 1989, pp. 38–51.

Fahlman S E Lebiere C , The Cascade Correlation Learning Architecture. In: Touretzky D S (ed), Advances in Neural Information Processing Systems 2, Morgan Kaufmann, 1990, pp. 524–532.

Friedman J H , Multivariate Adaptive Regression Splines, Annals of Statistics, Vol. 19, No. 1, 1991, pp. 1–141.

Friedman J H , Adaptive Spline Networks. In: Lippmann R P Moody J E Touretzky D S (eds), Advances in Neural Information Processing Systems 3, Morgan Kaufmann, 1991, pp. 675–683.

Friedman J H , A Micro User's Guide to MARS Version 3.6, Stanford Univ, 1993.

Gallant S I , Connectionist Expert Systems, Communications of the ACM, Vol. 31, No. 2, Feb 1988, pp. 152–169.

Gill P E Murray W Wright M H , Practical Optimization, Academic Press, 1981.

Goutte C , Note on free lunches and cross-validation, Neural Computation, Vol. 9, 1997, pp. 1211–1215,.

Hardle W , Applied Nonparametric Regression, Cambridge Univ Press, 1990.

Hassibi B Stork D G , Second Order Derivatives for Network Pruning: Optimal Brain Surgeon. In: Hanson S J Cowan J D Giles C L (eds), Advances in Neural Information Processing Systems 5, Morgan Kaufmann, 1993, pp. 164–171.

Hastie T J Tibshirani R J , Generalized Additive Models, Chapman & Hall, 1990.

Hastie T Tibshirani R Buja A , Flexible Discriminant Analysis by Optimal Scoring, Journal of American Statistical Assoc'n, Vol. 89, No. 428, Dec 1994, pp. 1255–1270.

Haykin S , Neural Networks: A Comprehensive Foundation, Macmillan, 1994.

Heskes T , Practical confidence and prediction intervals. In: Mozer M C Jordan M I Petsche T (eds), Advances in Neural Information Processing Systems 9, MIT Press, 1997, pp. 176–182.

Hertz J Krogh A Palmer R G , Introduction to the Theory of Neural Computation, Addison-Wesley, 1991.

Jacobs M C , Increased Rates of Convergence Through Learning Rate Adaption, Neural Networks, Vol. 1, 1988, pp. 295–307.

Kleinbaum D G , Applied regression analysis and other multi-variable methods, 3rd ed, Duxbury Press, 1998.

Koene R A Takane Y , Discriminant Component Pruning: Regularization and Interpretation of Multilayer Backpropagation Networks, Neural Computation, Vol. 11, 1999, pp. 783–802.

Looney C G , Pattern Recognition Using Neural Networks: Theory and Algorithms for Engineers and Scientists, Oxford Univ Press, 1997.

Maren A J Harston C T Pap R M , Handbook of Neural Computing Applications, Academic Press, 1990.

Masters T , Practical Neural Network Recipes in C++, Academic Press, 1993, with software.

Moody J E , The Effective Number of Parameters: An Analysis of Generalization and Regularization in Nonlinear Learning Systems. In: Moody J E Hanson S J Lippman R P (eds), Advances in Neural Infor'n Processing Systems 4, Morgan Kaufmann, 1992, pp. 847–854.

Pham D T Alcock R J , Automated Grading and Defect Detection: A Review, Forest Product Journals, Vol. 48, No. 4, 1998, pp. 34–42.

Pham D T Jennings N R Ross I , Intelligent Visual Inspection of Valve-Stem Seals, Control Engineering Practice, Vol. 3, No. 9, 1995, pp. 1237–1245.

Pham D T Peat B J , Hybrid Method for Systems Analysis, IEE Procs: Science, Measurement & Technology, Vol. 142, No. 5, Sept 1995, Special Issue on Manufacturing Eng'g, pp. 350–361.

Pham D T Pham P T N , Artificial Intelligence in Engineering, Intl Journal of Machine Tools & Manufacture, Vol. 39, 1999, pp. 937–949.

Reed R , Pruning Networks — A Survey, IEEE Trans on Neural Networks, Vol. 4, No. 5, Sept 1993, pp. 740–747.

Richard M D Lippmann R P , Neural Network Classifiers Estimate Bayesian a posteriori Probabilities, Neural Computation, Vol. 3, 1991, pp. 461–483.

Ripley B D , Statistical Aspects of Neural Networks. In: Barndorff-Nielsen Jensen Kendall (eds), Networks and Chaos — Statistical and Probabilistic Aspects, Chapman & Hall, 1993, pp. 40–123.

Ripley B D , Pattern Recognition and Neural Networks, Cambridge Univ Press, 1996.

Ruck D W Rogers S K Kabrisky M Oxley M E Suter B W , The Multilayer Perceptron as an Approximation to a Bayes Optimal Discriminant Function, IEEE Trans. on Neural Networks, Vol. 1, No. 4, Dec 1990, pp. 296–298.

Rumelhart D E Hinton G E Williams R J , Learning Internal Representations by Error Propagation. In: Rumelhart D E, McCelland J L & PDP Research Group, Parallel Distributed Processing, Vol. 1: Foundations, MIT Press, 1986, pp. 318–362.

Ryan T P , Modern regression methods, Wiley, 1997.

Sarle W S , Neural Network Implementation in SAS Software, Procs. of 19th Annual SAS Users Group Intl Conf, April 1994, (revised 21 April).

Tibshirani R , A comparison of some error estimates for neural network models, Neural Computation, Vol. 8, 1996, pp. 152–163.

Towell G G Shavlik J W , Knowledge-Based Artificial Neural Networks , Artificial Intelligence, Vol. 70, 1994, pp. 119–165.

Wan E A , Neural Network Classification: A Bayesian Interpretation, IEEE Trans. on Neural Networks, Vol. 1, No. 4, Dec 1990, pp. 303–305.

Weiss S M Kulikowski C A , Computer Systems that Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert Systems, Morgan Kaufmann, 1991.

White H , Artificial Neural Networks: Approximation and Learning Theory, Blackwell, 1992.

Weisberg S , Applied Linear Regression, 2nd ed, Wiley, 1985.

Zhu H Rohwer R , No free lunch for cross-validation, Neural Computation, Vol. 8, 1996, pp. 1421–1426.