Contemporary training methodologies based on evolutionary artificial neural networks with product and sigmoid neurons for classification

Abstract

This thesis introduces three contributions to train feed-forward neural network models based on evolutionary computation for a classification task. The new methodologies have been evaluated in three-layered neural models, including one input, one hidden and one output layer. Particularly, two kind of neurons such as product and sigmoidal units have been considered in an independent fashion for the hidden layer. Experiments have been carried out in a good number of problems, including three complex real-world problems, and the overall assessment of the new algorithms is very outstanding. Statistical tests shed light on that significant improvements were achieved. The applicability of the proposals is wide in the sense that can be extended to any kind of hidden neuron, either to other kind of problems like regression or even optimization with special emphasis in the two first approaches.

Keywords

Artificial neural networks evolutionary algorithm classification product unit sigmoid unit feature selection

Get full access to this article

View all access options for this article.

References

A.J.

Tallón-Ballesteros, Nuevos modelos de Redes Neuronales Evolutivas para Clasificación. Aplicación a Unidades Producto y Unidades Sigmoide, PhD thesis, University of Seville, Spain, 2013, available at: http://fondosdigitales.us.es/tesis/tesis/1990/nuevos-modelos-de-redes-neuronales-evolutivas-para-clasificacion-aplicacion-unidades-producto-y-unidades-sigmoide/.

A.J.

Tallón-Ballesteros,

P.A.

Gutiérrez-Peña and

Hervás-Martínez, Distribution of the search of evolutionary product unit neural networks for classification, 2012, Preprint, available at: arXiv:1205.3336.

A.J.

Tallón-Ballesteros and

Hervás-Martínez, A two-stage algorithm in evolutionary product unit neural networks for classification, Expert Systems with Applications 38(1) (2011), 743–754.

A.J.

Tallón-Ballesteros,

Hervás-Martínez and

P.A.

Gutiérrez, An extended approach of a two-stage evolutionary algorithm in artificial neural networks for multiclassification tasks, in: Innovations in Intelligent Machines -3, Springer, 2013, pp. 139–153.

A.J.

Tallón-Ballesteros,

Hervás-Martínez,

J.C.

Riquelme and

Ruiz, Feature selection to enhance a two-stage evolutionary algorithm in product unit neural networks for complex classification problems, Neurocomputing 114 (2013), 107–117.