Facial Recognition Techniques Applied to the Automated Registration of Patients in the Emergency Treatment of Head Injuries

Abstract

This paper describes the development of a registration framework for image-guided solutions to the automation of certain routine neurosurgical procedures. The registration process aligns the pose of the patient in the preoperative space to that of the intraoperative space. Computerized tomography images are used in the preoperative (planning) stage, whilst white light (TV camera) images are used to capture the intraoperative pose. Craniofacial landmarks, rather than artificial markers, are used as the registration basis for the alignment. To create further synergy between the user and the image-guided system, automated methods for extraction of these landmarks have been developed. The results obtained from the application of a polynomial neural network classifier based on Gabor features for the detection and localization of the selected craniofacial landmarks, namely the ear tragus and eye corners in the white light modality are presented. The robustness of the classifier to variations in intensity and noise is analysed. The results show that such a classifier gives good performance for the extraction of craniofacial landmarks.

Keywords

preoperative to intraoperative registration registration basis automated landmark extraction emergency neurosurgery machine vision neural networks

Get full access to this article

View all access options for this article.

References

Fitzpatrick

Hill

Maurer

Registration: Medical image processing. In Handbook of medical imaging , vol.II (Eds Sonka, M. and Fitzpatrick, J.M.), 2000.

Henderson

J.M.

Bucholz

R.D.

Accurate and ergonomic method of registration for image-guided neurosurgery. Proc. SPIE 1994, 2132, 67.

Besl

P.J.

McKay

H.D.

A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. , 1992, 14, 239–256.

Clarkson

M.J.

Rueckert

Hill

D. L.

Hawkes

D.J.

Registration of multiple video images to preoperative CT for image-guided surgery. Proc. SPIE , 1999, 3661, 14–23.

Clarkson

M. J.

Rueckert

Hill

D.L.G.

Hawkes

D.J.

Using photo-consistency to register 2D optical images of the human face to a 3D surface model. IEEE Trans. Pattern Anal. Mach. Intell. , 2001, 23, 1266–1280.

Pun

K.H.

Moon

Y.S.

Recent advances in ear biometrics. In Proceedings of the Sixth IEEE International Conference on Automatic face and gesture recognition, 2004, pp. 164–169.

Moreno

Sanchez

Velez

J.F.

On the use of outer ear images for personal identification insecurity applications. In Proceedings of the IEEE 33rd Annual International Carnahan Conference on Security technology, 1999, pp. 469–476.

Yan

Bowyer

K.W.

An automatic 3D ear recognition system. In Proceedings of the Third International Symposium on 3D data processing, visualization, and transmission, 2006, pp. 326–333 (IEEE Computer Society Press, Washington, DC).

Zhao

Chellappa

Phillips

P.J.

Rosenfeld

Face recognition: A literature survey. ACM Comput. Surv. , 2003, 35, 399–458.

10.

S.Z.

Zhang

H.J.

Learning probabilistic distribution model for multi-view face detection. In Proceedings of the IEEE Computer Society Conference on Computer vision and pattern recognition, 2001 vol. 2, p.116 (IEEE Computer Society Press, Washington, DC).

11.

Schneiderman

Kanade

Probabilistic modeling of local appearance and spatial relationships for object recognition. In Proceedings of the IEEE Computer Society Conference on Computer vision and pattern recognition, 1998, pp. 45–51 (IEEE Computer Society Press, Washington, DC).

12.

Cootes

T.F.

Taylor

C.J.

Cooper

D.H.

Graham

Active shape models-their training and application. Comput. Vis. Image Underst. , 1995, 61, 38–59.

13.

Huang

Shimizu

Kobatake

Robust face detection using Gabor filter features. Pattern Recognit. Lett. , 2005, 26, 1641–1649.

14.

Huang

L. L.

Shimizu

Hagihara

Kobatake

Face detection from cluttered images using a polynomial neural network. In Proceedings of the International Conference on Image processing, 2001 vol. 2, pp. 669–672.

15.

Gooroochurn

Ovinis

Kerr

Bouazza-Marouf

Vloeberghs

A registration framework for preoperative CT to intraoperative white light images. In Proceedings of the 13th Annual C-onference on Medical image understanding and analysis, Kingston University, London, UK, 14–15 July 2009, vol.57, pp. 184–188.

16.

Fitzpatrick

J.M.

West

J.B.

Maurer

C.R.

Jr.

Predicting error in rigid-body point-based registration. IEEE Trans. Med. Imaging , 1998, 17, 694–702.

17.

Ansari

Abdel-Mottaleb

Automatic facial feature extraction and 3D face modeling using two orthogonal views with application to 3D face recognition. Pattern Recognit. , 2005, 38, 2549–2563.

18.

Chen

Armstrong

Raftopoulos

An investigation on the accuracy of three-dimensional space reconstruction using the direct linear transformation technique. J. Biomech. , 1994, 27, 493–500.

19.

Gooroochurn

Ovinis

Kerr

Bouazza-Marouf

Vloeberghs

Preoperative to intraoperative space registration for management of head injuries. In Proceedings of the International Conference on Signal and image processing, Amsterdam, The Netherlands, 2009 vol. 57, pp. 11–18.

20.

Gabor

Theory of communication. J. Inst. Electr. Engrs , 1946, 93, 429–457.

21.

Kyrki

Local and global feature extraction for invariant object recognition. Ph.D. thesis, Lappeenranta University of Technology, 2002.

22.

Kyrki

Kamarainen

Kälviäinen

Simple Gabor feature space for invariant object recognition. Pattern Recognit. Lett. , 2004, 25, 311–318.

23.

Mohamed

A.S.S.

Weng

Ying

Ipson

S.S.

Jiang

Face detection based on skin color in image by neural networks. In Proceedings of the International Conference on Intelligent and advanced systems, 2007, pp. 779–783.

24.

Sung

K.K.

Poggio

Example-based learning for view-based human face detection. IEEE Trans. Pattern Anal. Mach. Intell. , 1998, 20, 39–51.

25.

Martinez

A.M.

Benavente

The AR face database, CVC Technical report, 1998.

26.

Marzan

G.T.

Karara

H.M.

A computer program for direct linear transformation solution of the collinearity condition, and some applications of it. In Proceedings of the Symposium on Close-range photogrammetric systems, 1975, pp. 420–476.

27.

Hatze

High-precision three-dimensional photogrammetric calibration and object space reconstruction using a modified DLT-approach. J. Biomech. , 1988, 21, 533–538.

28.

Gooroochurn

Kerr

Bouazza-Marouf

Vloeberghs

Extraction of craniofacial landmarks for preoperative to intraoperative registration. In Proceedings of the International Conference on Signal and image processing, Amsterdam, The Netherlands, 2009 vol. 57, pp. 1–10.

29.

Gao

Cao

Shan

Chen

Zhou

Zhang

Zhao

The CAS-PEAL large-scale Chinese face database and evaluation protocols, Technique Report, no. JDL-TR_04_FR_001, Joint Research & Development Laboratory, Chinese Academy of Sciences, Beijing, 2004.

30.

Huang

L. L.

Shimzu

Hagihara

Kobatake

Gradient feature extraction for classification-based face detection. Pattern Recognit. , 2003, 36, 2501–2511.