Hyperspectral face recognition with minimum noise fraction,histogram of oriented gradient features and collaborative representation-based classifier

Abstract

Hyperspectral imaging provides new opportunities for improving face recognition accuracy. However, it poses such challenges as difficulty in data acquisition, low signal to noise ratio (SNR), and high dimensionality. In this paper, we propose a novel method for hyperspectral face recognition with good recognition rates. We first reduce noise adaptively from each spectral band and then crop each face. We perform minimum noise fraction (MNF) transform to the cropped face data cube in order to extract a number of MNF bands. We extract histogram of oriented gradients (HOG) features from each MNF band. We conducted some experiments to test this new method for hyperspectral face recognition with very promising results. For Hong Kong Polytechnic University Hyperspectral Face Database (PolyU-HSFD), we achieved an average correct recognition rate of 95.4% with standard deviation of 2.6 (95.4% ±2.6). For CMU Hyperspectral Face Database (CMU-HSFD), we achieved an average correct recognition rate of 98.1% with standard deviation of 0.8 (98.1% ±0.8). The reasons why we choose MNF for hyperspectral face recognition are because it can separate noise from fine features in the face data cube and at the same time reduce the dimensionality of the face data cube. In this way, our proposed face recognition method will be faster than those methods without dimensionality reduction.

Keywords

Hyperspectral face recognition minimum noise fraction (MNF)histogram of oriented gradients (HOG)

Get full access to this article

View all access options for this article.

References

, Zhang

and Pan

, “Studies on hyperspectral face recognition in visible with feature band selection,”, IEEE Transactions on Systems, Man and Cybernetics A: System and Humans 40(6) (2010), 1354–1361 spectrum.

PolyU-HSFD. [Online]. Available: http://www4.comp.polyu.edu.hk/ biometrics/, accessed July 29, 2015.

Pan

, Healey

, Prasad

and Tromberg

, “Face recognition in hyperspectral images,” IEEE Transactions on Pattern Analysis and Machine Intelligence 25(12) (2003), 1552–1560.

CMU-HSFD [Online]. Available: http://www.consortium.ri.cmu.edu/hsagree/index.cgi, accessed July 29, (2015).

Shen

and Zheng

, “Hyperspectral face recognition using 3D Gabor wavelets,” International Conference on Pattern Recognition (2012), 1574–157.

Uzair

, Mahmood

and Mian

, “Hyperspectral face recognition with spatiospectral information fusion and PLS regression,” IEEE Transactions on Image Processing 24(3) (2015), 1127–1137.

Turk

and Pentland

, “Face recognition using eigenfaces,” in IEEE Int. Conf. Computer Vision and Pattern Recog (1991), 586–591.

Ahonen

, Hadid

and Pietikainen

, “Face recognition with local binary pattern,” Proc. of the 8th European Conference on Computer Vision (2004), 469–481.

Chen

G. Y.

, Sun

and Xie

W. F.

, “Hyperspectral face recognition using log-polar Fourier features and collaborative representation based voting classifiers,” IET Biometrics 6(1) (2017), 36–42.

10.

Andersson

, “Fast Inversion of the Radon Transform Using Log-polar Coordinates and Partial Back-Projections,” SIAM J Appl Math 65 (2005), 818–837.

11.

Sun

, Zhao

and Jin

, “Robust tensor preserving projection for multispectral face recognition,” Mathematical Problems in Engineering 2014 Article ID 597245, 10 pages.

12.

Wang

, Bau

T.C.

and Healey

, “Expression-invariant face recognition in hyperspectral images,” Optical Engineering 53(10) (2014), 103102.

13.

Pan

, Healey

and Tromberg

, “Hyperspectral face recognition under unknown illumination,” Optical Engineering 46(7) (2007), 077201.

14.

Sharma

and Gool

L. V.

, “Image-level classification in hyperspectral images using feature descriptors, with application to face recognition,” Submitted to Computer Vision and Pattern Recognition May 11, (2016). Available at http://arxiv.org/pdf/1605.03428.pdf.

15.

Vinayak

and Payal

, Hyperspectral face recognition using multidimensional clustering on hyperspectral face images, LAP Lambert Academic Publishing (2014).

16.

Dalal

and Triggs.

, “Histograms of Oriented Gradients for Human Detection,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1 (2005), 886–893.

17.

Green

A.A.

, Berman

, Switzer

and Craig

M.D.

, “A transformation for ordering multispectral data in terms of image quality with implications for noise removal,” IEEE Transactions on Geoscience and Remote Sensing 26(1) (1988), 65–74.

18.

Lee

J.B.

, Woodyatt

A.S.

and Berman

, “Enhancement of High Spectral Resolution Remote Sensing Data by a Noise-Adjusted Principal Components Transform,” IEEE Transactions on Geoscience and Remote Sensing 28(3) (1990), 295–304.

19.

Wright

J.A.

, Yang

A.Y.

, Ganesh

, Sastry

S.S.

and Ma

, “Robust face recognition via sparse representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence 31(2) (2009), 210–227.

20.

Zhang

, Yang

and Feng

, “Sparse representation or collaborative representation: which helps face recognition?” IEEE International Conference on Computer Vision (2011), 471–478.

21.

Dabov

, Foi

, Katkovnik

and Egiazarian

, “Image denoising by sparse 3D transform-domain collaborative filtering,” IEEE Transactions on Image Processing 16(8) (2007), 2080–2095.

22.

Chen

G.Y.

and Qian

S.E.

, “Denoising of hyperspectral imagery using principal component analysis and wavelet shrinkage,” IEEE Transactions on Geoscience and Remote Sensing 49(3) (2011), 973–980.

23.

Chen

G.Y.

, Qian

S.-E.

and Gleason

, “Denoising of hyperspectral imagery by combining PCA with block-matching 3D filtering,” Canadian Journal of Remote Sensing 37(6) (2011), 590–595.

24.

Chen

G.Y.

, Bui

T.D.

, Quach

K.G.

and Qian

S.E.

, “Denoising hyperspectral imagery using principal component analysis and block matching 4D filtering,” Canadian Journal of Remote Sensing 40(1) (2014), 60–67.

25.

Luo

G.C.

, Chen

G.Y.

, Tian

, Qin

and Qian

S.E.

, “Minimum Noise Fraction versus Principal Component Analysis as a Preprocessing Step for Hyperspectral Imagery Denoising,” Canadian Journal of Remote Sensing 42(2) (2016), 106–116.

26.

Masayuki Tanka’s Matlab code for face parts detection. Available at: https://www.mathworks.com/matlabcentral/fileexchange/5-face-parts-detection, accessed August 18, (2016).

27.

Chen

G.Y.

, Xie

W. F.

, Wang

S. P.

and Liu

H. K.

, “Hyperspectral face recognition with minimum noise fraction, log-polar Fourier features and collaborative representation-based classifier,” Proceedings of IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China, July 10–15, (2016).

28.

Abdi

, “Partial least squares regression and projection on latent structure regression (PLS-Regression),” Wiley Interdisciplinary Reviews: Computational Statistics (2) (2010), 97–106.

29.

Cui

and Prasad

, “Class-dependent sparse representation classifier for robust hyperspectral image recognition,” IEEE Transactions on Geoscience and Remote Sensing 53(5) (2015), 2683–2695.