ICRL: Using landmark ratios with cascade model for an accurate age estimation system using deep neural networks

Abstract

Over the past decade, the computer vision community has given increased attention to the development of age estimation systems. Several approaches to more accurate and robust facial age estimation have been introduced. Apparent age datasets are typically collected from uncontrolled environments, leading to a number of challenges. In this paper, a cascade model system, which we called the ‘Integrated Classification and Regression with Landmark Ratios (ICRL), is introduced. Our system uses a classification model in order to learn the age label distribution, then uses this knowledge as an auxiliary input to a regression model. ICRL is based on context facial information and label distribution analysis. Facial context information is introduced through the extraction of precise facial landmark ratios. Extracted landmark ratios allow the system to distinguish each age label. The ICRL system uses a classification model to train the CNN network to learn the in-between relation of age labels. ICRL sufficiently models the aging process in the form of ordered and continuous imagery. The ICRL system minimizes the number of parameters needed as well as overall computational costs whilst maintaining robust and accurate results. Despite its simplicity, our system has outperformed other state-of-the-art approaches when applied onto the MORPH II, CLAP2015, AFAD and UTKFace datasets. ICRL achieved an overall superior predictive performance, reaching 99.67% with MORPH II, 99.51% with AFAD, 96.52 with CLAP2015, and 96.28% with UTKFace.

Keywords

Age estimation ordinal regression facial context information age label distribution

Get full access to this article

View all access options for this article.

References

Gao

B.B.

, Zhou

H.Y.

, Wu

and Geng

, Age estimation using expectation of label distribution learning, In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, Sweden, 2018, 712–718. doi: 10.24963/ijcai.2018/99.

Zhang

, Liu

, Xu

and Zhu

, C3ae: Exploring the limits of compact model for age estimation, In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 2019, 12587–12596. DOI: 10.1109/CVPR.2019.01287.

Agustsson

, Timofte

, Escalera

, Baro

, Guyon

and Rothe

, Apparent and Real Age Estimation in Still Images with Deep Residual Regressors on Appa-Real Database, 12th IEEE International Conference on Automatic Face & Gesture Recognition, 2017, 87–94. doi: 10.1109/FG.2017.20.

Liu

, Lu

, Feng

and Zhou

, Label-sensitive deep metric learning for facial age estimation, IEEE Transactions on Information Forensics and Security 13(2) (2017), 292–305. DOI: 10.1109/TIFS.2017.2746062.

Pan

, Han

, Shan

and Chen

, Mean-Variance Loss for Deep Age Estimation from a Face, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 2018, 5285–5294. DOI: 10.1109/CVPR.2018.00554.

Yang

H.-F.

, Lin

B.-Y.

, Chang

K.-Y.

and Chen

C.-S.

, Joint estimation of age and expression by combining scatteringand convolutional networks, ACM Transactions on Multimedia Computing, Communications, and Applications(TOMM) 14(1) (2018), 1–18. https://doi.org/10.1145/3152118

and Lu

B.-L.

, An adaptive image Euclidean distance, Pattern Recognition 42 (2009), 349–357. https://doi.org/10.1016/j.patcog.2008.07.017

Xie

J.-C.

and Pun

C.-M.

, Deep and ordinal ensemble learning for human age estimation from facial images, IEEE Transactions on Information Forensics and Security 15 (2374), 2361–2374. https://doi.org/10.1109/TIFS.2020.2965298

Ricanek

and Tesafaye

, Morph: A longitudinal image database of normal adult age-progression, In Proceedings of IEEE 7th International Conference on Automatic Face Gesture Recognition, Southampton, UK, 2006, 341–345. DOI: 10.1109/FGR.2006.78.

10.

Liu

K.-H.

and Liu

T.-J.

, A structure-based human facial age estimation framework under a constrainedcondition, , IEEE Transactions on Image Processing 28(10) (2019), 5187–5200. DOI: 10.1109/TIP.2019.2916768.

11.

Chang

K.-Y.

, Chen

C.-S.

and Hung

Y.-P.

, Ordinal hyperplanes ranker with cost sensitivities for age estimation, Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA, 2011, 585–592. doi: 10.1109/CVPR.2011.5995437.

12.

Jäntschi

, A test detecting the outliers for continuous distributions based on the cumulative distributionfunction of the data being tested, Symmetry (Basel) 11(6) MDPI (2019), p. 835. https://doi.org/10.3390/sym11060835.

13.

Xia

, Zhang

, Weng

, Xu

and Liu

, Multi-Stage Feature Constraints Learning for Age Estimation, in IEEE Transactions on Information Forensics and Security 15 (2020), 2417–2428. doi: 10.1109/TIFS.2020.2969552.

14.

Duan

, Li

, Yang

and Li

, A hybrid deep learning CNN–ELM for age and gender classification, Neurocomputing 275 (2018), 448–461. https://doi.org/10.1016/j.neucom.2017.08.062

15.

Duan

, Li

and Li

, An ensemble CNN2ELM for age estimation, IEEE Transactions on Information Forensicsand Security 13(3) (2017), 758–772. doi: 10.1109/TIFS.2017.2766583.

16.

Liu

, Zhang

and Duan

, Facial Age Estimation Using a Multi-Task Network Combining Classification and Regression, , IEEE Access 8 (2020), 92441–92451. doi: 10.1109/ACCESS.2020.2994322.

17.

Osman

O.F.

and Yap

M.H.

, Computational intelligence in automatic face age estimation: A survey, IEEE Transactions on Emerging Topics in Computational Intelligence 3(3) (2018), 271–285. DOI: 10.1109/TETCI.2016.2646278.

18.

, Hu

, He

and Sun

, A coupled evolutionary network for age estimation, arXiv preprint arXiv:1809.07447, 2018, 1809–07447.

19.

Rothe

, Timofte

and Van Gool

, Deep expectation of real and apparent age from a single image withoutfacial landmarks, International Journal of Computer Vision 126(2) (2018), 144–157. https://doi.org/10.1007/s11263-016-0940-3

20.

Escalera

, Fabian

, Pardo

, Baro

, Gonzalez

, Escalante

H.J.

, Misevic

, Steiner

, Guyon

, et al., Chalearn looking at people 2015: Apparent age and cultural event recognition datasets and results, In Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 2015, 1–9. doi: 10.1109/ICCVW.2015.40.

21.

Escalera

, Baró

, Escalante

H.J.

and Guyon

, Chalearn looking at people: A review of events and resources, International Joint Conference on Neural Networks, Anchorage, AK, USA, 2017, 1594–1601. DOI: 10.1109/IJCNN.2017.7966041.

22.

Taheri

and Toygar

Ö.

, On the use of DAG-CNN architecture for age estimation with multi-stage featuresfusion, Neurocomputing 329 (2019), 300–310. https://doi.org/10.1016/j.neucom.2018.10.071

23.

Chen

, Zhang

, Dong

, Le

and Rao

, Using ranking-cnn for age estimation, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 2017, 5183–5192. DOI: 10.1109/CVPR.2017.86.

24.

Yang

and Ramanan

, Multi-scale recognition with DAG-CNNs, Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 2015, 1215–1223, doi: 10.1109/ICCV.2015.144.

25.

Yang

T.-Y.

, Huang

Y.-H.

, Lin

Y.-Y.

, Hsiu

P.-C.

and Chuang

Y.-Y.

, SSR-Net: A Compact Soft Stagewise RegressionNetwork for Age Estimation, In Proceedings of the Twenty-Seventh International Joint Conference onArtificial Intelligence 5(6), Stockholm, Sweden, 2018, 1078–1084. https://doi.org/10.24963/ijcai.2018/150

26.

, Lu

, Feng

, Xu

, Zhou

and Tian

, Bridgenet: A continuity-aware probabilistic network for age estimation, In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 2019, 1145–1154. DOI: 10.1109/CVPR.2019.00124.

27.

Cao

, Mirjalili

and Raschka

, Rank consistent ordinal regression for neural networks with application toage estimation, Pattern Recognition Letters 140 (2020), 325–331. https://doi.org/10.1016/j.patrec.2020.11.008.

28.

Wang

, Guo

and Kambhamettu

, Deeply-learned feature for age estimation, In Proceedings of IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA, 2015, 534–541. DOI: 10.1109/WACV.2015.77.

29.

Geng

, Yin

and Zhou

Z.-H.

, Facial age estimation by learning from label distributions, IEEETransactions on Pattern Analysis and Machine Intelligence 35(10) (2013), 2401–2412. DOI: 10.1109/TPAMI.2013.51.

30.

Liu

, Li

, Kan

, Zhang

, Wu

, Liu

, Han

, Shan

and Chen

, Agenet: Deeply learned regressor and classifier for robust apparent age estimation, In Proceedings of the IEEE International Conference on Computer Vision Workshop, Santiago, Chile, 2015, 16–24. DOI: 10.1109/ICCVW.2015.42.

31.

Chen

X.-W.

and Jeong

J.C.

, Enhanced recursive feature elimination, In Sixth International Conference on Machine Learning and Applications, Cincinnati, OH, USA, 2007, 429–435. DOI: 10.1109/ICMLA.2007.35.

32.

Zeng

, Huang

and Ding

, Soft-Ranking Label Encoding for Robust Facial Age Estimation,, IEEE Access 8 (2020), 134209–134218. doi: 10.1109/ACCESS.2020.3010815.

33.

Yang

, Gao

B.-B.

, Xing

, Huo

Z.-W.

, Wei

X.-S.

, Zhou

, Wu

and Geng

, Deep label distribution learning for apparent age estimation, In Proceedings of the IEEE International Conference on Computer Vision Workshop, Santiago, Chile, 2015, 102–108. DOI: 10.1109/ICCVW.2015.53.

34.

Guo

, Zhang

, Hu

, He

and Gao

, Ms-celeb-1m: A dataset and benchmark for large-scale face recognition, In Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 2016, 87–102. DOI: 10.1007/978-3-319-46487-9_6.

35.

Niu

, Zhou

, Wang

, Gao

and Hua

, Ordinal regression with multiple output CNN for age estimation, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016, 4920–4928. DOI: 10.1109/CVPR.2016.532.

36.

Zhang

, Song

and Qi

, Age progression/regression by conditional adversarial autoencoder, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 2017, 5810–5818. DOI: 10.1109/CVPR.2017.463.

37.

Tan

, Wan

, Lei

, Zhi

, Guo

and Li

S.Z.

, Efficient group-n encoding and decoding for facial ageestimation, IEEE Transactions on Pattern Analysis and Machine Intelligence 40(11) (2017), 2610–2623. DOI: 10.1109/TPAMI.2017.2779808.

38.

, Shen

and Hengel

A.D.

, A.: Wider or Deeper: Revisiting theResNet Model for Visual Recognition, Pattern Recognit 90 (2019), 119–133. https://doi.org/https://doi.org/10.1016/j.patcog.2019.01.006.