Abstract
We present a 2D and 3D multimodal hybrid face recognition algorithm and demonstrate its performance on the FRGC v1.0 data. We use hybrid (feature-based and holistic) matching for the 3D faces and a holistic matching approach on the 2D faces. Feature-based matching is performed by offline segmenting each 3D face in the gallery into three regions, namely the eyes-forehead, the nose and the cheeks. The cheeks are discarded to avoid facial expressions and hair. During recognition, each feature in the gallery is automatically matched, using a modified ICP algorithm, with a complete probe face. The holistic 3D and 2D face matching is performed using PCA. Individual matching scores are fused after normalization and the results are compared to the BEE baseline performances in order to provide some answers to the first three conjectures of the FRGC. Our multimodal hybrid algorithm substantially outperformed others by achieving 100% verification rate at 0.0006 FAR.
Chapter PDF
Similar content being viewed by others
References
Besl, P.J., McKay, N.D.: Reconstruction of Real-world Objects via Simultaneous Registration and Robust Combination of Multiple Range Images. IEEE TPAMI 14(2), 239–256 (1992)
Boehnen, C., Russ, T.: A Fast Multi-Modal Approach to Facial Feature Detection. In: IEEE WACV (2005)
Boussaid, F., Chai, D., Bouzerdoum, A.: A Current-mode VLSI Architecture for Skin Detection. ISSPA 1, 629–632 (2003)
Bowyer, K.W., Chang, K., Flynn, P.: A Survey Of Approaches to Three-Dimensional Face Recognition. In: IEEE ICPR, pp. 358–361 (2004)
Chang, K.I., Bowyer, K.W., Flynn, P.J.: Face Recognition Using 2D and 3D Facial Data. In: MMUA, pp. 25–32 (2003)
Huang, J., Heisele, B., Blanz, V.: Component-based Face Recognition with 3D Morphable Models. In: AVBPA (2003)
Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. IEEE TCSVT 14(1), 4–20 (2004)
Lu, X., Jain, A.K., Colbry, D.: Matching 2.5D Face Scans to 3D Models. IEEE TPAMI 28(1), 31–43 (2006)
Mian, A.S., Bennamoun, M., Owens, R.A.: Region-based Matching for Robust 3D Face Recognition. BMVC 1, 199–208 (2005)
Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the Face Recognition Grand Challenge. In: IEEE CVPR (2005)
Taubin, G.: Curve and Surface Smoothing without Shrinkage. In: ICCV, pp. 852–857 (1995)
Turk, M., Pentland, A.: Eigenfaces for Recognition. JOCN 3 (1991)
Viola, P., Jones, M.J.: Robust Real-Time Face Detection. IJCV 57(2), 137–154 (2004)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face Recognition: A Literature Survey. In: ACM Computing Survey, pp. 399–458 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mian, A., Bennamoun, M., Owens, R. (2006). 2D and 3D Multimodal Hybrid Face Recognition. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3953. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744078_27
Download citation
DOI: https://doi.org/10.1007/11744078_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33836-9
Online ISBN: 978-3-540-33837-6
eBook Packages: Computer ScienceComputer Science (R0)Springer Nature Proceedings Computer Science
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.