Photometric Stereo for 3D Face Reconstruction Using Non Linear Illumination Models

Villarini, B., Gkelias, A. and Argyriou, V. 2016. Photometric Stereo for 3D Face Reconstruction Using Non Linear Illumination Models. ICPR Workshop on Multimodal Pattern Recognition of Social Signals in Human-Computer Interaction. Cancun, Mexico 04 Dec 2016 - 08 Jun 2017 Springer. doi:10.1007/978-3-319-59259-6_12

TitlePhotometric Stereo for 3D Face Reconstruction Using Non Linear Illumination Models
AuthorsVillarini, B., Gkelias, A. and Argyriou, V.
TypeConference paper
Abstract

Face recognition in presence of illumination changes, variant pose and different facial expressions is a challenging problem. In this paper, a method for 3D face reconstruction using photometric stereo and without knowing the illumination directions and facial expression is proposed in order to achieve improvement in face recognition. A dimensionality reduction method was introduced to represent the face deformations due to illumination variations and self shadows in a lower space. The obtained mapping function was used to determine the illumination direction of each input image and that direction was used to apply photometric stereo. Experiments with faces were performed in order to evaluate the performance of the proposed scheme. From the experiments it was shown that the proposed approach results very accurate 3D surfaces without knowing the light directions and with a very small differences compared to the case of known directions. As a result the proposed approach is more general and requires less restrictions enabling 3D face recognition methods to operate with less data.

KeywordsFace reconstruction Face recognition Photometric stereo 3D imaging Non-linear dimensionality reduction Illumination models
Year2016
ConferenceICPR Workshop on Multimodal Pattern Recognition of Social Signals in Human-Computer Interaction
PublisherSpringer
Accepted author manuscriptMPRSS2016.pdf
Publication dates
Published01 Jun 2017
JournalLecture Notes in Computer Science
Journal citationVolume (10183), pp. 140-152
ISSN 0302-9743
Digital Object Identifier (DOI)doi:10.1007/978-3-319-59259-6_12

Related outputs

A Framework for Automatic Morphological Feature Extraction and Analysis of Abdominal Organs in MRI Volumes
Asaturyan, H., Thomas, E.L., Bell, J.D. and Villarini, B. 2019. A Framework for Automatic Morphological Feature Extraction and Analysis of Abdominal Organs in MRI Volumes. Journal of Medical Systems. 43 (12), p. 334. doi:10.1007/s10916-019-1474-3

Advancing Pancreas Segmentation in Multi-protocol MRI Volumes using Hausdorff-Sine Loss Function
Asaturyan, H., Thomas, E.L., Fitzpatrick, J., Bell, J.D. and Villarini, B. 2019. Advancing Pancreas Segmentation in Multi-protocol MRI Volumes using Hausdorff-Sine Loss Function. 10th International Workshop on Machine Learning in Medical Imaging (MLMI 2019) in conjunction with MICCAI 2019. Shenzen, China 13 Oct 2019 Springer. doi:10.1007/978-3-030-32692-0_4

Morphological and multi-level geometrical descriptor analysis in CT and MRI volumes for automatic pancreas segmentation
Asaturyan, H., Gligorievski, A. and Villarini, B. 2019. Morphological and multi-level geometrical descriptor analysis in CT and MRI volumes for automatic pancreas segmentation. Computerized Medical Imaging and Graphics. 75, pp. 1-13. doi:10.1016/j.compmedimag.2019.04.004

The SmartTarget BIOPSY trial: A prospective, within-person randomised, blinded trial comparing the accuracy of visual-registration and MRI/ultrasound image-fusion targeted biopsies for prostate cancer risk stratification
Hamid, S., Donaldson, I.A., Hu, Y., Rodell, R., Villarini, B., Bonmati, E., Tranter, P., Punwani, S., Side, H.S., Willis, S., van der Meulen, J., Hawkes, D., Mccarran, N., Potyka, I., Williams, N.W., Brew-Graves, C., Freeman, A., Moore, C.M., Barratt, D., Emberton, M. and Ahmed, H.U. 2019. The SmartTarget BIOPSY trial: A prospective, within-person randomised, blinded trial comparing the accuracy of visual-registration and MRI/ultrasound image-fusion targeted biopsies for prostate cancer risk stratification. European Urology. 75 (5), p. 733–740. doi:10.1016/j.eururo.2018.08.007

Hierarchical Framework for Automatic Pancreas Segmentation in MRI Using Continuous Max-flow and Min-Cuts Approach
Asaturyan, H. and Villarini, B. 2018. Hierarchical Framework for Automatic Pancreas Segmentation in MRI Using Continuous Max-flow and Min-Cuts Approach. ICIAR 2018 International Conference Image Analysis and Recognition. Póvoa de Varzim, Portugal 27 - 29 Jun 2018 Springer. doi:10.1007/978-3-319-93000-8_64

Technical Note: Error metrics for estimating the accuracy of needle/instrument placement during transperineal MR/US-guided prostate interventions
Bonmati, E., Hu, Y., Villarini, B., Rodell, R., Martin, P., Han, L., Donaldson, I., Ahmed, H.U., Moore, C.M., Emberton, M. and Barratt, D.C. 2018. Technical Note: Error metrics for estimating the accuracy of needle/instrument placement during transperineal MR/US-guided prostate interventions. Medical Physics. 45 (4), pp. 1408-1414. doi:10.1002/mp.12814

MP33-20 The SmartTarget Biopsy Trial: a Prospective Paired Blinded Trial with Randomisation to Compare Visual-Estimation and Image-Fusion Targeted Prostate Biopsies
Donaldson, I., Hamid, S., Barratt, D., Hu, Y., Rodell, R., Villarini, B., Bonmati, E., Martin, P., Hawkes, D., Mccarran, N., Potyka, I., Williams, N., Bre-Graves, C., Moore, C., Emberson, M. and Ahmed, H. 2017. MP33-20 The SmartTarget Biopsy Trial: a Prospective Paired Blinded Trial with Randomisation to Compare Visual-Estimation and Image-Fusion Targeted Prostate Biopsies. The Journal of Urology. 197 (4), p. e425. doi:10.1016/j.juro.2017.02.1016

A Framework for Morphological Feature Extraction of Organs from MR Images for Detection and Classification of Abnormalities
Villarini, B., Asaturyan, H., Thomas, E.L., Mould, R. and Bell, J.D. 2017. A Framework for Morphological Feature Extraction of Organs from MR Images for Detection and Classification of Abnormalities. Proceedings of the 30th IEEE International Symposium on Computer-Based Medical Systems (CBMS’17). Thessaloniki, Greece 22 - 24 Jun 2017 IEEE . doi:10.1109/CBMS.2017.49

Cognitive behaviour analysis based on facial information using depth sensors
Montenegro, J.F., Villarini, B., Gkelias, A. and Argyriou, V. 2016. Cognitive behaviour analysis based on facial information using depth sensors. Wannous, H., Pala, P., Daoudi, M. and Flórez-Revuelta, F. (ed.) ICPR Workshop on Understanding Human Activities through 3D Sensors (UHA3DS 2016). Cancun, Mexico 04 - 08 Dec 2016 Springer. doi:10.1007/978-3-319-91863-1

Validation of the needle targeting accuracy of a MRI/TRUS- image-guided system for transperineal prostate cancer biopsy
Bonmati, E., Hu, Y., Rodell, R., Villarini, B., Martin, P., Han, L., Donaldson, I., Ahmed, H.U., Moore, C.M., Emberton, M. and Barratt, D.C. 2015. Validation of the needle targeting accuracy of a MRI/TRUS- image-guided system for transperineal prostate cancer biopsy. CARS-Computer Assisted Radiology and Surgery, 29th International Congress and Exhibition. Barcelona, Spain 24 Jun 2015 Springer. doi:10.1007/s11548-015-1213-2

Image, video and 3D data registration: medical, satellite and video processing applications with quality metrics
Argyriou, V., Del Rincon, J.M., Villarini, B. and Roche, A. 2015. Image, video and 3D data registration: medical, satellite and video processing applications with quality metrics. Oxford Wiley.

A sparse representation method for determining the optimal illumination directions in Photometric Stereo
Argyriou, V., Zafeiriou, S., Villarini, B. and Petrou, M. 2013. A sparse representation method for determining the optimal illumination directions in Photometric Stereo. Signal Processing. 93 (11), pp. 3027-3038. doi:10.1016/j.sigpro.2013.04.026

An optimal method for searching UEP profiles in wireless JPEG 2000 video transmission
Baruffa, G., Frescura, F., Micanti, P. and Villarini, B. 2012. An optimal method for searching UEP profiles in wireless JPEG 2000 video transmission. ICIP - International Conference on Image Processing. Orlando, FL 30 Sep 2012 IEEE . doi:10.1109/ICIP.2012.6467192

A reduced-reference perceptual image and video quality metric based on edge preservation
Martini, M.G., Villarini, B. and Fiorucci, F. 2012. A reduced-reference perceptual image and video quality metric based on edge preservation. EURASIP Journal on Advances in Signal Processing. 2012 (66). doi:10.1186/1687-6180-2012-66

Image quality assessment based on edge preservation
Martini, M.G., Hewage, C. and Villarini, B. 2012. Image quality assessment based on edge preservation. Signal Processing: Image Communication. 27 (8), pp. 875-882. doi:10.1016/j.image.2012.01.012

Reduced-Reference Image Quality Assessment Based on Edge Preservation
Martini, M.G., Villarini, B. and Fiorucci, F. 2011. Reduced-Reference Image Quality Assessment Based on Edge Preservation. 7th International ICST Mobile Multimedia Communications Conference. Cagliari, Italy 05 Sep 2011 Springer. doi:10.1007/978-3-642-30419-4_3

A reprogrammable computing platform for JPEG 2000 and H.264 SHD video coding
Baruffa, G., Fiorucci, F., Frescura, F., Micanti, P., Verducci, L. and Villarini, B. 2010. A reprogrammable computing platform for JPEG 2000 and H.264 SHD video coding. 8th IEEE Workshop on Embedded Systems for Real-Time Multimedia (ESTIMedia). Scottsdale, AZ 28 Oct 2010 IEEE . doi:10.1109/ESTMED.2010.5666990

Permalink - https://westminsterresearch.westminster.ac.uk/item/q12w5/photometric-stereo-for-3d-face-reconstruction-using-non-linear-illumination-models


Share this
Tweet
Email