REliable, Secure and Privacy preserving multi-biometric pErson authentiCaTion
Final Report Abstract
Biometrics refers to the automated recognition of individuals based on their behavioural or biological characteristics. In spite of their numerous advantages over traditional authentication systems based on PINs or passwords (e.g., biometric characteristics cannot be lost or forgotten), biometric systems are vulnerable to external attacks and can leak privacy. Presentations attacks (PAs) - impostors who manipulate biometric systems by masquerading as other people - are serious threats to security. Privacy concerns involve the use of personal and sensitive biometric information, as classified by the GDPR, for purposes other than those intended. Vulnerabilities to PAs and privacy leakage are unacceptable and have hindered the deployment of biometric technology in commercial applications. The biometrics community has responded with presentation attack detection (PAD) technologies and privacy preservation mechanisms (biometric template protection schemes, BTP). Even though the latest PAD technologies are largely successful in protecting biometrics systems from known forms of PA, they tend to lack generalisation to different forms of attacks. The standard approach to privacy preservation involves some form of encryption or irreversible transformations, though the most recent fully homomorphic algorithms are general computationally prohibitive. Multi-biometric systems, explored extensively as a means of improving recognition reliability, also offer potential to improve PAD generalisation. Multi-biometric systems offer natural protection against spoofing since an impostor is less likely to succeed in fooling multiple systems simultaneously. For the same reason, previously unseen PAs are less likely to fool multi-biometric systems protected by PAD. Unfortunately, each sub-system in a multi-biometric approach to recognition has potential to leak privacy. Multi-biometric systems only compound the need for computationally prohibitive privacy preservation. RESPECT, a Franco-German collaborative project, will explore the potential of using multibiometrics as a means to defend against diverse PAs and improve generalisation while still preserving privacy. Central to this idea is the use of i) biometric characteristics that can be captured easily and reliably using ubiquitous smart devices and, ii) biometric characteristics which facilitate computationally manageable privacy preserving, homomorphic encryption. The research will focus on characteristics readily captured with consumer-grade microphones and video cameras, specifically face, iris and voice. Further advances beyond the current state of the art involve the consideration of dynamic characteristics, namely utterance verification and lip dynamics. The core research objective will be to determine which combination of biometrics characteristics gives the best biometric authentication reliability and PAD generalisation while remaining compatible with computationally efficient privacy preserving BTP schemes.
Publications
-
"Anti-spoofing in automatic speaker recognition" at the Odyssey 2020 - The Speaker and Language Recognition Workshop.
Massimiliano Todisco
-
"Presentation attack detection and unknown attacks" at the International Face Performance Conference (IFPC) 2020".
M. Gomez-Barrero
-
An Efficient Super-Resolution Single Image Network using Sharpness Loss Metrics for Iris. 2020 IEEE International Workshop on Information Forensics and Security (WIFS), 1-6. IEEE.
Tapia, Juan; Gomez-Barrero, Marta & Busch, Christoph
-
An Explainability Study of the Constant Q Cepstral Coefficient Spoofing Countermeasure for Automatic Speaker Verification. The Speaker and Language Recognition Workshop (Odyssey 2020), 333-340. ISCA.
Tak, Hemlata; Patino, Jose; Nautsch, Andreas; Evans, Nicholas & Todisco, Massimiliano
-
ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech. Computer Speech & Language, 64, 101114.
Wang, Xin; Yamagishi, Junichi; Todisco, Massimiliano; Delgado, Héctor; Nautsch, Andreas; Evans, Nicholas; Sahidullah, Md; Vestman, Ville; Kinnunen, Tomi; Lee, Kong Aik; Juvela, Lauri; Alku, Paavo; Peng, Yu-Huai; Hwang, Hsin-Te; Tsao, Yu; Wang, Hsin-Min; Le Maguer, Sébastien; Becker, Markus; Henderson, Fergus ... & Ling, Zhen-Hua
-
G3AN: Disentangling Appearance and Motion for Video Generation. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 5263-5272. IEEE.
Wang, Yaohui; Bilinski, Piotr; Bremond, Francois & Dantcheva, Antitza
-
ImaGINator: Conditional Spatio-Temporal GAN for Video Generation. 2020 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE.
Wang, Yaohui; Bilinski, Piotr; Bremond, Francois & Dantcheva, Antitza
-
Spoofing Attack Detection Using the Non-Linear Fusion of Sub-Band Classifiers. Interspeech 2020. ISCA.
Tak, Hemlata; Patino, Jose; Nautsch, Andreas; Evans, Nicholas & Todisco, Massimiliano
-
Texture-based Presentation Attack Detection for Automatic Speaker Verification. 2020 IEEE International Workshop on Information Forensics and Security (WIFS), 1-6. IEEE.
Gonzalez-Soler, Lazaro J.; Patino, Jose; Gomez-Barrero, Marta; Todisco, Massimiliano; Busch, Christoph & Evans, Nicholas
-
The Privacy ZEBRA: Zero Evidence Biometric Recognition Assessment. Interspeech 2020, 1698-1702. ISCA.
Nautsch, Andreas; Patino, Jose; Tomashenko, N.; Yamagishi, Junichi; Noé, Paul-Gauthier; Bonastre, Jean-François; Todisco, Massimiliano & Evans, Nicholas
-
„Evaluating the Sensitivity of Face Presentation Attack Detection Techniques to Images of Varying Resolutions”, in NISK, 2020.
Lázaro J. González-Soler, Marta Gomez-Barrero & Christoph Busch
-
„Fisher Vector Encoding of Dense-BSIF Features for Unknown Face Presentation Attack Detection”, in Proc. Intl. Conf. of the Biometrics Special Interest Group (BIOSIG), 2020.
Lázaro J. González-Soler, Marta Gomez-Barrero & Christoph Busch
-
Differential Anomaly Detection for Facial Images. 2021 IEEE International Workshop on Information Forensics and Security (WIFS), 1-6. IEEE.
Ibsen, M.; Gonzalez-Soler, L. J.; Rathgeb, C.; Drozdowski, P.; Gomez-Barrero, M. & Busch, C.
-
Emotion Editing in Head Reenactment Videos using Latent Space Manipulation. 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), 1-8. IEEE.
Strizhkova, Valeriya; Wang, Yaohui; Anghelone, David; Yang, Di; Dantcheva, Antitza & Bremond, Francois
-
Fingerprint Presentation Attack Detection Based on Local Features Encoding for Unknown Attacks. IEEE Access, 9, 5806-5820.
Gonzalez-Soler, Lazaro Janier; Gomez-Barrero, Marta; Chang, Leonardo; Perez-Suarez, Airel & Busch, Christoph
-
Local feature encoding for unknown presentation attack detection: An analysis of different local feature descriptors. IET Biometrics, 10(4), 374-391.
González‐Soler, Lázaro J.; Gomez‐Barrero, Marta; Kolberg, Jascha; Chang, Leonardo; Pérez‐Suárez, Airel & Busch, Christoph
-
On the generalisation capabilities of Fisher vector‐based face presentation attack detection. IET Biometrics, 10(5), 480-496.
González‐Soler, Lázaro J.; Gomez‐Barrero, Marta & Busch, Christoph
-
PANACEA Cough Sound-Based Diagnosis of COVID-19 for the DiCOVA 2021 Challenge. Interspeech 2021. ISCA.
Kamble, Madhu R.; Gonzalez-Lopez, Jose A.; Grau, Teresa; Espin, Juan M.; Cascioli, Lorenzo; Huang, Yiqing; Gomez-Alanis, Alejandro; Patino, Jose; Font, Roberto; Peinado, Antonio M.; Gomez, Angel M.; Evans, Nicholas; Zuluaga, Maria A. & Todisco, Massimiliano
-
Privacy-Preserving Voice Anti-Spoofing Using Secure Multi-Party Computation. Interspeech 2021, 856-860. ISCA.
Chouchane, Oubaïda; Brossier, Baptiste; Gamboa, Jorge Esteban Gamboa; Lardy, Thomas; Tak, Hemlata; Ermis, Orhan; Kamble, Madhu R.; Patino, Jose; Evans, Nicholas; Önen, Melek & Todisco, Massimiliano
-
Self-Supervised Video Pose Representation Learning for Occlusion- Robust Action Recognition. 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), 1-5. IEEE.
Yang, Di; Wang, Yaohui; Dantcheva, Antitza; Garattoni, Lorenzo; Francesca, Gianpiero & Bremond, Francois
-
„Analysing the feasibility of using Objectosphere for Face Presentation Attack Detection”, in NISK, 2021.
Lázaro J. González-Soler, Marta Gomez-Barrero, Manuel Günther & Christoph Busch
-
„Inmodegan: Interpretable motion decomposition generative adversarial network for video generation“, Proc. Int. Conf. on Automatic Face and Gesture Recognition (FG)
Y. Wang, F. Bremond & A. Dantcheva
-
Biometrics in the Era of COVID-19: Challenges and Opportunities. IEEE Transactions on Technology and Society, 3(4), 307-322.
Gomez-Barrero, Marta; Drozdowski, Pawel; Rathgeb, Christian; Patino, Jose; Todisco, Massimiliano; Nautsch, Andreas; Damer, Naser; Priesnitz, Jannier; Evans, Nicholas & Busch, Christoph
-
Dual-Stream Temporal Convolutional Neural Network for Voice Presentation Attack Detection. 2022 International Workshop on Biometrics and Forensics (IWBF), 1-6. IEEE.
Gonzalez-Soler, Lazaro J.; Gomez-Barrero, Marta; Kamble, Madhu; Todisco, Massimiliano & Busch, Christoph
-
Exploring Auditory Acoustic Features for The Diagnosis of Covid-19. ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE.
Kamble, Madhu R.; Patino, Jose; Zuluaga, Maria A. & Todisco, Massimiliano
-
When Facial Recognition Systems become Presentation Attack Detectors. 2022 International Conference of the Biometrics Special Interest Group (BIOSIG), 1-5. IEEE.
Gonzalez-Soler, Lazaro J.; Barhaugen, Kevin Abadi; Gomez-Barrero, Marta & Busch, Christoph
-
“Biometrics – Security and Privacy” at the Lecture Series Cybercrime, Cybercrime and Forensic Computing DFG-Graduiertenkolleg, July 2022
Marta Gomez-Barrero
-
“Latent image animator: Learning to animate images via latent space navigation”, Proc. Int. Conf. on Learning Representations (ICLR), 2022
Y. Wang, D. Yang, F. Bremond & A. Dantcheva
-
Fisher Vectors for Biometric Presentation Attack Detection. Advances in Computer Vision and Pattern Recognition, 489-519. Springer Nature Singapore.
Gonzalez-Soler, Lazaro Janier; Gomez-Barrero, Marta; Patino, Jose; Kamble, Madhu; Todisco, Massimiliano & Busch, Christoph
-
Introduction to Presentation Attack Detection in Iris Biometrics and Recent Advances. Advances in Computer Vision and Pattern Recognition, 103-121. Springer Nature Singapore.
Morales, Aythami; Fierrez, Julian; Galbally, Javier & Gomez-Barrero, Marta
-
Toward Generalizable Facial Presentation Attack Detection Based on the Analysis of Facial Regions. IEEE Access, 11, 68512-68524.
Gonzalez-Soler, Lazaro Janier; Gomez-Barrero, Marta & Busch, Christoph
-
“Biometric Information Protection” at the Norwegian Biometrics Lab Annual Workshop (NBLAW), March 2023
Marta Gomez-Barrero
-
“Evaluation of Biometric Template Protection Schemes” at the EAB & CITeR Biometrics Workshop, April 2023
Marta Gomez-Barrero
