Intramodal and intermodal fusion for audio-visual biometric authentication

Ming Cheung Cheung, Man Wai Mak, Sun-Yuan Kung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

This paper proposes a multiple-source multiple-sample fusion approach to identity verification. Fusion is performed at two levels: intramodal and intermodal. In intramodal fusion, the scores of multiple samples (e.g. utterances or video shots) obtained from the same modality are linearly combined, where the combination weights are dependent on the difference between the score values and a user-dependent reference score obtained during enrollment. This is followed by intermodal fusion in which the means of intramodal fused scores obtained from different modalities are fused. The final fused score is then used for decision making. This two-level fusion approach was applied to audio-visual biometric authentication, and experimental results based on the XM2VTSDB corpus show that the proposed fusion approach can achieve an error rate reduction of up to 83%.

Original languageEnglish (US)
Title of host publication2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, ISIMP 2004
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages25-28
Number of pages4
ISBN (Print)0780386884, 9780780386884
StatePublished - Jan 1 2004
Event2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, ISIMP 2004 - Hong Kong, China, Hong Kong
Duration: Oct 20 2004Oct 22 2004

Publication series

Name2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, ISIMP 2004

Other

Other2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, ISIMP 2004
CountryHong Kong
CityHong Kong, China
Period10/20/0410/22/04

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Fingerprint Dive into the research topics of 'Intramodal and intermodal fusion for audio-visual biometric authentication'. Together they form a unique fingerprint.

  • Cite this

    Cheung, M. C., Mak, M. W., & Kung, S-Y. (2004). Intramodal and intermodal fusion for audio-visual biometric authentication. In 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, ISIMP 2004 (pp. 25-28). (2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, ISIMP 2004). Institute of Electrical and Electronics Engineers Inc..