Stochastic feature transformation with divergence-based out-of-handset rejection for robust speaker verification

Man Wai Mak, Chi Leung Tsang, Sun Yuan Kung

Research output: Contribution to journalArticlepeer-review

11 Scopus citations


The performance of telephone-based speaker verification systems can be severely degraded by linear and nonlinear acoustic distortion caused by telephone handsets. This paper proposes to combine a handset selector with stochastic feature transformation to reduce the distortion. Specifically, a Gaussian mixture model (GMM)-based handset selector is trained to identify the most likely handset used by the claimants, and then handset-specific stochastic feature transformations are applied to the distorted feature vectors. This paper also proposes a divergence-based handset selector with out-of-handset (OOH) rejection capability to identify the "unseen" handsets. This is achieved by measuring the Jensen difference between the selector's output and a constant vector with identical elements. The resulting handset selector is combined with the proposed feature transformation technique for telephone-based speaker verification. Experimental results based on 150 speakers of the HTIMIT corpus show that the handset selector, either with or without OOH rejection capability, is able to identify the "seen" handsets accurately (98.3% in both cases). Results also demonstrate that feature transformation performs significantly better than the classical cepstral mean normalization approach. Finally, by using the transformation parameters of the seen handsets to transform the utterances with correctly identified handsets and processing those utterances with unseen handsets by cepstral mean subtraction (CMS), verification error rates are reduced significantly (from 12.41% to 6.59% on average).

Original languageEnglish (US)
Pages (from-to)452-465
Number of pages14
JournalEurasip Journal on Applied Signal Processing
Issue number4
StatePublished - Apr 1 2004

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Hardware and Architecture
  • Electrical and Electronic Engineering


  • Divergence
  • EM algorithm
  • Feature transformation
  • Handset distortion
  • Robust speaker verification


Dive into the research topics of 'Stochastic feature transformation with divergence-based out-of-handset rejection for robust speaker verification'. Together they form a unique fingerprint.

Cite this