Multiclass Ridge-adjusted Slack Variable Optimization using selected basis for fast classification

Yinan Yu, Konstantinos I. Diamantaras, Tomas McKelvey, Sun-Yuan Kung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Kernel techniques for classification is especially challenging in terms of computation and memory requirement when data fall into more than two categories. In this paper, we extend a binary classification technique called Ridge-adjusted Slack Variable Optimization (RiSVO) to its multiclass counterpart where the label information encoding scheme allows the computational complexity to remain the same to the binary case. The main features of this technique are summarized as follows: (1) Only a subset of data are pre-selected to construct the basis for kernel computation; (2) Simultaneous active training set selection for all classes helps reduce complexity meanwhile improving robustness; (3) With the proposed active set selection criteria, inclusion property is verified empirically. Inclusion property means that once a pattern is excluded, it will no longer return to the active training set and therefore can be permanently removed from the training procedure. This property greatly reduce the complexity. The proposed techniques are evaluated on standard multiclass datasets MNIST, USPS, pendigits and letter which could be easily compared with existing results.

Original languageEnglish (US)
Title of host publication2014 Proceedings of the 22nd European Signal Processing Conference, EUSIPCO 2014
PublisherEuropean Signal Processing Conference, EUSIPCO
Pages1178-1182
Number of pages5
ISBN (Electronic)9780992862619
StatePublished - Nov 10 2014
Event22nd European Signal Processing Conference, EUSIPCO 2014 - Lisbon, Portugal
Duration: Sep 1 2014Sep 5 2014

Publication series

NameEuropean Signal Processing Conference
ISSN (Print)2219-5491

Other

Other22nd European Signal Processing Conference, EUSIPCO 2014
CountryPortugal
CityLisbon
Period9/1/149/5/14

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering

Keywords

  • RKHS basis construction
  • RiSVO
  • kernel
  • large scale data
  • multiclass classification

Fingerprint Dive into the research topics of 'Multiclass Ridge-adjusted Slack Variable Optimization using selected basis for fast classification'. Together they form a unique fingerprint.

Cite this