Parameter design tradeoff between prediction performance and training time for Ridge-SVM

Rasmus Rothe, Yinan Yu, S. Y. Kung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

It is well known that the accuracy of classifiers strongly depends on the distribution of the data. Consequently, a versatile classifier with a broad range of design parameters is better able to cope with various scenarios encountered in real-world applications. Kung [1] [2] [3] presented such a classifier named Ridge-SVM which incorporates the advantages of both Kernel Ridge Regression and Support Vector Machines by combining their regularization mechanisms for enhancing robustness. In this paper this novel classifier was tested on four different datasets and an optimal combination of parameters was identified. Furthermore, the influence of the parameter choice on the training time was quantified and methods to efficiently tune the parameters are presented. This prior knowledge about how each parameter influences the training is especially important for big data applications where the training time becomes the bottleneck as well as for applications in which the algorithm is regularly trained on new data.

Original languageEnglish (US)
Title of host publication2013 IEEE International Workshop on Machine Learning for Signal Processing - Proceedings of MLSP 2013
DOIs
StatePublished - 2013
Event2013 16th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2013 - Southampton, United Kingdom
Duration: Sep 22 2013Sep 25 2013

Publication series

NameIEEE International Workshop on Machine Learning for Signal Processing, MLSP
ISSN (Print)2161-0363
ISSN (Electronic)2161-0371

Other

Other2013 16th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2013
Country/TerritoryUnited Kingdom
CitySouthampton
Period9/22/139/25/13

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Signal Processing

Keywords

  • Ridge-SVM
  • parameter tuning
  • training time
  • unified model for supervised learning
  • weight-error-curve (WEC)

Fingerprint

Dive into the research topics of 'Parameter design tradeoff between prediction performance and training time for Ridge-SVM'. Together they form a unique fingerprint.

Cite this