TY - GEN
T1 - Improved output coding for classification using continuous relaxation
AU - Crammer, Koby
AU - Singer, Yoram
PY - 2001
Y1 - 2001
N2 - Output coding is a general method for solving multiclass problems by reducing them to multiple binary classification problems. Previous research on output coding has employed, almost solely, predefined discrete codes. We describe an algorithm that improves the performance of output codes by relaxing them to continuous codes. The relaxation procedure is cast as an optimization problem and is reminiscent of the quadratic program for support vector machines. We describe experiments with the proposed algorithm, comparing it to standard discrete output codes. The experimental results indicate that continuous relaxations of output codes often improve the generalization performance, especially for short codes.
AB - Output coding is a general method for solving multiclass problems by reducing them to multiple binary classification problems. Previous research on output coding has employed, almost solely, predefined discrete codes. We describe an algorithm that improves the performance of output codes by relaxing them to continuous codes. The relaxation procedure is cast as an optimization problem and is reminiscent of the quadratic program for support vector machines. We describe experiments with the proposed algorithm, comparing it to standard discrete output codes. The experimental results indicate that continuous relaxations of output codes often improve the generalization performance, especially for short codes.
UR - http://www.scopus.com/inward/record.url?scp=84898939239&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84898939239&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84898939239
SN - 0262122413
SN - 9780262122412
T3 - Advances in Neural Information Processing Systems
BT - Advances in Neural Information Processing Systems 13 - Proceedings of the 2000 Conference, NIPS 2000
PB - Neural information processing systems foundation
T2 - 14th Annual Neural Information Processing Systems Conference, NIPS 2000
Y2 - 27 November 2000 through 2 December 2000
ER -