Vapnik-Chervonenkis entropy of the spherical perceptron

P. Riegler; Hyunjune Sebastian Seung

doi:10.1103/PhysRevE.55.3283

Vapnik-Chervonenkis entropy of the spherical perceptron

P. Riegler, Hyunjune Sebastian Seung

Research output: Contribution to journal › Article › peer-review

5 Scopus citations

Abstract

Perceptron learning of randomly labeled patterns is analyzed using a Gibbs distribution on the set of realizable labelings of the patterns. The entropy of this distribution is an extension of the Vapnik-Chervonenkis (VC) entropy, reducing to it exactly in the limit of infinite temperature. The close relationship between the VC and Gardner entropies can be seen within the replica formalism.

Original language	English (US)
Pages (from-to)	3283-3287
Number of pages	5
Journal	Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics
Volume	55
Issue number	3
DOIs	https://doi.org/10.1103/PhysRevE.55.3283
State	Published - 1997

All Science Journal Classification (ASJC) codes

Statistical and Nonlinear Physics
Statistics and Probability
Condensed Matter Physics

Access to Document

10.1103/PhysRevE.55.3283

Cite this

@article{4a765ca6d8b641d5b2f38f6e7c726cff,

title = "Vapnik-Chervonenkis entropy of the spherical perceptron",

abstract = "Perceptron learning of randomly labeled patterns is analyzed using a Gibbs distribution on the set of realizable labelings of the patterns. The entropy of this distribution is an extension of the Vapnik-Chervonenkis (VC) entropy, reducing to it exactly in the limit of infinite temperature. The close relationship between the VC and Gardner entropies can be seen within the replica formalism.",

author = "P. Riegler and Seung, {Hyunjune Sebastian}",

year = "1997",

doi = "10.1103/PhysRevE.55.3283",

language = "English (US)",

volume = "55",

pages = "3283--3287",

journal = "Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics",

issn = "1063-651X",

publisher = "American Physical Society",

number = "3",

}

TY - JOUR

T1 - Vapnik-Chervonenkis entropy of the spherical perceptron

AU - Riegler, P.

AU - Seung, Hyunjune Sebastian

PY - 1997

Y1 - 1997

N2 - Perceptron learning of randomly labeled patterns is analyzed using a Gibbs distribution on the set of realizable labelings of the patterns. The entropy of this distribution is an extension of the Vapnik-Chervonenkis (VC) entropy, reducing to it exactly in the limit of infinite temperature. The close relationship between the VC and Gardner entropies can be seen within the replica formalism.

AB - Perceptron learning of randomly labeled patterns is analyzed using a Gibbs distribution on the set of realizable labelings of the patterns. The entropy of this distribution is an extension of the Vapnik-Chervonenkis (VC) entropy, reducing to it exactly in the limit of infinite temperature. The close relationship between the VC and Gardner entropies can be seen within the replica formalism.

UR - http://www.scopus.com/inward/record.url?scp=0003177442&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0003177442&partnerID=8YFLogxK

U2 - 10.1103/PhysRevE.55.3283

DO - 10.1103/PhysRevE.55.3283

M3 - Article

AN - SCOPUS:0003177442

SN - 1063-651X

VL - 55

SP - 3283

EP - 3287

JO - Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics

JF - Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics

IS - 3

ER -

Vapnik-Chervonenkis entropy of the spherical perceptron

Abstract

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this