Using vocabulary knowledge in Bayesian multinomial estimation

Thomas L. Griffiths; Joshua B. Tenenbaum

Using vocabulary knowledge in Bayesian multinomial estimation

Thomas L. Griffiths, Joshua B. Tenenbaum

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Estimating the parameters of sparse multinomial distributions is an important component of many statistical learning tasks. Recent approaches have used uncertainty over the vocabulary of symbols in a multinomial distribution as a means of accounting for sparsity. We present a Bayesian approach that allows weak prior knowledge, in the form of a small set of approximate candidate vocabularies, to be used to dramatically improve the resulting estimates. We demonstrate these improvements in applications to text compression and estimating distributions over words in newsgroup data.

Original language	English (US)
Title of host publication	Advances in Neural Information Processing Systems 14 - Proceedings of the 2001 Conference, NIPS 2001
Publisher	Neural information processing systems foundation
ISBN (Print)	0262042088, 9780262042086
State	Published - Jan 1 2002
Externally published	Yes
Event	15th Annual Neural Information Processing Systems Conference, NIPS 2001 - Vancouver, BC, Canada Duration: Dec 3 2001 → Dec 8 2001

Publication series

Name	Advances in Neural Information Processing Systems
ISSN (Print)	1049-5258

Other

Other	15th Annual Neural Information Processing Systems Conference, NIPS 2001
Country/Territory	Canada
City	Vancouver, BC
Period	12/3/01 → 12/8/01

All Science Journal Classification (ASJC) codes

Computer Networks and Communications
Information Systems
Signal Processing

Cite this

@inproceedings{47b15f3405a9497d8dd0645f4abf6375,

title = "Using vocabulary knowledge in Bayesian multinomial estimation",

abstract = "Estimating the parameters of sparse multinomial distributions is an important component of many statistical learning tasks. Recent approaches have used uncertainty over the vocabulary of symbols in a multinomial distribution as a means of accounting for sparsity. We present a Bayesian approach that allows weak prior knowledge, in the form of a small set of approximate candidate vocabularies, to be used to dramatically improve the resulting estimates. We demonstrate these improvements in applications to text compression and estimating distributions over words in newsgroup data.",

author = "Griffiths, {Thomas L.} and Tenenbaum, {Joshua B.}",

year = "2002",

month = jan,

day = "1",

language = "English (US)",

isbn = "0262042088",

series = "Advances in Neural Information Processing Systems",

publisher = "Neural information processing systems foundation",

booktitle = "Advances in Neural Information Processing Systems 14 - Proceedings of the 2001 Conference, NIPS 2001",

note = "15th Annual Neural Information Processing Systems Conference, NIPS 2001 ; Conference date: 03-12-2001 Through 08-12-2001",

}

Griffiths, TL & Tenenbaum, JB 2002, Using vocabulary knowledge in Bayesian multinomial estimation. in Advances in Neural Information Processing Systems 14 - Proceedings of the 2001 Conference, NIPS 2001. Advances in Neural Information Processing Systems, Neural information processing systems foundation, 15th Annual Neural Information Processing Systems Conference, NIPS 2001, Vancouver, BC, Canada, 12/3/01.

Using vocabulary knowledge in Bayesian multinomial estimation. / Griffiths, Thomas L.; Tenenbaum, Joshua B.

Advances in Neural Information Processing Systems 14 - Proceedings of the 2001 Conference, NIPS 2001. Neural information processing systems foundation, 2002. (Advances in Neural Information Processing Systems).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Using vocabulary knowledge in Bayesian multinomial estimation

AU - Griffiths, Thomas L.

AU - Tenenbaum, Joshua B.

PY - 2002/1/1

Y1 - 2002/1/1

N2 - Estimating the parameters of sparse multinomial distributions is an important component of many statistical learning tasks. Recent approaches have used uncertainty over the vocabulary of symbols in a multinomial distribution as a means of accounting for sparsity. We present a Bayesian approach that allows weak prior knowledge, in the form of a small set of approximate candidate vocabularies, to be used to dramatically improve the resulting estimates. We demonstrate these improvements in applications to text compression and estimating distributions over words in newsgroup data.

AB - Estimating the parameters of sparse multinomial distributions is an important component of many statistical learning tasks. Recent approaches have used uncertainty over the vocabulary of symbols in a multinomial distribution as a means of accounting for sparsity. We present a Bayesian approach that allows weak prior knowledge, in the form of a small set of approximate candidate vocabularies, to be used to dramatically improve the resulting estimates. We demonstrate these improvements in applications to text compression and estimating distributions over words in newsgroup data.

UR - http://www.scopus.com/inward/record.url?scp=84887129778&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84887129778&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84887129778

SN - 0262042088

SN - 9780262042086

T3 - Advances in Neural Information Processing Systems

BT - Advances in Neural Information Processing Systems 14 - Proceedings of the 2001 Conference, NIPS 2001

PB - Neural information processing systems foundation

T2 - 15th Annual Neural Information Processing Systems Conference, NIPS 2001

Y2 - 3 December 2001 through 8 December 2001

ER -

Using vocabulary knowledge in Bayesian multinomial estimation

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Other files and links

Fingerprint

Cite this