Robust relevance-based language models

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a new robust relevance model that can be applied to both pseudo feedback and true relevance feedback in the language-modeling framework for document retrieval. There are three main differences between our new relevance model and the Lavrenko-Croft relevance model. The proposed model brings back the original query into the relevance model by treating it as a short, special document, in addition to a number of top ranked documents returned from the first round retrieval for pseudo feedback, or a number of relevant documents for true relevance feedback. Second, instead of using a uniform prior as in the original relevance model, documents are assigned with different priors according to their lengths (in terms) and ranks in the first round retrieval. Third, the probability of a term in the relevance model is further adjusted by its probability in a background language model. In both cases, we have compared the performance of our model to that of the two baselines: the original relevance model and a linear combination model. Our experimental results show that the proposed new model outperforms both of the two baselines in terms of mean average precision.

Original languageEnglish (US)
Title of host publicationProceedings of the Fifth IASTED International Conference on Communications, Internet, and Information Technology, CIIT 2006
Pages341-348
Number of pages8
StatePublished - 2006
Externally publishedYes
Event5th IASTED International Conference on Communications, Internet, and Information Technology, CIIT 2006 - St. Thomas, US Virgin Islands, United States
Duration: Nov 29 2006Dec 1 2006

Publication series

NameProceedings of the Fifth IASTED International Conference on Communications, Internet, and Information Technology, CIIT 2006

Conference

Conference5th IASTED International Conference on Communications, Internet, and Information Technology, CIIT 2006
CountryUnited States
CitySt. Thomas, US Virgin Islands
Period11/29/0612/1/06

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Software

Keywords

  • Feedback
  • Language modeling
  • Query expansion
  • Relevance models

Fingerprint Dive into the research topics of 'Robust relevance-based language models'. Together they form a unique fingerprint.

Cite this