Improving information extraction by acquiring external evidence with reinforcement learning

Karthik Narasimhan, Adam Yala, Regina Barzilay

Research output: Chapter in Book/Report/Conference proceedingConference contribution

33 Scopus citations

Abstract

Most successful information extraction systems operate with access to a large collection of documents. In this work, we explore the task of acquiring and incorporating external evidence to improve extraction accuracy in domains where the amount of training data is scarce. This process entails issuing search queries, extraction from new sources and reconciliation of extracted values, which are repeated until sufficient evidence is collected. We approach the problem using a reinforcement learning framework where our model learns to select optimal actions based on contextual information. We employ a deep Q-network, trained to optimize a reward function that reflects extraction accuracy while penalizing extra effort. Our experiments on two databases - of shooting incidents, and food adulteration cases - demonstrate that our system significantly outperforms traditional extractors and a competitive meta-classifier baseline.

Original languageEnglish (US)
Title of host publicationEMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings
PublisherAssociation for Computational Linguistics (ACL)
Pages2355-2365
Number of pages11
ISBN (Electronic)9781945626258
StatePublished - Jan 1 2016
Event2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016 - Austin, United States
Duration: Nov 1 2016Nov 5 2016

Publication series

NameEMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings

Conference

Conference2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016
CountryUnited States
CityAustin
Period11/1/1611/5/16

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Information Systems
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'Improving information extraction by acquiring external evidence with reinforcement learning'. Together they form a unique fingerprint.

  • Cite this

    Narasimhan, K., Yala, A., & Barzilay, R. (2016). Improving information extraction by acquiring external evidence with reinforcement learning. In EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings (pp. 2355-2365). (EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings). Association for Computational Linguistics (ACL).