Evaluating vector-space models of analogy

Dawn Chen, Joshua C. Peterson, Thomas L. Griffiths

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

Vector-space representations provide geometric tools for reasoning about the similarity of a set of objects and their relationships. Recent machine learning methods for deriving vector-space embeddings of words (e.g., word2vec) have achieved considerable success in natural language processing. These vector spaces have also been shown to exhibit a surprising capacity to capture verbal analogies, with similar results for natural images, giving new life to a classic model of analogies as parallelograms that was first proposed by cognitive scientists. We evaluate the parallelogram model of analogy as applied to modern word embeddings, providing a detailed analysis of the extent to which this approach captures human relational similarity judgments in a large benchmark dataset. We find that that some semantic relationships are better captured than others. We then provide evidence for deeper limitations of the parallelogram model based on the intrinsic geometric constraints of vector spaces, paralleling classic results for first-order similarity.

Original languageEnglish (US)
Title of host publicationCogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society
Subtitle of host publicationComputational Foundations of Cognition
PublisherThe Cognitive Science Society
Pages1746-1751
Number of pages6
ISBN (Electronic)9780991196760
StatePublished - 2017
Externally publishedYes
Event39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition, CogSci 2017 - London, United Kingdom
Duration: Jul 26 2017Jul 29 2017

Publication series

NameCogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition

Conference

Conference39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition, CogSci 2017
Country/TerritoryUnited Kingdom
CityLondon
Period7/26/177/29/17

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications
  • Human-Computer Interaction
  • Cognitive Neuroscience

Keywords

  • analogy
  • GloVe
  • vector space models
  • word2vec

Fingerprint

Dive into the research topics of 'Evaluating vector-space models of analogy'. Together they form a unique fingerprint.

Cite this