TY - JOUR
T1 - Semantics derived automatically from language corpora contain human-like biases
AU - Caliskan, Aylin
AU - Bryson, Joanna J.
AU - Narayanan, Arvind
N1 - Publisher Copyright:
© 2017, American Association for the Advancement of Science. All rights reserved.
PY - 2017/4/14
Y1 - 2017/4/14
N2 - Machine learning is a means to derive artificial intelligence by discovering patterns in existing data. Here, we show that applying machine learning to ordinary human language results in human-like semantic biases. We replicated a spectrum of known biases, as measured by the Implicit Association Test, using a widely used, purely statistical machine-learning model trained on a standard corpus of text from the World Wide Web. Our results indicate that text corpora contain recoverable and accurate imprints of our historic biases, whether morally neutral as toward insects or flowers, problematic as toward race or gender, or even simply veridical, reflecting the status quo distribution of gender with respect to careers or first names. Our methods hold promise for identifying and addressing sources of bias in culture, including technology.
AB - Machine learning is a means to derive artificial intelligence by discovering patterns in existing data. Here, we show that applying machine learning to ordinary human language results in human-like semantic biases. We replicated a spectrum of known biases, as measured by the Implicit Association Test, using a widely used, purely statistical machine-learning model trained on a standard corpus of text from the World Wide Web. Our results indicate that text corpora contain recoverable and accurate imprints of our historic biases, whether morally neutral as toward insects or flowers, problematic as toward race or gender, or even simply veridical, reflecting the status quo distribution of gender with respect to careers or first names. Our methods hold promise for identifying and addressing sources of bias in culture, including technology.
UR - http://www.scopus.com/inward/record.url?scp=85018471624&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85018471624&partnerID=8YFLogxK
U2 - 10.1126/science.aal4230
DO - 10.1126/science.aal4230
M3 - Article
C2 - 28408601
AN - SCOPUS:85018471624
SN - 0036-8075
VL - 356
SP - 183
EP - 186
JO - Science
JF - Science
IS - 6334
ER -