TY - GEN
T1 - Foundation Model Transparency Reports
AU - Bommasani, Rishi
AU - Klyman, Kevin
AU - Longpre, Shayne
AU - Xiong, Betty
AU - Kapoor, Sayash
AU - Maslej, Nestor
AU - Narayanan, Arvind
AU - Liang, Percy
N1 - Publisher Copyright:
Copyright © 2024, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.
PY - 2024
Y1 - 2024
N2 - Foundation models are critical digital technologies with sweeping societal impact that necessitates transparency. To codify how foundation model developers should provide transparency about the development and deployment of their models, we propose Foundation Model Transparency Reports, drawing upon the transparency reporting practices in social media. While external documentation of societal harms prompted social media transparency reports, our objective is to institutionalize transparency reporting for foundation models while the industry is still nascent. To design our reports, we identify 6 design principles given the successes and shortcomings of social media transparency reporting. To further schematize our reports, we draw upon the 100 transparency indicators from the Foundation Model Transparency Index. Given these indicators, we measure the extent to which they overlap with the transparency requirements included in six prominent government policies (e.g. the EU AI Act, the US Executive Order on Safe, Secure, and Trustworthy AI). Well-designed transparency reports could reduce compliance costs, in part due to overlapping regulatory requirements across different jurisdictions. We encourage foundation model developers to regularly publish transparency reports, building upon recommendations from the G7 and the White House.
AB - Foundation models are critical digital technologies with sweeping societal impact that necessitates transparency. To codify how foundation model developers should provide transparency about the development and deployment of their models, we propose Foundation Model Transparency Reports, drawing upon the transparency reporting practices in social media. While external documentation of societal harms prompted social media transparency reports, our objective is to institutionalize transparency reporting for foundation models while the industry is still nascent. To design our reports, we identify 6 design principles given the successes and shortcomings of social media transparency reporting. To further schematize our reports, we draw upon the 100 transparency indicators from the Foundation Model Transparency Index. Given these indicators, we measure the extent to which they overlap with the transparency requirements included in six prominent government policies (e.g. the EU AI Act, the US Executive Order on Safe, Secure, and Trustworthy AI). Well-designed transparency reports could reduce compliance costs, in part due to overlapping regulatory requirements across different jurisdictions. We encourage foundation model developers to regularly publish transparency reports, building upon recommendations from the G7 and the White House.
UR - https://www.scopus.com/pages/publications/105040196550
UR - https://www.scopus.com/pages/publications/105040196550#tab=citedBy
M3 - Conference contribution
AN - SCOPUS:105040196550
T3 - Proceedings of the 7th AAAI/ACM Conference on AI, Ethics, and Society, AIES 2024
SP - 181
EP - 195
BT - Proceedings of the 7th AAAI/ACM Conference on AI, Ethics, and Society, AIES 2024
A2 - Das, Sanmay
A2 - Green, Brian Patrick
A2 - Varshney, Kush
A2 - Ganapini, Marianna
A2 - Renda, Andrea
PB - AAAI press
T2 - 7th AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society, AIES 2024
Y2 - 21 October 2024 through 23 October 2024
ER -