TY - GEN
T1 - More Victories, Less Cooperation
T2 - 62nd Annual Meeting of the Association for Computational Linguistics, ACL 2024
AU - Wongkamjan, Wichayaporn
AU - Gu, Feng
AU - Wang, Yanze
AU - Hermjakob, Ulf
AU - May, Jonathan
AU - Stewart, Brandon M.
AU - Kummerfeld, Jonathan K.
AU - Peskoff, Denis
AU - Boyd-Graber, Jordan Lee
N1 - Publisher Copyright:
© 2024 Association for Computational Linguistics.
PY - 2024
Y1 - 2024
N2 - The boardgame Diplomacy is a challenging setting for communicative and cooperative artificial intelligence. The most prominent communicative Diplomacy AI, Cicero, has excellent strategic abilities, exceeding human players. However, the best Diplomacy players master communication, not just tactics, which is why the game has received attention as an AI challenge. This work seeks to understand the degree to which Cicero succeeds at communication. First, we annotate in-game communication with abstract meaning representation to separate in-game tactics from general language. Second, we run two dozen games with humans and Cicero, totaling over 200 human-player hours of competition. While AI can consistently outplay human players, AI-Human communication is still limited because of AI's difficulty with deception and persuasion. This shows that Cicero relies on strategy and has not yet reached the full promise of communicative and cooperative AI.
AB - The boardgame Diplomacy is a challenging setting for communicative and cooperative artificial intelligence. The most prominent communicative Diplomacy AI, Cicero, has excellent strategic abilities, exceeding human players. However, the best Diplomacy players master communication, not just tactics, which is why the game has received attention as an AI challenge. This work seeks to understand the degree to which Cicero succeeds at communication. First, we annotate in-game communication with abstract meaning representation to separate in-game tactics from general language. Second, we run two dozen games with humans and Cicero, totaling over 200 human-player hours of competition. While AI can consistently outplay human players, AI-Human communication is still limited because of AI's difficulty with deception and persuasion. This shows that Cicero relies on strategy and has not yet reached the full promise of communicative and cooperative AI.
UR - http://www.scopus.com/inward/record.url?scp=85204455622&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85204455622&partnerID=8YFLogxK
U2 - 10.18653/v1/2024.acl-long.672
DO - 10.18653/v1/2024.acl-long.672
M3 - Conference contribution
AN - SCOPUS:85204455622
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 12423
EP - 12441
BT - Long Papers
A2 - Ku, Lun-Wei
A2 - Martins, Andre F. T.
A2 - Srikumar, Vivek
PB - Association for Computational Linguistics (ACL)
Y2 - 11 August 2024 through 16 August 2024
ER -