Sponsored by Evolution AI: https://www.evolution.ai
Speakers: Emily Dinan, Adam Lerer and Noam Brown.
Abstract: Despite much progress in training artificial intelligence (AI) systems to imitate human language, building agents that use language to communicate intentionally with humans in interactive environments remains a major challenge. We introduce Cicero, the first AI agent to achieve human-level performance in Diplomacy, a strategy game involving both cooperation and competition that emphasizes natural language negotiation and tactical coordination between seven players. Cicero integrates a language model with planning and reinforcement learning algorithms by inferring players’ beliefs and intentions from its conversations and generating dialogue in pursuit of its plans. Across 40 games of an anonymous online Diplomacy league, Cicero achieved more than double the average score of the human players and ranked in the top 10% of participants who played more than one game.

Bios of Speakers:
Adam Lerer: Adam Lerer is a Research Engineer at Meta AI. Prior to his work on Diplomacy, Adam built agents for Poker and Hanabi, developed systems for machine learning on large scale graphs, and was a member of the original PyTorch developer team. Previously, Adam worked at D. E. Shaw Research where he developed software for Anton, a custom-ASIC supercomputer specialized for performing molecular dynamics simulations of biomolecules.

Noam Brown: Noam Brown is a Research Scientist at Meta AI. He co-created Libratus and Pluribus, the first AIs to defeat top humans in two-player no-limit poker and multiplayer no-limit poker, respectively. Noam has received the Marvin Minsky Medal for Outstanding Achievements in AI, was named one of MIT Tech Review's 35 Innovators Under 35, and his work on Pluribus was named by Science as one of the top 10 scientific breakthroughs of 2019. Noam received his PhD from Carnegie Mellon University, for which he received the AAMAS Victor Lesser Distinguished Dissertation Award, the AAAI ACM-SIGAI Dissertation Award, and the CMU School of Computer Science Distinguished Dissertation Award.

Emily Dinan: Emily Dinan is a Research Engineer at Meta AI in New York. Her research interests include natural language generation and conversational AI, as well as safety and responsibility in these fields. Recently she has focused on methods for controlling generative language models with expert systems. Prior to joining FAIR, she received her master's degree in Mathematics from the University of Washington where she was an NSF Graduate Fellow.