TL; DR : Übersetzung von Mikhail Nukhovichs Beitrag Was ist Emergent Communication und warum sollte es Sie interessieren : Was ist es, warum wird es benötigt, was sind die Standpunkte zum Problem und zu vielversprechenden Forschungsbereichen. Reinforcement Learning, Verarbeitung natürlicher Sprache, Spieltheorie und Philosophie. Veröffentlichung mit freundlicher Genehmigung des Autors.
Emergent Communication (EC), . , : Workshop on Emergent Communication NeurIPS. EC , ( ).
, , ! , , EC.
Emergent Communication?
Emergent Communication (EC) — , " [] " (Foerster et al., 2016) , [1]. EC — (deep learning), , (deep multi-agent reinforcement learning; MARL); EC .
— , . " ", . , , "", . . , .
"-"
"-" (sender-receiver games) — : [2]. - , , — , .
, , , . , , . , . , , . , , , — . , . , — , [3]: "0" — , "1" — , "2" — .
, "" , ; "1", "2", , . Emergent Communication — . — , , . , , - - . , , EC , "". , — , . .
EC . — , , (Lazaridou et al., 2017) (Resnick et al., 2018). (Havrylov et al., 2017), (Das, Kottur et al., 2017). , , , (Foerster et al., 2016). , , , (Leibo et al., 2017).
Emergent Communication?
, , EC, : ? , . , .
, , RL- . - . EC " " . , , , "" , [4].
, , . , . . (language understanding), , (Lake and Baroni, 2018). , "" .
Emergent Communication . . , , — TCP/IP Bluetooth. , . , .
, , , "" , . , (Kraska et al, 2018). , , , (), .
(policy). , , ? , , . , , . — .
— . : "" , . , , , . , . , — , .
, , , Hanabi (Bard et al., 2019). — . , , .
""
Bottom-Up Natural Language
Emergent Communication, — ( ). EC / . (1953) , . , , natural language understanding (" " NLProc) — "" : . Emergent Communication — "": , , .
: , , , . , , , - . , . , language understanding — , .
Emergent Communication . , , , , , . — , ( ), . , , .
( ) , , mnoukhov at gmail.com. ! , NeurIPS-2019, Workshop on Emergent Communication!
Christine Xu , Travis Lacroix .
Bard, Nolan, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare, Michael Bowling. “The Hanabi Challenge: A New Frontier for AI Research” Artificial Intelligence Nov 2019
Das, Abhishek, Satwik Kottur, José M. F. Moura, Stefan Lee, Dhruv Batra. “Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning.” ICCV 2017
Foerster, Jakob N., Yannis M. Assael, Nando de Freitas and Shimon Whiteson. “Learning to Communicate with Deep Multi-Agent Reinforcement Learning.” NIPS 2016
Havrylov, Serhii, Ivan Titov. “Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols” NIPS 2017
Kraska, Tim, Alex Beutel, Ed H. Chi, Jeffrey Dean and Neoklis Polyzotis. “The Case for Learned Index Structures.”" SIGMOD 2018
Lake, Brenden M., Marco Baroni. “Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks.” ICML 2018
Lazaridou, Angeliki, Karl Moritz Hermann, Karl Tuyls and Stephen Clark. “Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input.” ICLR 2018
Lazaridou, Angeliki, Alexander Peysakhovich and Marco Baroni. “Multi-Agent Cooperation and the Emergence of (Natural) Language.” ICLR 2017
Leibo, Joel Z., Vinícius Flores Zambaldi, Marc Lanctot, Janusz Marecki and Thore Graepel. “Multi-agent Reinforcement Learning in Sequential Social Dilemmas.” AAMAS 2017
Mordatch, Igor and Pieter Abbeel. “Emergence of Grounded Compositional Language in Multi-Agent Populations.” AAAI 2018
Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018
Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018
Wittgenstein, Ludwig. “Philosophical investigations.” 1953.
@misc{noukhovitch2019emergentblogwhy,
author = {Michael Noukhovitch},
title = {What is Emergent Communication and Why You Should Care},
year = {2019}
}
[1]: , (, signalling , , ..), . , , .
[2]: — “signalling games” (Skryms, 2010) “referential games” (Lazaridou et al, 2016) .
[3]: 'grounding'. VIGiL @ NeurIPS 2018.
[4]: , , (Sutton and Barto, 1998).
Emergent Communication – . ? ? ? , , , . “” – . , , , .
— , . ( ; !), kirdin aspr_spb.