TL; DR:Mikhail Nukhovich的文章的翻译:什么是紧急交流以及您为什么要关心:它是什么,为什么需要它,对问题的看法和有希望的研究领域是什么?强化学习,自然语言处理,博弈论和哲学。经作者的允许发布。
Emergent Communication (EC), . , : Workshop on Emergent Communication NeurIPS. EC , ( ).
, , ! , , EC.
Emergent Communication?
Emergent Communication (EC) — , " [] " (Foerster et al., 2016) , [1]. EC — (deep learning), , (deep multi-agent reinforcement learning; MARL); EC .
— , . " ", . , , "", . . , .
"-"
"-" (sender-receiver games) — : [2]. - , , — , .

, , , . , , . , . , , . , , , — . , . , — , [3]: "0" — , "1" — , "2" — .
, "" , ; "1", "2", , . Emergent Communication — . — , , . , , - - . , , EC , "". , — , . .
EC . — , , (Lazaridou et al., 2017) (Resnick et al., 2018). (Havrylov et al., 2017), (Das, Kottur et al., 2017). , , , (Foerster et al., 2016). , , , (Leibo et al., 2017).
Emergent Communication?
, , EC, : ? , . , .
, , RL- . - . EC " " . , , , "" , [4].
, , . , . . (language understanding), , (Lake and Baroni, 2018). , "" .
Emergent Communication . . , , — TCP/IP Bluetooth. , . , .
, , , "" , . , (Kraska et al, 2018). , , , (), .
(policy). , , ? , , . , , . — .
— . : "" , . , , , . , . , — , .
, , , Hanabi (Bard et al., 2019). — . , , .
""
Bottom-Up Natural Language
Emergent Communication, — ( ). EC / . (1953) , . , , natural language understanding (" " NLProc) — "" : . Emergent Communication — "": , , .
: , , , . , , , - . , . , language understanding — , .
Emergent Communication . , , , , , . — , ( ), . , , .
( ) , , mnoukhov
at gmail.com
. ! , NeurIPS-2019, Workshop on Emergent Communication!
Christine Xu , Travis Lacroix .
Bard, Nolan, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare, Michael Bowling. “The Hanabi Challenge: A New Frontier for AI Research” Artificial Intelligence Nov 2019
Das, Abhishek, Satwik Kottur, José M. F. Moura, Stefan Lee, Dhruv Batra. “Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning.” ICCV 2017
Foerster, Jakob N., Yannis M. Assael, Nando de Freitas and Shimon Whiteson. “Learning to Communicate with Deep Multi-Agent Reinforcement Learning.” NIPS 2016
Havrylov, Serhii, Ivan Titov. “Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols” NIPS 2017
Kraska, Tim, Alex Beutel, Ed H. Chi, Jeffrey Dean and Neoklis Polyzotis. “The Case for Learned Index Structures.”" SIGMOD 2018
Lake, Brenden M., Marco Baroni. “Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks.” ICML 2018
Lazaridou, Angeliki, Karl Moritz Hermann, Karl Tuyls and Stephen Clark. “Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input.” ICLR 2018
Lazaridou, Angeliki, Alexander Peysakhovich and Marco Baroni. “Multi-Agent Cooperation and the Emergence of (Natural) Language.” ICLR 2017
Leibo, Joel Z., Vinícius Flores Zambaldi, Marc Lanctot, Janusz Marecki and Thore Graepel. “Multi-agent Reinforcement Learning in Sequential Social Dilemmas.” AAMAS 2017
Mordatch, Igor and Pieter Abbeel. “Emergence of Grounded Compositional Language in Multi-Agent Populations.” AAAI 2018
Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018
Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018
Wittgenstein, Ludwig. “Philosophical investigations.” 1953.
@misc{noukhovitch2019emergentblogwhy,
author = {Michael Noukhovitch},
title = {What is Emergent Communication and Why You Should Care},
year = {2019}
}
[1]: , (, signalling , , ..), . , , .
[2]: — “signalling games” (Skryms, 2010) “referential games” (Lazaridou et al, 2016) .
[3]: 'grounding'. VIGiL @ NeurIPS 2018.
[4]: , , (Sutton and Barto, 1998).
Emergent Communication – . ? ? ? , , , . “” – . , , , .
— , . ( ; !), kirdin aspr_spb.