TL; DR : tradução do post por Mikhail Nukhovich O que é comunicação emergente e por que você deve se importar : o que é, por que é necessário, quais são os pontos de vista sobre o problema e as áreas promissoras de pesquisa. Aprendizado por reforço, processamento de linguagem natural, teoria e filosofia dos jogos. Publicado com a gentil permissão do autor.
Emergent Communication (EC), . , : Workshop on Emergent Communication NeurIPS. EC , ( ).
, , ! , , EC.
Emergent Communication?
Emergent Communication (EC) — , " [] " (Foerster et al., 2016) , [1]. EC — (deep learning), , (deep multi-agent reinforcement learning; MARL); EC .
— , . " ", . , , "", . . , .
"-"
"-" (sender-receiver games) — : [2]. - , , — , .
, , , . , , . , . , , . , , , — . , . , — , [3]: "0" — , "1" — , "2" — .
, "" , ; "1", "2", , . Emergent Communication — . — , , . , , - - . , , EC , "". , — , . .
EC . — , , (Lazaridou et al., 2017) (Resnick et al., 2018). (Havrylov et al., 2017), (Das, Kottur et al., 2017). , , , (Foerster et al., 2016). , , , (Leibo et al., 2017).
Emergent Communication?
, , EC, : ? , . , .
, , RL- . - . EC " " . , , , "" , [4].
, , . , . . (language understanding), , (Lake and Baroni, 2018). , "" .
Emergent Communication . . , , — TCP/IP Bluetooth. , . , .
, , , "" , . , (Kraska et al, 2018). , , , (), .
(policy). , , ? , , . , , . — .
— . : "" , . , , , . , . , — , .
, , , Hanabi (Bard et al., 2019). — . , , .
""
Bottom-Up Natural Language
Emergent Communication, — ( ). EC / . (1953) , . , , natural language understanding (" " NLProc) — "" : . Emergent Communication — "": , , .
: , , , . , , , - . , . , language understanding — , .
Emergent Communication . , , , , , . — , ( ), . , , .
( ) , , mnoukhov at gmail.com. ! , NeurIPS-2019, Workshop on Emergent Communication!
Christine Xu , Travis Lacroix .
Bard, Nolan, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare, Michael Bowling. “The Hanabi Challenge: A New Frontier for AI Research” Artificial Intelligence Nov 2019
Das, Abhishek, Satwik Kottur, José M. F. Moura, Stefan Lee, Dhruv Batra. “Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning.” ICCV 2017
Foerster, Jakob N., Yannis M. Assael, Nando de Freitas and Shimon Whiteson. “Learning to Communicate with Deep Multi-Agent Reinforcement Learning.” NIPS 2016
Havrylov, Serhii, Ivan Titov. “Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols” NIPS 2017
Kraska, Tim, Alex Beutel, Ed H. Chi, Jeffrey Dean and Neoklis Polyzotis. “The Case for Learned Index Structures.”" SIGMOD 2018
Lake, Brenden M., Marco Baroni. “Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks.” ICML 2018
Lazaridou, Angeliki, Karl Moritz Hermann, Karl Tuyls and Stephen Clark. “Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input.” ICLR 2018
Lazaridou, Angeliki, Alexander Peysakhovich and Marco Baroni. “Multi-Agent Cooperation and the Emergence of (Natural) Language.” ICLR 2017
Leibo, Joel Z., Vinícius Flores Zambaldi, Marc Lanctot, Janusz Marecki and Thore Graepel. “Multi-agent Reinforcement Learning in Sequential Social Dilemmas.” AAMAS 2017
Mordatch, Igor and Pieter Abbeel. “Emergence of Grounded Compositional Language in Multi-Agent Populations.” AAAI 2018
Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018
Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018
Wittgenstein, Ludwig. “Philosophical investigations.” 1953.
@misc{noukhovitch2019emergentblogwhy,
author = {Michael Noukhovitch},
title = {What is Emergent Communication and Why You Should Care},
year = {2019}
}
[1]: , (, signalling , , ..), . , , .
[2]: — “signalling games” (Skryms, 2010) “referential games” (Lazaridou et al, 2016) .
[3]: 'grounding'. VIGiL @ NeurIPS 2018.
[4]: , , (Sutton and Barto, 1998).
Emergent Communication – . ? ? ? , , , . “” – . , , , .
— , . ( ; !), kirdin aspr_spb.