什么是紧急交流,为什么需要知道

TL; DR:Mikhail Nukhovich的文章的翻译:什么是紧急交流以及您为什么要关心:它是什么,为什么需要它,对问题的看法和有希望的研究领域是什么?强化学习,自然语言处理,博弈论和哲学。经作者的允许发布。


Emergent Communication (EC), . , : Workshop on Emergent Communication NeurIPS. EC , ( ).


, , ! , , EC.


Emergent Communication?


Emergent Communication (EC) — , " [] " (Foerster et al., 2016) , [1]. EC — (deep learning), , (deep multi-agent reinforcement learning; MARL); EC .


— , . " ", . , , "", . . , .


"-"


"-" (sender-receiver games) — : [2]. - , , — , .


最简单的发送器/接收器游戏


, , , . , , . , . , , . , , , — . , . , — , [3]: "0" — , "1" — , "2" — .


, "" , ; "1", "2", , . Emergent Communication — . — , , . , , - - . , , EC , "". , — , . .



EC . — , , (Lazaridou et al., 2017) (Resnick et al., 2018). (Havrylov et al., 2017), (Das, Kottur et al., 2017). , , , (Foerster et al., 2016). , , , (Leibo et al., 2017).


Emergent Communication?


, , EC, : ? , . , .



, , RL- . - . EC " " . , , , "" , [4].


, , . , . . (language understanding), , (Lake and Baroni, 2018). , "" .



Emergent Communication . . , , — TCP/IP Bluetooth. , . , .


, , , "" , . , (Kraska et al, 2018). , , , (), .


(policy). , , ? , , . , , . — .



— . : "" , . , , , . , . , — , .


, , , Hanabi (Bard et al., 2019). — . , , .


""


Bottom-Up Natural Language


Emergent Communication, — ( ). EC / . (1953) , . , , natural language understanding (" " NLProc) — "" : . Emergent Communication — "": , , .


: , , , . , , , - . , . , language understanding — , .



Emergent Communication . , , , , , . — , ( ), . , , .


( ) , , mnoukhov at gmail.com. ! , NeurIPS-2019, Workshop on Emergent Communication!



Christine Xu , Travis Lacroix .



Bard, Nolan, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare, Michael Bowling. “The Hanabi Challenge: A New Frontier for AI Research” Artificial Intelligence Nov 2019


Das, Abhishek, Satwik Kottur, José M. F. Moura, Stefan Lee, Dhruv Batra. “Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning.” ICCV 2017


Foerster, Jakob N., Yannis M. Assael, Nando de Freitas and Shimon Whiteson. “Learning to Communicate with Deep Multi-Agent Reinforcement Learning.” NIPS 2016


Havrylov, Serhii, Ivan Titov. “Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols” NIPS 2017


Kraska, Tim, Alex Beutel, Ed H. Chi, Jeffrey Dean and Neoklis Polyzotis. “The Case for Learned Index Structures.”" SIGMOD 2018


Lake, Brenden M., Marco Baroni. “Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks.” ICML 2018


Lazaridou, Angeliki, Karl Moritz Hermann, Karl Tuyls and Stephen Clark. “Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input.” ICLR 2018


Lazaridou, Angeliki, Alexander Peysakhovich and Marco Baroni. “Multi-Agent Cooperation and the Emergence of (Natural) Language.” ICLR 2017


Leibo, Joel Z., Vinícius Flores Zambaldi, Marc Lanctot, Janusz Marecki and Thore Graepel. “Multi-agent Reinforcement Learning in Sequential Social Dilemmas.” AAMAS 2017


Mordatch, Igor and Pieter Abbeel. “Emergence of Grounded Compositional Language in Multi-Agent Populations.” AAAI 2018


Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018


Resnick, Cinjon, Wes Eldridge, David Ha, Denny Britz, Jakob Foerster, Julian Togelius, Kyunghyun Cho, Joan Bruna. “Pommerman: A Multi-Agent Playground.” Arxiv 2018


Wittgenstein, Ludwig. “Philosophical investigations.” 1953.



@misc{noukhovitch2019emergentblogwhy,
author = {Michael Noukhovitch},
title = {What is Emergent Communication and Why You Should Care},
year = {2019}
}


[1]: , (, signalling , , ..), . , , .


[2]: — “signalling games” (Skryms, 2010) “referential games” (Lazaridou et al, 2016) .


[3]: 'grounding'. VIGiL @ NeurIPS 2018.


[4]: , , (Sutton and Barto, 1998).



Emergent Communication – . ? ? ? , , , . “” – . , , , .


— , . ( ; !), kirdin aspr_spb.

All Articles