大家好！
如果您对课程有疑问，请参阅下面的“问答”部分。
介绍
我的名字叫Alexei Klokov，我想谈谈自然语言处理课堂课程的启动，这是由DeepPavlov项目的物理技术人员再次启动的-DeepPavlov项目是一个对话式人工智能的开放库，由MIPT的神经系统和深度学习实验室开发。谢谢他们，莫里什卡允许在我们的ods博客上的Habré上涵盖此主题。所以走吧！
图1. DeepPavlov徽标
简要地
C 11- 2020 «Deep Learning in NLP».
NLP . , , . (NLP ), . , , , " ". — cs224n , NLP (. 2019 ). “” !
2. GPU —
, , . python. tensorflow pytorch .
, ( ):
- (Word embeddings: w2v, fasttext GloVe)
- (FFNN, backprop)
- NLP (Language Modeling: RNN. CNN)
- Transfer learning (ELMo, ULMFiT)
- (Attention, seq2seq NMT)
- (Self-Attention, Transformer)
- BERT
- Next steps: GANs in NLP .
( @alexeysorokin89) ( @letmypeoplego).
1 : . , , .9 ( ""), 9235 (2 ).
: 11.02.2019, 19:00.
— inverted classroom. , , / Youtube, , , . :
- . cs224n roadmap. ( ). . 1 . ! >>1<<, >>2<< !
- . , . , . — . Youtube, . ( – transfer learning).
- — . , cs231n. w2v, backprop RNN . 2019 - (peer-reviewed). .. , - – .
- . ( NLP-Researcher). . . cs224n — Question Answering. SQuAD 2.0, . . , . , .
- . inclass competition – .
- : https://forms.gle/1mz9rzoFdf2Von9L7
- — Telegram. . : https://t.me/dlinnlp2020spring; 2020 : https://t.me/joinchat/HdGuOk3LL4J3iDqj8x0i6g
- yorko roadmap ( , … ?) https://github.com/Yorko/dl_in_nlp_deeppavlov_cs224n_spring2020
- , 800+ ( , ): https://t.me/dlinnlp_discuss
Q & A
- road map? — . . .
- ? — .
- , ? — , . .
- , ? — (moryshka). 19:00 11 .
- ( .) , ? — , . !
ODS
OpenDataScience, 2 ML DL. DS (~41 ) ( ) . ODS . Slack. workspace_ods. «DL in NLP» #class_cs224n Slack.
. , , - . PhD University of Massachusetts Lowell Google. . – .
3. c RNN
ods.ai , , , . .
:
“ ”