- Slides
- CS231 lecture on RNNs - video
- Our lecture, seminar(pytorch), seminar(theano) (both russian)
- [alternative] Brief lecture on RNN by nervana - video
- [alternative] More detailed lecture by Y. Bengio - video
- Great reading by Karpathy - blog post
- LSTM explained in detail by colah - blog post
- Seq2seq lecture - video
- "Awesome rnn" entry point - repo
- OpenAI research on sentiment analysis that sheds some light on what's inside LSTM language model.
This week's practice gets you acquainted with basics of recurrent neural networks. For simplicity, we'll train them on character language modelling task. Pick any one of seminar_lasagne
, seminar_lasagne_ingraph
or seminar_tf
.
As for difference btwn seminar_lasagne
and seminar_lasagne_ingraph
- ingraph version shows a lower-level interface to recurrent neural networks. It also requires you to install pip install https://github.com/yandexdataschool/agentnet/archive/master.zip
. Out-of-graph version cover higher-level syntax from native lasagne.