Materials

• Slides
• CS231 lecture on RNNs - video
• Our lecture, seminar (PyTorch) (in russian)
• [alternative] Brief lecture on RNN by nervana - video
• [alternative] More detailed lecture by Y. Bengio - video
• Great reading by Karpathy - blog post
• LSTM explained in detail by colah - blog post

More materials

• Seq2seq lecture - video
• "Awesome rnn" entry point - repo
• OpenAI research on sentiment analysis that sheds some light on what's inside LSTM language model.

Homework description

This week's practice gets you acquainted with basics of recurrent neural networks. For simplicity, we'll train them on character language modelling task. You'll need seminar_pytorch.ipynb or seminar_tf.ipynb.