15. Neural networks for sequences

We now consider model where inputs, outputs or both that are sequences. Such models have many applications in machine translation, speech recognition or text classification.

15.2 Recurrent neural networks (RNNs)
15.3 1d CNNs
15.4 Attention
15.5 Transformers
15.6 Efficient transformers
15.7 Language models and unsupervised representation learning