Transformer and Its Architectural Evolution.
Self-Attention Mechanism.
Memory Augmented Neural Network.
Attention Mechanism in Seq2Seq Models.
Sequence to sequence.
Capsule Network.