Coding Attention Is All You Need from Scratch in PyTorch

4 points

5 years ago

A four-part series to code an Attention Transformer from scratch in PyTorch for classifying text

Part - 1: https://thevatsalsaglani.medium.com/question-classification-using-self-attention-transformer-part-1-33e990636e76

Part - 1.1: https://thevatsalsaglani.medium.com/question-classification-using-self-attention-transformer-part-1-1-3b4224cd4757

Part - 2: https://thevatsalsaglani.medium.com/question-classification-using-self-attention-transformer-part-2-910b89c7116a

Part - 3: https://thevatsalsaglani.medium.com/question-classification-using-self-attention-transformer-part-3-74efbda22451