Explanation video: https://youtu.be/9qSEFFqdXdA

Molecule attention transformer (MAT) is an interesting application of the transformer architecture on chemistry domain. MAT shows the very promising and intriguing results on the several molecule property prediction tasks and also paves the way for more adaptation of deep learning approaches in chemistry research.