The self-attention-based transformer model was first introduced by Vaswani et al. in their paper Attention Is All You Need in ...