Attention Is All You Need

Research Publication

Introduces an attention-based architecture for sequence transduction, separating sequence modelling from recurrent and convolutional network designs. Authors: Vaswani, Ashish; Shazeer, Noam; Parmar, Niki; Uszkoreit, Jakob; Jones, Llion; Gomez, Aidan N.; Kaiser, Lukasz; Polosukhin, Illia Year: 2017 Venue: NeurIPS 2017 Research topics: Transformer architecture; self-attention; sequence modelling; neural machine translation DOI / identifier status: 10.48550/arXiv.1706.03762 Open text / access status: https://arxiv.org/abs/1706.03762 2017 preprint and conference work. The stored DOI identifies the arXiv version. Reference: https://arxiv.org/abs/1706.03762 Curation scope: edition-aware bibliographic consistency and thematic learning associations. A publisher catalogue link or verified DOI does not by itself imply unrestricted full-text access.

Related Skills: -

Related Technologies: TensorFlow

Related Careers: -

Related Sectors: -