BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Research Publication

Presents bidirectional transformer pre-training and fine-tuning for language understanding tasks, including masked language modelling and task transfer. Authors: Devlin, Jacob; Chang, Ming-Wei; Lee, Kenton; Toutanova, Kristina Year: 2018 Venue: arXiv preprint (2018); conference version: NAACL-HLT 2019 Research topics: Bidirectional language representations; pre-training; transfer learning; natural language understanding DOI / identifier status: 10.48550/arXiv.1810.04805 Open text / access status: https://arxiv.org/abs/1810.04805 The recorded year and DOI identify the 2018 arXiv preprint; the conference version appeared at NAACL-HLT 2019. Reference: https://arxiv.org/abs/1810.04805 Curation scope: edition-aware bibliographic consistency and thematic learning associations. A publisher catalogue link or verified DOI does not by itself imply unrestricted full-text access.

Related Skills: -

Related Technologies: PyTorch, Hugging Face Transformers

Related Careers: -

Related Sectors: -