Σχετικά με το έγγραφο αυτό
- sl:arxiv_author :
- sl:arxiv_firstAuthor : Anna Rogers
- sl:arxiv_num : 2002.12327
- sl:arxiv_published : 2020-02-27T18:46:42Z
- sl:arxiv_summary : Transformer-based models are now widely used in NLP, but we still do not
understand a lot about their inner workings. This paper describes what is known
to date about the famous BERT model (Devlin et al. 2019), synthesizing over 40
analysis studies. We also provide an overview of the proposed modifications to
the model and its training regime. We then outline the directions for further
research.@en
- sl:arxiv_title : A Primer in BERTology: What we know about how BERT works@en
- sl:arxiv_updated : 2020-02-27T18:46:42Z
- sl:bookmarkOf : https://arxiv.org/abs/2002.12327
- sl:creationDate : 2020-02-28
- sl:creationTime : 2020-02-28T13:25:30Z