Arxiv Doc ; NLP: pretraining AND NLP@Microsoft
Common descendants
7 Documents
[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Tags:
2023-08-27 About
[2307.08621] Retentive Network: A Successor to Transformer for Large Language Models
Tags:
2023-07-20 About
[2004.05119] Beyond Fine-tuning: Few-Sample Sentence Embedding Transfer
Tags:
2022-03-31 About
[2106.13474] Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains
Tags:
2021-10-21 About
[2007.15779] Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Tags:
2021-04-11 About
[2002.02925] BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Tags:
2020-02-10 About
[1901.11504] Multi-Task Deep Neural Networks for Natural Language Understanding
Tags:
2019-02-17 About