Knowledge distillation ; NLP: pretraining AND NLP@Microsoft
Descendants partagés
4 Documents
[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Tags:
2023-08-27 A propos
[2106.13474] Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains
Tags:
2021-10-21 A propos
[2002.02925] BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Tags:
2020-02-10 A propos
Canwen Xu sur Twitter : "WTF? We brutally dismember BERT and replace all his organs?"
Tags:
2020-02-10 A propos