Knowledge distillation ; Pre-Trained Language Models AND Pre-Trained Language Models
Descendants partagés
10 Documents
[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Tags:
2023-08-27 A propos
[2207.06300] Re2G: Retrieve, Rerank, Generate
Tags:
2022-07-14 A propos
Multilingual Sentence Transformers | Pinecone
Tags:
2021-11-04 A propos
[2106.13474] Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains
Tags:
2021-10-21 A propos
NLP Newsletter: The Annotated GPT-2, Understanding self-distillation, Haiku, GANILLA, Sparkwiki, Ethics in NLP, Torchmeta,…
Tags:
2020-02-24 A propos
Distilling BERT models with spaCy - Towards Data Science (2019)
Tags:
2020-02-15 A propos
Hugging Face sur Twitter : DistilBERT-cased for Question Answering w/ just 3 lines of javascript
Tags:
2020-02-14 A propos
[2002.02925] BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Tags:
2020-02-10 A propos
Canwen Xu sur Twitter : "WTF? We brutally dismember BERT and replace all his organs?"
Tags:
2020-02-10 A propos
Smaller, faster, cheaper, lighter: Introducing DistilBERT, a distilled version of BERT
Tags:
2019-08-28 A propos