Semanlink - Knowledge distillation ; NLP: pretraining AND Arxiv Doc

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

Arxiv Doc - Discuté avec Raphaël - Domain adaptation (NLP) - Good - Knowledge distillation - Michael Glass - Neural Search - NLP: pretraining - NLP@Facebook - NLP@Microsoft - Pre-Trained Language Models - Question Answering - Retriever-Reader - Self-training - Slot filling - Zero shot -

Knowledge distillation ; NLP: pretraining AND Arxiv Doc

Common descendants

5 Documents

[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval

Tags:

2023-08-27 About

[2207.06300] Re2G: Retrieve, Rerank, Generate

Tags:

2022-07-14 About

[2106.13474] Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains

Tags:

2021-10-21 About

[2010.02194] Self-training Improves Pre-training for Natural Language Understanding

Tags:

2021-03-12 About

[2002.02925] BERT-of-Theseus: Compressing BERT by Progressive Module Replacing

Tags:

2020-02-10 About