Favoris ; Attention mechanism ; Arxiv Doc ; NLP@Microsoft AND Knowledge distillation
Common descendants
2 Documents
[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Tags:
2023-08-27 About
[2002.02925] BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Tags:
2020-02-10 About