Transformers AND NLP@Microsoft
Common descendants
14 Documents
LlamaIndex 🦙 sur X : "Fine-tuning Embedding Models for RAG with LoRA'
Tags:
2024-04-23 About
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Tags:
2023-08-27 About
[2307.08621] Retentive Network: A Successor to Transformer for Large Language Models
Tags:
2023-07-20 About
How to use Alpaca-LoRA to fine-tune a model like ChatGPT
Tags:
2023-05-26 About
State of GPT (Andrej Karpathy at Microsoft Build)
Tags:
2023-05-24 About
BioGPT
Tags:
2023-02-02 About
[2008.12813] HittER: Hierarchical Transformers for Knowledge Graph Embeddings
Tags:
2022-06-30 About
[2004.05119] Beyond Fine-tuning: Few-Sample Sentence Embedding Transfer
Tags:
2022-03-31 About
[2007.15779] Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Tags:
2021-04-11 About
[2002.02925] BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Tags:
2020-02-10 About
Canwen Xu sur Twitter : "WTF? We brutally dismember BERT and replace all his organs?"
Tags:
2020-02-10 About
Robust Language Representation Learning via Multi-task Knowledge Distillation - Microsoft Research
Tags:
2019-05-19 About
[1901.11504] Multi-Task Deep Neural Networks for Natural Language Understanding
Tags:
2019-02-17 About