Language Model AND NLP@Microsoft
Descendants partagés
35 Documents
LlamaIndex 🦙 sur X : "Fine-tuning Embedding Models for RAG with LoRA'
Tags:
2024-04-23 A propos
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 A propos
Answer.AI - You can now train a 70b language model at home
Tags:
2024-03-09 A propos
GraphRAG: Unlocking LLM discovery on narrative private data - Microsoft Research
Tags:
2024-03-07 A propos
GitHub - microsoft/LLMLingua: To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Tags:
2024-01-18 A propos
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Tags:
2023-11-20 A propos
microsoft/chat-copilot
Tags:
2023-11-16 A propos
microsoft/semantic-kernel: Integrate cutting-edge LLM technology quickly and easily into your apps
Tags:
2023-11-16 A propos
Batched Low-Rank Adaptation of Foundation Models
Tags:
2023-11-12 A propos
microsoft/semantic-kernel: Integrate cutting-edge LLM technology quickly and easily into your apps
Tags:
2023-10-19 A propos
[2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Tags:
2023-09-26 A propos
Sebastien Bubeck sur X : "How far does one billion parameters take you? ... Releasing phi-1.5, a 1.3B parameter LLM exhibiting emergent behaviors surprisingly close to much larger LLMs"
Tags:
2023-09-12 A propos
peft/examples/token_classification/peft_lora_token_cls.ipynb at main · huggingface/peft
Tags:
2023-08-27 A propos
[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Tags:
2023-08-27 A propos
[2307.13269] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
Tags:
2023-08-08 A propos
Parameter-Efficient LLM Finetuning With Low-Rank Adaptation (LoRA) - Lightning AI - Sebastian Raschka
Tags:
2023-07-27 A propos
What is low-rank adaptation (LoRA)? - TechTalks
Tags:
2023-07-27 A propos
LoRA for semantic similarity tasks
Tags:
2023-07-21 A propos
[2307.08621] Retentive Network: A Successor to Transformer for Large Language Models
Tags:
2023-07-20 A propos
[2306.07174] Augmenting Language Models with Long-Term Memory
Tags:
2023-06-13 A propos
How to use Alpaca-LoRA to fine-tune a model like ChatGPT
Tags:
2023-05-26 A propos
[2305.15294] Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy
Tags:
2023-05-26 A propos
State of GPT (Andrej Karpathy at Microsoft Build)
Tags:
2023-05-24 A propos
Google "We Have No Moat, And Neither Does OpenAI"
Tags:
2023-05-04 A propos
[2106.09685] LoRA: Low-Rank Adaptation of Large Language Models
Tags:
2023-03-21 A propos
BioGPT
Tags:
2023-02-02 A propos
[2002.01808] K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
Tags:
2023-01-12 A propos
Talking to Models: Stanford U & Microsoft Method Enables Developers to Correct Model Bugs via Natural Language Patches | Synced
Tags:
2022-11-27 A propos
[2004.05119] Beyond Fine-tuning: Few-Sample Sentence Embedding Transfer
Tags:
2022-03-31 A propos
[2106.13474] Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains
Tags:
2021-10-21 A propos
[2007.15779] Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Tags:
2021-04-11 A propos
[2002.02925] BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Tags:
2020-02-10 A propos
Canwen Xu sur Twitter : "WTF? We brutally dismember BERT and replace all his organs?"
Tags:
2020-02-10 A propos
Robust Language Representation Learning via Multi-task Knowledge Distillation - Microsoft Research
Tags:
2019-05-19 A propos
[1901.11504] Multi-Task Deep Neural Networks for Natural Language Understanding
Tags:
2019-02-17 A propos