Generative Transformer LM AND Parameter-efficient fine-tuning (PEFT)
Common descendants
6 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
[2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Tags:
2023-09-26 About
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 About
How to use Alpaca-LoRA to fine-tune a model like ChatGPT
Tags:
2023-05-26 About
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 About
[2205.05638] Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Tags:
2022-12-15 About