Tweet ; Fine-tuning AND Parameter-efficient fine-tuning (PEFT)
Common descendants
5 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
UKP Lab sur X : "a lightweight solution for few-shot domain-specific sentence classification: AdaSent!..."
Tags:
2023-12-09 About
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 About
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 About
(((ل()(ل() 'yoav))))👾 sur Twitter : "there is this genre of papers that show you can train/tune only some subset of a network's weights, freezing the rest, and things still work as well as (or better than) full training/tuning..."
Tags:
2023-02-15 About