Parameter-Efficient Fine-Tuning using 🤗 PEFT
Tags:
About This Document
File info
Documents with similar tags (experimental)
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
[2404.03592] ReFT: Representation Finetuning for Language Models
Tags:
2024-04-08 About
[2311.11077] Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning
Tags:
2023-11-25 About
P-tuning for sequence classification
Tags:
2023-08-28 About
peft/examples/token_classification/peft_lora_token_cls.ipynb at main · huggingface/peft
Tags:
2023-08-27 About
[2302.06600] Task-Specific Skill Localization in Fine-tuned Language Models
Tags:
2023-08-25 About
Modular and Parameter-Efficient Fine-Tuning for NLP Models
Tags:
2023-08-08 About
EMNLP 2022 Tutorial — “Modular and Parameter-Efficient Fine-Tuning for NLP Models” | by Oscar Shih | Jun, 2023 | Medium
Tags:
2023-08-08 About
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 About
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 About
[2106.09685] LoRA: Low-Rank Adaptation of Large Language Models
Tags:
2023-03-21 About
(((Ů„()(Ů„() 'yoav))))đź‘ľ sur Twitter : "there is this genre of papers that show you can train/tune only some subset of a network's weights, freezing the rest, and things still work as well as (or better than) full training/tuning..."
Tags:
2023-02-15 About
[2205.12410] AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Tags:
2022-12-16 About
[2205.05638] Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Tags:
2022-12-15 About
[2106.10199] BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
Tags:
2022-09-01 About