Semanlink - Parameter-efficient fine-tuning (PEFT) AND Quantization

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

AI on consumer hardware - Continued pre-training - Jeremy Howard - LLama3 - Parameter-efficient fine-tuning (PEFT) - Quantization - Task-specific models - Twitter thread -

Parameter-efficient fine-tuning (PEFT) AND Quantization

Common descendants

QLoRA

2 Documents

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 About

Answer.AI - You can now train a 70b language model at home

Tags:

2024-03-09 About