Semanlink - LM Fine-tuning AND Quantization

Impression

Recherche de Mot-clé

Recherche de Doc

Préférences...

Mots-clés liés

AI on consumer hardware - Continued pre-training - Jeremy Howard - LLama3 - Parameter-efficient fine-tuning (PEFT) - Quantization - Task-specific models - Twitter thread -

LM Fine-tuning AND Quantization

Descendants partagés

QLoRA

2 Documents

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 A propos

Answer.AI - You can now train a 70b language model at home

Tags:

2024-03-09 A propos