Continued pre-training ; LLaMA AND Parameter-efficient fine-tuning (PEFT)
Common descendants
1 Document
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About