Semanlink - Continued pre-training ; Quantization AND Task-specific models

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

AI on consumer hardware - Continued pre-training - Jeremy Howard - LLama3 - Parameter-efficient fine-tuning (PEFT) - Quantization - Task-specific models - Twitter thread -

Continued pre-training ; Quantization AND Task-specific models

Common descendants

1 Document

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 About