Semanlink - Unsupervised deep pre-training ; NLP@Microsoft AND Continued pre-training

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

AI on consumer hardware - Continued pre-training - Jeremy Howard - LLama3 - Parameter-efficient fine-tuning (PEFT) - Quantization - Task-specific models - Twitter thread -

Unsupervised deep pre-training ; NLP@Microsoft AND Continued pre-training

Common descendants

1 Document

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 About