Semanlink - Answer.AI - You can now train a 70b language model at home

Impression

Recherche de Mot-clé

Recherche de Doc

Préférences...

Answer.AI - You can now train a 70b language model at home

Tags:

Au sujet de ce document

sl:bookmarkOf : https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
sl:creationDate : 2024-03-09
sl:creationTime : 2024-03-09T10:06:03Z

Infos sur le fichier

Bookmark of: https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html

Documents with similar tags (experimental)

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 A propos