Semanlink - Answer.AI - You can now train a 70b language model at home

Printer friendly

Search Tag:

Search Doc:

Preferences...

Answer.AI - You can now train a 70b language model at home

Tags:

About This Document

sl:bookmarkOf : https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
sl:creationDate : 2024-03-09
sl:creationTime : 2024-03-09T10:06:03Z

File info

Bookmark of: https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html

Documents with similar tags (experimental)

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 About