Attention mechanism ; Foundation Models ; Self-Attention AND Technical girls and guys
Common descendants
6 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
Easily Finetune Llama 2 for Your Text-to-SQL Applications | by Jerry Liu | Aug, 2023
Tags:
2023-08-18 About
Andrej Karpathy sur Twitter : "How is LLaMa.cpp possible?"
Tags:
2023-08-16 About
Andrej Karpathy sur Twitter : "My fun weekend hack: llama2.c Lets you train a baby Llama 2 model in PyTorch, then inference it with one 500-line file with no dependencies, in pure C."
Tags:
2023-07-24 About
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 About
Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."
Tags:
2023-02-25 About