Attention mechanism ; Tweet AND Mémoire
Common descendants
4 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 About
Allen Institute for AI sur Twitter : "MemPrompt, appearing at #EMNLP2022, is a new way to "fix" #GPT3 after deployment via user interaction"
Tags:
2022-12-11 About
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 About