Andrew Trask about large language models: The "bigness" is a temporary flaw, not a permanent feature of progress"
Tags:
Au sujet de ce document
Infos sur le fichier
Documents with similar tags (experimental)
Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."
Tags:
2023-02-25 A propos
Jim Fan sur Twitter : "Do you know that DeepMind has actually open-sourced the heart of AlphaGo & AlphaZero?... "
Tags:
2023-02-15 A propos
An empirical analysis of compute-optimal large language model training
Tags:
2023-01-26 A propos
Andrej Karpathy sur Twitter : "Great post (5mo ago) "chinchilla's wild implications" giving context to LLM goldrush shifting from model size to dataset size..."
Tags:
2023-01-05 A propos
Leshem Choshen sur Twitter : "Computational (Chomskian) hierarchies can predict OOD capabilities..."
Tags:
2022-07-11 A propos
Omer Levy sur Twitter : "What if I told you that fine-tuning T5-Large (0.8B params) on a couple hundred examples could outperform GPT-3 (175B params) on a bunch of tasks?"
Tags:
2021-10-13 A propos
Emily M. Bender sur Twitter : "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?"
Tags:
2021-01-23 A propos