Tweet ; Géographie AND NLP: pretraining
Common descendants
5 Documents
Zain Hasan sur X : "why do large language models pay more attention to and reason better over the beginning and end of what you tell them in prompts?"
Tags:
2023-11-19 About
Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."
Tags:
2023-04-05 About
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 About
Koren Lazar sur Twitter : "...Modern pre-trained language models are applicable even in extreme low-resource settings as the case of the ancient Akkadian language."
Tags:
2021-09-23 About
Inria Paris NLP (ALMAnaCH team) sur Twitter : "#PAGnol, a new, free, GPT-3-like generative LM for French
Tags:
2021-05-04 About