Favoris ; Tweet ; Pre-Trained Language Models AND LMs: context length
Common descendants
5 Documents
Zain Hasan sur X : "why do large language models pay more attention to and reason better over the beginning and end of what you tell them in prompts?"
Tags:
2023-11-19 About
Philipp Schmid sur X : “YaRN” allows you to scale LLMs like llama 2 to over 100k context!...
Tags:
2023-09-01 About
LlamaIndex 🦙 (GPT Index) sur Twitter : "Pretty much everyone building LLM apps over data has to figure out how to... cram arbitrary data into limited context windows?"
Tags:
2023-07-09 About
Aran Komatsuzaki sur Twitter : "Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System Enables LLMs to outperform ChatGPT in scenarios involving ultra-long document summarization or long-term conversations."
Tags:
2023-04-27 About
Aran Komatsuzaki sur Twitter : "Scaling Transformer to 1M tokens and beyond with Recurrent Memory Transformer..."
Tags:
2023-04-25 About