LMs: context length AND Prompts
Descendants partagés
11 Documents
[2404.11018] Many-Shot In-Context Learning
Tags:
2024-04-21 A propos
GitHub - microsoft/LLMLingua: To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Tags:
2024-01-18 A propos
Albert Gu sur X : "Quadratic attention has been indispensable for information-dense modalities such as language... until now..."
Tags:
2023-12-05 A propos
Zain Hasan sur X : "why do large language models pay more attention to and reason better over the beginning and end of what you tell them in prompts?"
Tags:
2023-11-19 A propos
[2310.03025] Retrieval meets Long Context Large Language Models
Tags:
2023-10-07 A propos
[2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Tags:
2023-09-26 A propos
Philipp Schmid sur X : “YaRN” allows you to scale LLMs like llama 2 to over 100k context!...
Tags:
2023-09-01 A propos
[2307.02486] LongNet: Scaling Transformers to 1,000,000,000 Tokens
Tags:
2023-07-06 A propos
Aran Komatsuzaki sur Twitter : "Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System Enables LLMs to outperform ChatGPT in scenarios involving ultra-long document summarization or long-term conversations."
Tags:
2023-04-27 A propos
Aran Komatsuzaki sur Twitter : "Scaling Transformer to 1M tokens and beyond with Recurrent Memory Transformer..."
Tags:
2023-04-25 A propos
[2203.08913] Memorizing Transformers
Tags:
2022-05-07 A propos