Parents:
LLMs: extended context window
Related Tags:
 
CloseDescendants
    9 Documents (Long List) 
    [2404.11018] Many-Shot In-Context Learning
    Tags:
    2024-04-21 About
    Albert Gu sur X : "Quadratic attention has been indispensable for information-dense modalities such as language... until now..."
    Tags:
    2023-12-05 About
    [2310.03025] Retrieval meets Long Context Large Language Models
    Tags:
    2023-10-07 About
    [2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
    Tags:
    2023-09-26 About
    Philipp Schmid sur X : “YaRN” allows you to scale LLMs like llama 2 to over 100k context!...
    Tags:
    2023-09-01 About
    [2307.02486] LongNet: Scaling Transformers to 1,000,000,000 Tokens
    Tags:
    2023-07-06 About
    Aran Komatsuzaki sur Twitter : "Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System Enables LLMs to outperform ChatGPT in scenarios involving ultra-long document summarization or long-term conversations."
    Tags:
    2023-04-27 About
    Aran Komatsuzaki sur Twitter : "Scaling Transformer to 1M tokens and beyond with Recurrent Memory Transformer..."
    Tags:
    2023-04-25 About
    [2203.08913] Memorizing Transformers
    Tags:
    2022-05-07 About
    Properties