Prompting/In-context learning AND Transformers
Descendants partagés
13 Documents
Albert Gu sur X : "Quadratic attention has been indispensable for information-dense modalities such as language... until now..."
Tags:
2023-12-05 A propos
Philipp Schmid sur X : “YaRN” allows you to scale LLMs like llama 2 to over 100k context!...
Tags:
2023-09-01 A propos
[2307.02486] LongNet: Scaling Transformers to 1,000,000,000 Tokens
Tags:
2023-07-06 A propos
[2306.07536] TART: A plug-and-play Transformer module for task-agnostic reasoning
Tags:
2023-06-15 A propos
Aran Komatsuzaki sur Twitter : "Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System Enables LLMs to outperform ChatGPT in scenarios involving ultra-long document summarization or long-term conversations."
Tags:
2023-04-27 A propos
Aran Komatsuzaki sur Twitter : "Scaling Transformer to 1M tokens and beyond with Recurrent Memory Transformer..."
Tags:
2023-04-25 A propos
Andrej Karpathy sur Twitter : "Next frontier of prompt engineering imo: "AutoGPTs"..."
Tags:
2023-04-02 A propos
Prompting, Instruction Finetuning, and RLHF (CS224N)
Tags:
2023-02-16 A propos
Riley Goodside sur Twitter : "OpenAI’s ChatGPT is susceptible to prompt injection — say the magic words, “Ignore previous directions”, and..."
Tags:
2022-12-18 A propos
[2208.01066] What Can Transformers Learn In-Context? A Case Study of Simple Function Classes
Tags:
2022-09-17 A propos
[2201.04337] PromptBERT: Improving BERT Sentence Embeddings with Prompts
Tags:
2022-09-16 A propos
Prompt Tuning BERT🎯:CommonLit Readability | Kaggle
Tags:
2022-09-16 A propos
Prompting: Better Ways of Using Language Models for NLP Tasks
Tags:
2022-07-12 A propos