Alternative to Transformers AND LLM
Common descendants
3 Documents
Albert Gu sur X : "Quadratic attention has been indispensable for information-dense modalities such as language... until now..."
Tags:
2023-12-05 About
[2306.04640] ModuleFormer: Modularity Emerges from Mixture-of-Experts
Tags:
2023-09-16 About
[2307.08621] Retentive Network: A Successor to Transformer for Large Language Models
Tags:
2023-07-20 About