Alternative to Transformers ; Artificial Intelligence AND Data science
Common descendants
6 Documents
[2405.06394] Memory Mosaics
Tags:
2024-05-17 About
Albert Gu sur X : "Quadratic attention has been indispensable for information-dense modalities such as language... until now..."
Tags:
2023-12-05 About
Ben Hoover sur X : "Energy Transformer (ET): A novel architecture combining 3 prominent ideas in AI..."
Tags:
2023-12-02 About
[2306.04640] ModuleFormer: Modularity Emerges from Mixture-of-Experts
Tags:
2023-09-16 About
[2307.08621] Retentive Network: A Successor to Transformer for Large Language Models
Tags:
2023-07-20 About
AK sur Twitter : "HyperMixer: An MLP-based Green AI Alternative to Transformers"
Tags:
2022-03-16 About