Transformers: improvements AND Twitter thread
Common descendants
1 Document
Matteo Pagliardini sur X : "#DenseFormer, a simple modification that performs—after each transformer block—a weighted average of past representations."
Tags:
2024-03-23 About