Amin Karbasi sur Twitter : "...Computation ofTransformer models incurs quadratic time/memory complexities in sequence length... Can we dramatically accelerate them?"
Tags:
Au sujet de ce document
Infos sur le fichier
Documents with similar tags (experimental)
Sebastian Raschka sur X : "Since Mixture of Expert (MoE) LLMs are all the rage as of this weekend, thanks to the Mixtral-8x-7B release, here's a quick explainer..."
Tags:
2023-12-12 A propos
spaCy sur Twitter : "NEW transformer library for PyTorch: curated-transformers!"
Tags:
2023-07-14 A propos
[2307.02486] LongNet: Scaling Transformers to 1,000,000,000 Tokens
Tags:
2023-07-06 A propos
Aran Komatsuzaki sur Twitter : "Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System Enables LLMs to outperform ChatGPT in scenarios involving ultra-long document summarization or long-term conversations."
Tags:
2023-04-27 A propos
Aran Komatsuzaki sur Twitter : "Scaling Transformer to 1M tokens and beyond with Recurrent Memory Transformer..."
Tags:
2023-04-25 A propos
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 A propos
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 A propos
Stephanie Chan sur Twitter : "Transformer inductive biases..."
Tags:
2022-10-14 A propos
Ilias Chalkidis sur Twitter : "Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification..."
Tags:
2022-10-13 A propos
Rajiv Shah sur Twitter : "How to explain predictions from 🤗 transformer models?..."
Tags:
2022-08-18 A propos
Jean de Nyandwi sur Twitter : "Efficient Transformers: A Survey..."
Tags:
2022-07-04 A propos
Lenka Zdeborova sur Twitter : "Amazing lecture of @SebastienBubeck giving intuition on transformers and how to approach them theoretically..."
Tags:
2022-06-30 A propos
(((ل()(ل() 'yoav))))👾 sur Twitter : "... another step in understanding how transformer-based LMs work..."
Tags:
2022-03-30 A propos
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 A propos
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 A propos
Javier Abellán sur Twitter : "Tired of not fully understanding the Attention of the Transformer? I've made this illustration for you."
Tags:
2021-01-23 A propos
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 A propos
Amit Chaudhary sur Twitter : "How to learn transformers:..."
Tags:
2020-08-23 A propos
Aran Komatsuzaki sur Twitter : "Big Bird: Transformers for Longer Sequences..."
Tags:
2020-07-29 A propos
Chaitanya Joshi sur Twitter : "Excited to share a blog post on the connection between #Transformers for NLP and #GraphNeuralNetworks"
Tags:
2020-03-01 A propos