Stephanie Chan sur Twitter : "Transformer inductive biases..."
Tags:
Au sujet de ce document
Infos sur le fichier
Documents with similar tags (experimental)
Sebastian Raschka sur X : "Since Mixture of Expert (MoE) LLMs are all the rage as of this weekend, thanks to the Mixtral-8x-7B release, here's a quick explainer..."
Tags:
2023-12-12 A propos
spaCy sur Twitter : "NEW transformer library for PyTorch: curated-transformers!"
Tags:
2023-07-14 A propos
Peter J. Liu sur Twitter : "RLHF-alternative without RL"
Tags:
2023-05-18 A propos
Aran Komatsuzaki sur Twitter : "JaxPruner: A concise library for sparsity research An open-source JAX-based pruning and sparse training library for machine learning research repo"
Tags:
2023-04-28 A propos
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 A propos
Amin Karbasi sur Twitter : "...Computation ofTransformer models incurs quadratic time/memory complexities in sequence length... Can we dramatically accelerate them?"
Tags:
2023-02-19 A propos
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 A propos
[2202.06991] Transformer Memory as a Differentiable Search Index
Tags:
2022-10-25 A propos
Ilias Chalkidis sur Twitter : "Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification..."
Tags:
2022-10-13 A propos
Yi Tay sur Twitter : "Don't retrieve, recite!..."
Tags:
2022-10-06 A propos
Rajiv Shah sur Twitter : "How to explain predictions from 🤗 transformer models?..."
Tags:
2022-08-18 A propos
Jean de Nyandwi sur Twitter : "Efficient Transformers: A Survey..."
Tags:
2022-07-04 A propos
Lenka Zdeborova sur Twitter : "Amazing lecture of @SebastienBubeck giving intuition on transformers and how to approach them theoretically..."
Tags:
2022-06-30 A propos
Tu Vu sur Twitter : "Enormous LMs like GPT-3 exhibit impressive few-shot performance, but w/ self-training a BERT base sized model can achieve much better results!
Tags:
2022-04-13 A propos
(((ل()(ل() 'yoav))))👾 sur Twitter : "... another step in understanding how transformer-based LMs work..."
Tags:
2022-03-30 A propos
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 A propos
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 A propos
Javier Abellán sur Twitter : "Tired of not fully understanding the Attention of the Transformer? I've made this illustration for you."
Tags:
2021-01-23 A propos
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 A propos
Amit Chaudhary sur Twitter : "How to learn transformers:..."
Tags:
2020-08-23 A propos
Aran Komatsuzaki sur Twitter : "Big Bird: Transformers for Longer Sequences..."
Tags:
2020-07-29 A propos
[2004.07202] Entities as Experts: Sparse Memory Access with Entity Supervision
Tags:
2020-07-11 A propos
Chaitanya Joshi sur Twitter : "Excited to share a blog post on the connection between #Transformers for NLP and #GraphNeuralNetworks"
Tags:
2020-03-01 A propos
Semantic Text Matching for Long-Form Documents (2019)
Tags:
2020-01-23 A propos