Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
About This Document
File info
Documents with similar tags (experimental)
Sebastian Raschka sur X : "Since Mixture of Expert (MoE) LLMs are all the rage as of this weekend, thanks to the Mixtral-8x-7B release, here's a quick explainer..."
Tags:
2023-12-12 About
Jeremy Howard sur X : "OK everyone's asking me for my take on the OpenAI stuff, so here it is...."
Tags:
2023-11-18 About
Jeremy Howard sur X : "I just uploaded a 90 minute tutorial, which is designed to be the one place I point coders at when they ask "hey, tell me everything I need to know about LLMs!"
Tags:
2023-09-24 About
Jeremy Howard sur X : "It looks like @johnowhitaker & I may have found something crazy: LLMs can nearly perfectly memorise from just 1-2 examples!"
Tags:
2023-09-06 About
spaCy sur Twitter : "NEW transformer library for PyTorch: curated-transformers!"
Tags:
2023-07-14 About
Jeremy Howard sur Twitter : "regulation designed to increase AI safety may backfire badly!"
Tags:
2023-07-11 About
Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."
Tags:
2023-02-25 About
Amin Karbasi sur Twitter : "...Computation ofTransformer models incurs quadratic time/memory complexities in sequence length... Can we dramatically accelerate them?"
Tags:
2023-02-19 About
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 About
Stephanie Chan sur Twitter : "Transformer inductive biases..."
Tags:
2022-10-14 About
Ilias Chalkidis sur Twitter : "Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification..."
Tags:
2022-10-13 About
Rajiv Shah sur Twitter : "How to explain predictions from 🤗 transformer models?..."
Tags:
2022-08-18 About
Jean de Nyandwi sur Twitter : "Efficient Transformers: A Survey..."
Tags:
2022-07-04 About
Lenka Zdeborova sur Twitter : "Amazing lecture of @SebastienBubeck giving intuition on transformers and how to approach them theoretically..."
Tags:
2022-06-30 About
Jeremy Howard sur Twitter : "NLP competition at Kaggle about patent concept similarity...."
Tags:
2022-04-15 About
(((ل()(ل() 'yoav))))👾 sur Twitter : "... another step in understanding how transformer-based LMs work..."
Tags:
2022-03-30 About
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 About
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 About
Javier Abellán sur Twitter : "Tired of not fully understanding the Attention of the Transformer? I've made this illustration for you."
Tags:
2021-01-23 About
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 About
Amit Chaudhary sur Twitter : "How to learn transformers:..."
Tags:
2020-08-23 About
Aran Komatsuzaki sur Twitter : "Big Bird: Transformers for Longer Sequences..."
Tags:
2020-07-29 About
Chaitanya Joshi sur Twitter : "Excited to share a blog post on the connection between #Transformers for NLP and #GraphNeuralNetworks"
Tags:
2020-03-01 About
Jeremy Howard sur Twitter : "The fastai paper (with @GuggerSylvain) covers v2..."
Tags:
2020-02-13 About
Your own hosted blog, the easy, free, open way· fast.ai
Tags:
2020-01-16 About
Jeremy Howard on Twitter: "Such a ridiculously simple idea couldn't possibly work, could it? Or... could it? "
Tags:
2019-02-09 About