Sebastian Raschka sur X : "Since Mixture of Expert (MoE) LLMs are all the rage as of this weekend, thanks to the Mixtral-8x-7B release, here's a quick explainer..."
Tags:
About This Document
File info
Documents with similar tags (experimental)
Christopher Manning sur X : "Now that everyone is writing LLM programs, the idea of doing approximate bayesian inference by sampling along linguistic pipelines (rather than k-best, etc.) is more relevant again"
Tags:
2024-03-19 About
Jeremy Howard sur X : "I just uploaded a 90 minute tutorial, which is designed to be the one place I point coders at when they ask "hey, tell me everything I need to know about LLMs!"
Tags:
2023-09-24 About
Jeremy Howard sur X : "It looks like @johnowhitaker & I may have found something crazy: LLMs can nearly perfectly memorise from just 1-2 examples!"
Tags:
2023-09-06 About
Jerry Liu sur Twitter : "Some critical data considerations that you must take into account to make your LLM application production-ready"
Tags:
2023-07-23 About
spaCy sur Twitter : "NEW transformer library for PyTorch: curated-transformers!"
Tags:
2023-07-14 About
Scott Condron sur Twitter : "a tag-based document explorer with <200 lines of python 1. keyword extraction 2. LLM turns keywords into tags 3. tag docs with LLM 4. document browsing on a weave board"
Tags:
2023-06-29 About
Aran Komatsuzaki sur Twitter : "The False Promise of Imitating Proprietary LLMs..."
Tags:
2023-06-03 About
Aran Komatsuzaki sur Twitter : "Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System Enables LLMs to outperform ChatGPT in scenarios involving ultra-long document summarization or long-term conversations."
Tags:
2023-04-27 About
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 About
Jim Fan sur Twitter : "...NVIDIA AI Foundations "
Tags:
2023-03-24 About
Andrej Karpathy sur Twitter : "Base LLMs (non-finetuned) make very strong few-shot classifiers. Describe task in English, give few examples, read off the label probabilities on test example. No gradient-based optimization necessary. It brings a cannon to a knife fight but is fast, convenient, strong baseline." / Twitter
Tags:
2023-03-19 About
Jerry Liu sur Twitter : "A key goal of @gpt_index is to enable end users to ask an LLM *any* questions over their own data..."
Tags:
2023-02-27 About
abacaj/awesome-transformers: A curated list of awesome transformer models.
Tags:
2023-02-25 About
Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."
Tags:
2023-02-25 About
Maria Khalusova @maria@recsys.social sur Twitter : "Did you know that you can tweak the text output generated by a LLM without changing any of the trainable parameters?..."
Tags:
2023-02-23 About
Amin Karbasi sur Twitter : "...Computation ofTransformer models incurs quadratic time/memory complexities in sequence length... Can we dramatically accelerate them?"
Tags:
2023-02-19 About
Yann LeCun sur Twitter : "On the highway towards Human-Level AI, Large Language Model is an off-ramp."
Tags:
2023-02-05 About
deepset sur Twitter : " Generative models have taken the world of NLP by storm. But LLMs do not know about your personal data. This makes personal assistants, enterprise knowledge management and many other applications challenging. Retrieval augmented pipelines are the answer"
Tags:
2023-02-02 About
Andrej Karpathy sur Twitter : "Great post (5mo ago) "chinchilla's wild implications" giving context to LLM goldrush shifting from model size to dataset size..."
Tags:
2023-01-05 About
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 About
Stephanie Chan sur Twitter : "Transformer inductive biases..."
Tags:
2022-10-14 About
Ilias Chalkidis sur Twitter : "Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification..."
Tags:
2022-10-13 About
Rajiv Shah sur Twitter : "How to explain predictions from 🤗 transformer models?..."
Tags:
2022-08-18 About
Jean de Nyandwi sur Twitter : "Efficient Transformers: A Survey..."
Tags:
2022-07-04 About
Lenka Zdeborova sur Twitter : "Amazing lecture of @SebastienBubeck giving intuition on transformers and how to approach them theoretically..."
Tags:
2022-06-30 About
(((ل()(ل() 'yoav))))👾 sur Twitter : "... another step in understanding how transformer-based LMs work..."
Tags:
2022-03-30 About
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 About
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 About
Javier Abellán sur Twitter : "Tired of not fully understanding the Attention of the Transformer? I've made this illustration for you."
Tags:
2021-01-23 About
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 About
Amit Chaudhary sur Twitter : "How to learn transformers:..."
Tags:
2020-08-23 About
Aran Komatsuzaki sur Twitter : "Big Bird: Transformers for Longer Sequences..."
Tags:
2020-07-29 About
Chaitanya Joshi sur Twitter : "Excited to share a blog post on the connection between #Transformers for NLP and #GraphNeuralNetworks"
Tags:
2020-03-01 About