AI teams ; Deep Learning AND Tweet
Common descendants
56 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
Zeyuan Allen-Zhu sur X : " surprisingly, when pre-training good data (e.g., Wiki) together with "junks" (e.g., Common Crawl), LLM's capacity on good data may decrease by 20x times!"
Tags:
2024-04-10 About
Mathieu Trachino sur X : "Why @huggingface Assistants are better than GPTs..."
Tags:
2024-02-03 About
Rachit Bansal sur X : "An LLM can be efficiently *composed* with specialized (L)LMs to enable new tasks"
Tags:
2024-01-06 About
Maarten Grootendorst sur X : "BERTopic + LLMs + DataMapPlot"
Tags:
2024-01-06 About
UKP Lab sur X : "a lightweight solution for few-shot domain-specific sentence classification: AdaSent!..."
Tags:
2023-12-09 About
Zain Hasan sur X : "why do large language models pay more attention to and reason better over the beginning and end of what you tell them in prompts?"
Tags:
2023-11-19 About
Philipp Schmid sur X : “YaRN” allows you to scale LLMs like llama 2 to over 100k context!...
Tags:
2023-09-01 About
Andrej Karpathy sur Twitter : "How is LLaMa.cpp possible?"
Tags:
2023-08-16 About
Simon Willison sur Twitter : "Run Llama 2 on your own Mac using LLM and Homebrew..."
Tags:
2023-08-02 About
Andrej Karpathy sur Twitter : "My fun weekend hack: llama2.c Lets you train a baby Llama 2 model in PyTorch, then inference it with one 500-line file with no dependencies, in pure C."
Tags:
2023-07-24 About
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 About
Daniel Daza sur Twitter : "BioBLP, a method for learning embeddings on multimodal knowledge graphs...."
Tags:
2023-06-07 About
Hyung Won Chung sur Twitter : "RLHF as an instance of using a learned objective function"
Tags:
2023-05-18 About
DataChazGPT sur Twitter : "The new 𝚝𝚛𝚊𝚗𝚜𝚏𝚘𝚛𝚖𝚎𝚛𝚜.𝚝𝚘𝚘𝚕𝚜 library from @huggingface is insane! E.g. you can summarize and chat with a PDF in just 6 lines of code..."
Tags:
2023-05-14 About
Aran Komatsuzaki sur Twitter : "JaxPruner: A concise library for sparsity research An open-source JAX-based pruning and sparse training library for machine learning research repo"
Tags:
2023-04-28 About
Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."
Tags:
2023-04-05 About
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 About
Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."
Tags:
2023-02-25 About
Maria Khalusova @maria@recsys.social sur Twitter : "Did you know that you can tweak the text output generated by a LLM without changing any of the trainable parameters?..."
Tags:
2023-02-23 About
Maarten Grootendorst sur Twitter : "The v0.14 release of BERTopic is here. Fine-tune your topic keywords and labels with models from @OpenAI, @huggingface, @CohereAI, @spacy_io, and @LangChainAI... An overview thread"
Tags:
2023-02-15 About
Jim Fan sur Twitter : "Do you know that DeepMind has actually open-sourced the heart of AlphaGo & AlphaZero?... "
Tags:
2023-02-15 About
Ramsri Goutham Golla sur Twitter : "The most practical open-source competitor to @OpenAI 's GPT-3 is Google's Flan-T5 Here are 5 Flan-T5 resources to try out easily, deploy, or fine-tune it! 🧵" / Twitter
Tags:
2023-02-04 About
Shayne Longpre sur Twitter : "What’s the best completely public competitor to #ChatGPT? Flan-T5 beats all public models we tested..."
Tags:
2023-02-01 About
Andrej Karpathy sur Twitter : "Great post (5mo ago) "chinchilla's wild implications" giving context to LLM goldrush shifting from model size to dataset size..."
Tags:
2023-01-05 About
Akari Asai sur Twitter : "Can we solely rely on LLMs’ memories (eg replace search w ChatGPT)? Probably not... Our analysis shows how retrieval is complementary to LLMs’ parametric knowledge..."
Tags:
2022-12-21 About
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 About
Stephanie Chan sur Twitter : "Transformer inductive biases..."
Tags:
2022-10-14 About
Lewis Tunstall sur Twitter : "The SetFit library for few-shot learning with Sentence Transformers now supports *multi-label text classification*..."
Tags:
2022-10-14 About
Santiago sur Twitter : "If you have an Apple M1 or M2 and don't take advantage of its GPU, I'm about to change your life..."
Tags:
2022-10-07 About
Thomas Wolf sur Twitter : "you can divide the size of any model in 🤗 transformers: model.int8()"
Tags:
2022-09-26 About
merve sur Twitter : "@huggingface transformers includes a new pipeline called Document Question Answering. This is a pipeline you can use to extract information from PDFs!...
Tags:
2022-09-20 About
Ankur Goyal sur Twitter : "DocQuery, a new #opensource query engine for analyzing documents using large language models (LLMs)..."
Tags:
2022-09-01 About
Sylvain Gugger sur Twitter : "Load any HuggingFace model in Int8 precision and save half the memory..."
Tags:
2022-08-11 About
Leshem Choshen sur Twitter : "Computational (Chomskian) hierarchies can predict OOD capabilities..."
Tags:
2022-07-11 About
Lenka Zdeborova sur Twitter : "Amazing lecture of @SebastienBubeck giving intuition on transformers and how to approach them theoretically..."
Tags:
2022-06-30 About
Chris Olah sur Twitter : "I'm excited to *finally* be making progress on understanding the first MLP layer in large transformer LMs. I've tried really hard and prior to SoLU had little success." / Twitter
Tags:
2022-06-27 About
Nils Reimers sur Twitter : "GPL goes multi-lingual..."
Tags:
2022-06-01 About
Ramsri Goutham Golla sur Twitter : "Hi @Nils_Reimers For GPL you used "msmarco-distilbert-base-tas-b" model and ..."
Tags:
2022-04-27 About
Ikuya Yamada sur Twitter : "Is entity representation effective to improve multilingual language models?..."
Tags:
2022-04-13 About
Nils Reimers sur Twitter : "Great post on SetFit"
Tags:
2022-03-31 About
(((ل()(ل() 'yoav))))👾 sur Twitter : "... another step in understanding how transformer-based LMs work..."
Tags:
2022-03-30 About
Studio Ousia sur Twitter : "Now using LUKE is easier than ever!" / Twitter
Tags:
2022-03-15 About
Nils Reimers sur Twitter : "Creating intent classes for chatbots is challenging This tutorial shows how to use sentence-transformers to find potentially overlapping intent classes and how to improve your data annotation work." / Twitter
Tags:
2022-02-19 About
Nils Reimers sur Twitter : "how to use the fast clustering algorithm from sentence-transformers..."
Tags:
2022-02-19 About
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 About
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 About
Omer Levy sur Twitter : "What if I told you that fine-tuning T5-Large (0.8B params) on a couple hundred examples could outperform GPT-3 (175B params) on a bunch of tasks?"
Tags:
2021-10-13 About
Nils Reimers sur Twitter : EasyNMT Easy-to-use (3 lines of code), state-of-the-art neural machine translations
Tags:
2021-04-27 About
Nils Reimers sur Twitter : "SBERT Release v1.1.0"
Tags:
2021-04-22 About
Nils Reimers sur Twitter : "New models for Neural Information Retrieval..."
Tags:
2021-04-17 About
Rodrigo Nogueira sur Twitter : "Slides of our WSDM 2021 tutorial "Pretrained Transformers for Text Ranking: BERT and Beyond"
Tags:
2021-03-09 About
Hugging Face sur Twitter : "Transformers release of the Retrieval-Augmented Generation model in collaboration with @facebookai!"
Tags:
2021-02-23 About
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 About
Patrick von Platen sur Twitter : "Today, @huggingface is the start of our Reformer series..."
Tags:
2020-06-29 About
Hugging Face sur Twitter : DistilBERT-cased for Question Answering w/ just 3 lines of javascript
Tags:
2020-02-14 About