AI teams AND Tweet
Common descendants
90 Documents
Zeyuan Allen-Zhu sur X : " surprisingly, when pre-training good data (e.g., Wiki) together with "junks" (e.g., Common Crawl), LLM's capacity on good data may decrease by 20x times!"
Tags:
2024-04-10 About
Omar Khattab sur X : "ColBERT in 81 languages by generalizing from English training! ..."
Tags:
2024-02-28 About
Omar Khattab sur X : "A thread on late interaction, how it works efficiently, and why/where it's been shown to improve quality"
Tags:
2024-02-05 About
Mathieu Trachino sur X : "Why @huggingface Assistants are better than GPTs..."
Tags:
2024-02-03 About
Craig Macdonald sur X : "a thread of our main ColBERT research findings"
Tags:
2024-02-01 About
Jo Kristian Bergum sur X : (on "why using ColBERT?")
Tags:
2024-01-28 About
Rachit Bansal sur X : "An LLM can be efficiently *composed* with specialized (L)LMs to enable new tasks"
Tags:
2024-01-06 About
Maarten Grootendorst sur X : "BERTopic + LLMs + DataMapPlot"
Tags:
2024-01-06 About
Omar Khattab sur X : "A🧵on beating the hardware lottery for retrieval: the internals of the late interaction stack. ColBERT..."
Tags:
2023-12-29 About
UKP Lab sur X : "a lightweight solution for few-shot domain-specific sentence classification: AdaSent!..."
Tags:
2023-12-09 About
Zain Hasan sur X : "why do large language models pay more attention to and reason better over the beginning and end of what you tell them in prompts?"
Tags:
2023-11-19 About
Omar Khattab sur X : "This isn't the main point of this great new paper by @sophiaalthammer et al. But it's incredible how ColBERT at 1000 training queries is better than DPR trained at *50,000* queries!"
Tags:
2023-09-14 About
Philipp Schmid sur X : “YaRN” allows you to scale LLMs like llama 2 to over 100k context!...
Tags:
2023-09-01 About
Andrej Karpathy sur Twitter : "How is LLaMa.cpp possible?"
Tags:
2023-08-16 About
Simon Willison sur Twitter : "Run Llama 2 on your own Mac using LLM and Homebrew..."
Tags:
2023-08-02 About
Andrej Karpathy sur Twitter : "My fun weekend hack: llama2.c Lets you train a baby Llama 2 model in PyTorch, then inference it with one 500-line file with no dependencies, in pure C."
Tags:
2023-07-24 About
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 About
Daniel Daza sur Twitter : "BioBLP, a method for learning embeddings on multimodal knowledge graphs...."
Tags:
2023-06-07 About
Archit Sharma sur Twitter : "Direct Preference Optimization (DPO) allows you to fine-tune LMs directly from preferences via a simple classification loss, no RL required"
Tags:
2023-05-31 About
Eric sur Twitter : "...Introducing Direct Preference Optimization (DPO), a simple classification loss provably equivalent to RLHF"
Tags:
2023-05-31 About
Peter J. Liu sur Twitter : "RLHF-alternative without RL"
Tags:
2023-05-18 About
Hyung Won Chung sur Twitter : "RLHF as an instance of using a learned objective function"
Tags:
2023-05-18 About
DataChazGPT sur Twitter : "The new 𝚝𝚛𝚊𝚗𝚜𝚏𝚘𝚛𝚖𝚎𝚛𝚜.𝚝𝚘𝚘𝚕𝚜 library from @huggingface is insane! E.g. you can summarize and chat with a PDF in just 6 lines of code..."
Tags:
2023-05-14 About
Niels Rogge sur Twitter : "Made some new demo notebooks! - fine-tune @MetaAI's SAM and @GoogleAI's Pix2Struct on custom data"
Tags:
2023-05-09 About
Aran Komatsuzaki sur Twitter : "JaxPruner: A concise library for sparsity research An open-source JAX-based pruning and sparse training library for machine learning research repo"
Tags:
2023-04-28 About
Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."
Tags:
2023-04-05 About
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 About
Niels Rogge sur Twitter : "@GoogleAI's Pix2Struct now available in 🤗 Transformers!"
Tags:
2023-03-27 About
Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."
Tags:
2023-02-25 About
Maria Khalusova @maria@recsys.social sur Twitter : "Did you know that you can tweak the text output generated by a LLM without changing any of the trainable parameters?..."
Tags:
2023-02-23 About
Maarten Grootendorst sur Twitter : "The v0.14 release of BERTopic is here. Fine-tune your topic keywords and labels with models from @OpenAI, @huggingface, @CohereAI, @spacy_io, and @LangChainAI... An overview thread"
Tags:
2023-02-15 About
Jim Fan sur Twitter : "Do you know that DeepMind has actually open-sourced the heart of AlphaGo & AlphaZero?... "
Tags:
2023-02-15 About
Ramsri Goutham Golla sur Twitter : "The most practical open-source competitor to @OpenAI 's GPT-3 is Google's Flan-T5 Here are 5 Flan-T5 resources to try out easily, deploy, or fine-tune it! 🧵" / Twitter
Tags:
2023-02-04 About
Shayne Longpre sur Twitter : "What’s the best completely public competitor to #ChatGPT? Flan-T5 beats all public models we tested..."
Tags:
2023-02-01 About
Omar Khattab sur Twitter : "New features in 𝗖𝗼𝗹𝗕𝗘𝗥𝗧 ‣ Index Updater. Simple API to add/remove documents..."
Tags:
2023-01-30 About
Teklia sur Twitter : "The first text line detection model for historical documents available on @huggingface : paper+code+models, all open-source..."
Tags:
2023-01-28 About
Andrej Karpathy sur Twitter : "Great post (5mo ago) "chinchilla's wild implications" giving context to LLM goldrush shifting from model size to dataset size..."
Tags:
2023-01-05 About
elvis sur Twitter : "NEW: Meta AI introduces OPT-IML, a large language model (175B) fine-tuned on 2000 NLP tasks. Uses instruction-tuning to improve zero-shot and few-shot generalization abilities...."
Tags:
2022-12-23 About
Akari Asai sur Twitter : "Can we solely rely on LLMs’ memories (eg replace search w ChatGPT)? Probably not... Our analysis shows how retrieval is complementary to LLMs’ parametric knowledge..."
Tags:
2022-12-21 About
Rohan Anil sur Twitter : "Next big jump with Neural Network performance is going to happen when community embraces non-uniformity
Tags:
2022-12-18 About
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 About
Stanford NLP Group sur Twitter : "YONO: You Only Need One Model for Open-domain Question Answering..."
Tags:
2022-12-05 About
Stephanie Chan sur Twitter : "Transformer inductive biases..."
Tags:
2022-10-14 About
Lewis Tunstall sur Twitter : "The SetFit library for few-shot learning with Sentence Transformers now supports *multi-label text classification*..."
Tags:
2022-10-14 About
Santiago sur Twitter : "If you have an Apple M1 or M2 and don't take advantage of its GPU, I'm about to change your life..."
Tags:
2022-10-07 About
Yi Tay sur Twitter : "Don't retrieve, recite!..."
Tags:
2022-10-06 About
Thomas Wolf sur Twitter : "you can divide the size of any model in 🤗 transformers: model.int8()"
Tags:
2022-09-26 About
merve sur Twitter : "@huggingface transformers includes a new pipeline called Document Question Answering. This is a pipeline you can use to extract information from PDFs!...
Tags:
2022-09-20 About
Ankur Goyal sur Twitter : "DocQuery, a new #opensource query engine for analyzing documents using large language models (LLMs)..."
Tags:
2022-09-01 About
AllenNLP sur Twitter : "Dataset: training data for @MetaAI 's No Language Left Behind NLLB-200 models!..."
Tags:
2022-08-25 About
Timo Schick sur Twitter : "PEER, a language model trained to incrementally write texts & collaborate w/ humans ..."
Tags:
2022-08-25 About
Karl Higley sur Twitter : "Many ANN search tools (e.g. FAISS, ScaNN) allow you to provide multiple points as part of the same query..."
Tags:
2022-08-20 About
Sylvain Gugger sur Twitter : "Load any HuggingFace model in Int8 precision and save half the memory..."
Tags:
2022-08-11 About
Leshem Choshen sur Twitter : "Computational (Chomskian) hierarchies can predict OOD capabilities..."
Tags:
2022-07-11 About
Lenka Zdeborova sur Twitter : "Amazing lecture of @SebastienBubeck giving intuition on transformers and how to approach them theoretically..."
Tags:
2022-06-30 About
Chris Olah sur Twitter : "I'm excited to *finally* be making progress on understanding the first MLP layer in large transformer LMs. I've tried really hard and prior to SoLU had little success." / Twitter
Tags:
2022-06-27 About
Nils Reimers sur Twitter : "GPL goes multi-lingual..."
Tags:
2022-06-01 About
Ramsri Goutham Golla sur Twitter : "Hi @Nils_Reimers For GPL you used "msmarco-distilbert-base-tas-b" model and ..."
Tags:
2022-04-27 About
Devendra Singh Sachan sur Twitter : "...Unsupervised Passage Re-ranker (UPR), an approach to re-rank retrieved passages for information retrieval tasks."
Tags:
2022-04-18 About
I.A.B sur Twitter : "When we "know the meaning" of a word, what is it that we know? For example, what does knowing the words "dolphin" and "tiger" entail?..."
Tags:
2022-04-15 About
Ikuya Yamada sur Twitter : "Is entity representation effective to improve multilingual language models?..."
Tags:
2022-04-13 About
Tu Vu sur Twitter : "Enormous LMs like GPT-3 exhibit impressive few-shot performance, but w/ self-training a BERT base sized model can achieve much better results!
Tags:
2022-04-13 About
Tengyu Ma sur Twitter : "Pretraining is ≈SoTA for domain adaptation..."
Tags:
2022-04-13 About
Leshem Choshen sur Twitter : "Labelled data is scarce, what can we do?..."
Tags:
2022-04-06 About
Nils Reimers sur Twitter : "Great post on SetFit"
Tags:
2022-03-31 About
(((ل()(ل() 'yoav))))👾 sur Twitter : "... another step in understanding how transformer-based LMs work..."
Tags:
2022-03-30 About
Jason Weston sur Twitter : "SeeKeR: An open source search-augmented language model"
Tags:
2022-03-25 About
Studio Ousia sur Twitter : "Now using LUKE is easier than ever!" / Twitter
Tags:
2022-03-15 About
Andrew Trask about large language models: The "bigness" is a temporary flaw, not a permanent feature of progress"
Tags:
2022-03-13 About
Stanford NLP Group sur Twitter : "...how to use AI systems to augment the work of humans in interactive systems "
Tags:
2022-03-05 About
Nils Reimers sur Twitter : "Creating intent classes for chatbots is challenging This tutorial shows how to use sentence-transformers to find potentially overlapping intent classes and how to improve your data annotation work." / Twitter
Tags:
2022-02-19 About
Nils Reimers sur Twitter : "how to use the fast clustering algorithm from sentence-transformers..."
Tags:
2022-02-19 About
Explosion 💥 sur Twitter : "...annotation tool and AutoNLP to train state-of-the-art NLP models!"
Tags:
2021-12-30 About
AK sur Twitter : "You Only Need One Model for Open-domain Question Answering..."
Tags:
2021-12-23 About
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 About
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 About
Omer Levy sur Twitter : "What if I told you that fine-tuning T5-Large (0.8B params) on a couple hundred examples could outperform GPT-3 (175B params) on a bunch of tasks?"
Tags:
2021-10-13 About
Nils Reimers sur Twitter : EasyNMT Easy-to-use (3 lines of code), state-of-the-art neural machine translations
Tags:
2021-04-27 About
Nils Reimers sur Twitter : "SBERT Release v1.1.0"
Tags:
2021-04-22 About
Nils Reimers sur Twitter : "New models for Neural Information Retrieval..."
Tags:
2021-04-17 About
"Text is the API for humans"
Tags:
2021-03-20 About
Rodrigo Nogueira sur Twitter : "Slides of our WSDM 2021 tutorial "Pretrained Transformers for Text Ranking: BERT and Beyond"
Tags:
2021-03-09 About
Distill our @huggingface zero-shot classifier with your specified class names
Tags:
2021-02-23 About
Hugging Face sur Twitter : "Transformers release of the Retrieval-Augmented Generation model in collaboration with @facebookai!"
Tags:
2021-02-23 About
Pablo Castro sur Twitter : "Random finding of the day for word embeddings: vec("apple")-vec("apples") yields a vector close to ipad, ipod, etc. (apples removes the "fruitness" from apple)
Tags:
2020-12-18 About
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 About
Patrick von Platen sur Twitter : "Today, @huggingface is the start of our Reformer series..."
Tags:
2020-06-29 About
Isabel Cachola sur Twitter : "TLDR: Extreme Summarization of Scientific Documents"
Tags:
2020-05-03 About
Sebastian Riedel sur Twitter : Happy to introduce BLINK, the @facebookai open-source entity linker!...
Tags:
2020-05-02 About
Hugging Face sur Twitter : DistilBERT-cased for Question Answering w/ just 3 lines of javascript
Tags:
2020-02-14 About