Unsupervised machine learning ; NLP girls and guys AND Tweet
Common descendants
64 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
Christopher Manning sur X : "Now that everyone is writing LLM programs, the idea of doing approximate bayesian inference by sampling along linguistic pipelines (rather than k-best, etc.) is more relevant again"
Tags:
2024-03-19 About
Krista Opsahl-Ong sur X : "Got a pipeline with **multiple prompts**, like a DSPy program? ... Introducing MIPRO, a Multi-prompt Instruction Proposal Optimizer...."
Tags:
2024-03-09 About
Jerry Liu sur X : "To better augment LLMs with context, it makes a lot of sense to organize context not just as a flat list of text chunks, but as a hierarchy of high-level to low-level details. RAPTOR..."
Tags:
2024-03-03 About
Omar Khattab sur X : "ColBERT in 81 languages by generalizing from English training! ..."
Tags:
2024-02-28 About
Omar Khattab sur X : "A thread on late interaction, how it works efficiently, and why/where it's been shown to improve quality"
Tags:
2024-02-05 About
Jerry Liu sur X : "Build a RAG backend over any website in a single CLI command ..."
Tags:
2024-02-03 About
Craig Macdonald sur X : "a thread of our main ColBERT research findings"
Tags:
2024-02-01 About
Jo Kristian Bergum sur X : (on "why using ColBERT?")
Tags:
2024-01-28 About
Jerry Liu sur X : "4 Levels of Agents for RAG..."
Tags:
2024-01-23 About
LlamaIndex: "Instead of using a global fixed chunk size for RAG, try splitting based on the semantics of the text"
Tags:
2024-01-13 About
Omar Khattab sur X : "...Let's use 30 lines of DSPy—without any hand-written prompts or any calls to OpenAI ($0)—to teach..."
Tags:
2024-01-01 About
Omar Khattab sur X : "A🧵on beating the hardware lottery for retrieval: the internals of the late interaction stack. ColBERT..."
Tags:
2023-12-29 About
Jerry Liu sur X : "Naive chunking strategies cause poor RAG performance...."
Tags:
2023-12-06 About
Jerry Liu sur X : "evaluating RAG: purely evaluating retrieval metrics (MRR, precision) isn’t the whole picture - you need end-to-end response evals..."
Tags:
2023-09-26 About
Jeremy Howard sur X : "I just uploaded a 90 minute tutorial, which is designed to be the one place I point coders at when they ask "hey, tell me everything I need to know about LLMs!"
Tags:
2023-09-24 About
Omar Khattab sur X : "This isn't the main point of this great new paper by @sophiaalthammer et al. But it's incredible how ColBERT at 1000 training queries is better than DPR trained at *50,000* queries!"
Tags:
2023-09-14 About
Jerry Liu sur X : "A simple trick to improve retrieval for RAG 💡: Embed “references” to each text chunk instead of the chunk itself (e.g. smaller chunks, summaries)..."
Tags:
2023-09-06 About
Jeremy Howard sur X : "It looks like @johnowhitaker & I may have found something crazy: LLMs can nearly perfectly memorise from just 1-2 examples!"
Tags:
2023-09-06 About
Jerry Liu sur X : "how do you get a good retrieval dataset w/o spending a ton of money on human labels? Answer: use LLMs"
Tags:
2023-08-30 About
Jerry Liu sur X : "One major way to improve your RAG system is to fine-tune your embedding model"
Tags:
2023-08-25 About
Omar Khattab sur X : "Announcing 𝗗𝗦𝗣y..."
Tags:
2023-08-24 About
Jerry Liu sur X : "8 key considerations for building *production-grade* LLM apps over your data (RAG)..."
Tags:
2023-08-20 About
Jerry Liu on X: “Graph RAG” in @llama_index: a new method of augmenting LLMs with context from a graph database
Tags:
2023-08-17 About
Jerry Liu sur Twitter : "Some critical data considerations that you must take into account to make your LLM application production-ready"
Tags:
2023-07-23 About
Jerry Liu sur Twitter : "if you have access to a rich query language (e.g. SQL / any DSL), use a vector db to index additional metadata to help the LLM execute queries using this query language, while preventing prompt overflows!
Tags:
2023-07-20 About
Nils Reimers sur Twitter : "Cross-Lingual Text-Classification just from English Data"
Tags:
2023-07-20 About
Jerry Liu sur Twitter : "Using cross-encoding as a reranking step can dramatically speed up LLM inference time AND improve accuracy!"
Tags:
2023-07-20 About
Jerry Liu sur Twitter : Hot take: if you want to... deliver technical differentiation, you will need to learn LLM development in a “bottoms-up” fashion
Tags:
2023-07-16 About
Jerry Liu sur Twitter : "Adding metadata to text can help w/ disambiguation and boost retrieval performance for LLM QA systems, using LLMs to... extract rich context to augment each chunk"
Tags:
2023-07-09 About
Jerry Liu sur Twitter : "If you’re building “chat over your PDFs” with LLMs, you need to deal with the pesky issue of how to parse embedded tables/diagrams..."
Tags:
2023-07-07 About
Sanjeev Arora sur Twitter : "new `skills' induced by LLM fine-tuning can be localized in tiny fraction of the model."
Tags:
2023-07-07 About
Jerry Liu sur Twitter : "LLMs can directly extract structured data (esp w/ Function API), but can be slow/expensive. 🤔 Instead: use LLMs to generate code, run code to extract data..."
Tags:
2023-07-03 About
Jerry Liu sur Twitter : "The `camelot` package is an awesome module for extracting tables from PDFs..."
Tags:
2023-07-03 About
Jerry Liu sur Twitter : "The DSP project carries a lot of insights for improving RAG..."
Tags:
2023-06-18 About
Jerry Liu sur Twitter : "The new OpenAI Function API simplifies agent development by A LOT."
Tags:
2023-06-15 About
Sanjeev Arora sur Twitter : "Fine-tuning language models using just forward pass!...r
Tags:
2023-06-09 About
Jerry Liu sur Twitter : "LLMs + knowledge graphs backed by a graph db (@NebulaGraph). New stack for retrieval-augmented generation. Now possible with @llama_index..."
Tags:
2023-06-09 About
Jerry Liu sur Twitter : "Tuning top-k for semantic search is challenging... Introducing the LlamaIndex AutoRetriever for vector databases"
Tags:
2023-05-13 About
Jerry Liu sur Twitter : "LlamaIndex... has deep integrations with @MongoDB..."
Tags:
2023-05-11 About
Jerry Liu sur Twitter : "LlamaIndex: define your *own* (simplified) hybrid search"
Tags:
2023-04-29 About
Jerry Liu sur Twitter : "Building a Unified Query Interface. @gpt_index provides a crazy amount of functionality to make data retrieval + LLM’s really good for different use cases."
Tags:
2023-04-15 About
Jerry Liu sur Twitter : "To evaluate retrieval-augmented LLM’s, we can compare the query/response/source context to see if they match. We just added this to @gpt_index..."
Tags:
2023-04-11 About
Jerry Liu sur Twitter : "Sparse-Dense Hybrid Search..."
Tags:
2023-04-09 About
Jeremy Howard sur Twitter : "There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case..." (thread)
Tags:
2023-04-03 About
Jerry Liu sur Twitter : "A key goal of @gpt_index is to enable end users to ask an LLM *any* questions over their own data..."
Tags:
2023-02-27 About
Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."
Tags:
2023-02-25 About
(((ل()(ل() 'yoav))))👾 sur Twitter : "there is this genre of papers that show you can train/tune only some subset of a network's weights, freezing the rest, and things still work as well as (or better than) full training/tuning..."
Tags:
2023-02-15 About
Omar Khattab sur Twitter : "New features in 𝗖𝗼𝗹𝗕𝗘𝗥𝗧 ‣ Index Updater. Simple API to add/remove documents..."
Tags:
2023-01-30 About
Matthew Honnibal sur Twitter : "Some of the things ChatGPT can do are emergent behaviours... Other things it can do have been specifically taught to it. Is there some speculative list somewhere about what tasks were supervised?" / Twitter
Tags:
2023-01-14 About
Christopher Manning sur Twitter : "As the abilities of large pre-trained language models continue to rapidly improve, as seen in this week’s ChatGPT, I find it a rather implausible position to think that these models have no understanding of the meaning of texts."
Tags:
2022-12-03 About
Sanjeev Arora sur Twitter : "A priori, fine-tuning a huge LM on a few datapoints could lead to catastrophic overfitting. So why doesn’t it? Our theory + experiments..."
Tags:
2022-10-14 About
Nils Reimers sur Twitter : "GPL goes multi-lingual..."
Tags:
2022-06-01 About
Ramsri Goutham Golla sur Twitter : "Hi @Nils_Reimers For GPL you used "msmarco-distilbert-base-tas-b" model and ..."
Tags:
2022-04-27 About
Ikuya Yamada sur Twitter : "Is entity representation effective to improve multilingual language models?..."
Tags:
2022-04-13 About
Nils Reimers sur Twitter : "Great post on SetFit"
Tags:
2022-03-31 About
(((ل()(ل() 'yoav))))👾 sur Twitter : "... another step in understanding how transformer-based LMs work..."
Tags:
2022-03-30 About
Nils Reimers sur Twitter : "Creating intent classes for chatbots is challenging This tutorial shows how to use sentence-transformers to find potentially overlapping intent classes and how to improve your data annotation work." / Twitter
Tags:
2022-02-19 About
Nils Reimers sur Twitter : "how to use the fast clustering algorithm from sentence-transformers..."
Tags:
2022-02-19 About
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 About
Nils Reimers sur Twitter : "Do dense retrieval models work out-of-the-box for your specific domain? Often the answer was No😢..."
Tags:
2021-12-15 About
Nils Reimers sur Twitter : "SBERT Release v1.1.0"
Tags:
2021-04-22 About
Nils Reimers sur Twitter : "New models for Neural Information Retrieval..."
Tags:
2021-04-17 About
Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...
Tags:
2020-10-10 About