Information retrieval: techniques AND Jerry Liu
Common descendants
23 Documents
Jerry Liu sur X : "To better augment LLMs with context, it makes a lot of sense to organize context not just as a flat list of text chunks, but as a hierarchy of high-level to low-level details. RAPTOR..."
Tags:
2024-03-03 About
Jerry Liu sur X : "a big step towards better RAG... is to just have a really nice PDF parser. It’s so important because a good parser unlocks way more interesting indexing/retrieval strategies…"
Tags:
2024-02-23 About
Jerry Liu sur X : "Build a RAG backend over any website in a single CLI command ..."
Tags:
2024-02-03 About
Jerry Liu sur X : "4 Levels of Agents for RAG..."
Tags:
2024-01-23 About
LlamaIndex: "Instead of using a global fixed chunk size for RAG, try splitting based on the semantics of the text"
Tags:
2024-01-13 About
Jerry Liu sur X : "Naive chunking strategies cause poor RAG performance...."
Tags:
2023-12-06 About
Jerry Liu sur X : "There's different ways you can parse embedded tables for RAG..."
Tags:
2023-12-02 About
Jerry Liu sur X : "Advanced RAG architectures need to implement dynamic retrieval..."
Tags:
2023-10-22 About
Jerry Liu sur X : "Using LLMs for automated decision making (routing) is a huge part of an advanced RAG/agent app But LLMs are expensive and slow... Fine-tune embeddings instead"
Tags:
2023-10-19 About
Jerry Liu sur X : "The idea of “small-to-big” retrieval: - retrieve on smaller pieces, expand into more context for LLM synthesis..."
Tags:
2023-10-02 About
Jerry Liu sur X : "evaluating RAG: purely evaluating retrieval metrics (MRR, precision) isn’t the whole picture - you need end-to-end response evals..."
Tags:
2023-09-26 About
Jerry Liu sur X : "A simple trick to improve retrieval for RAG 💡: Embed “references” to each text chunk instead of the chunk itself (e.g. smaller chunks, summaries)..."
Tags:
2023-09-06 About
Jerry Liu sur X : "how do you get a good retrieval dataset w/o spending a ton of money on human labels? Answer: use LLMs"
Tags:
2023-08-30 About
Jerry Liu sur X : "This might be the first time ChatGPT (+@jxnlco) helped us come up with a better retrieval algorithm for RAG..."
Tags:
2023-08-28 About
Jerry Liu sur X : "One major way to improve your RAG system is to fine-tune your embedding model"
Tags:
2023-08-25 About
Jerry Liu sur X : "8 key considerations for building *production-grade* LLM apps over your data (RAG)..."
Tags:
2023-08-20 About
Jerry Liu on X: “Graph RAG” in @llama_index: a new method of augmenting LLMs with context from a graph database
Tags:
2023-08-17 About
Jerry Liu sur Twitter : "Some critical data considerations that you must take into account to make your LLM application production-ready"
Tags:
2023-07-23 About
Jerry Liu sur Twitter : "Using cross-encoding as a reranking step can dramatically speed up LLM inference time AND improve accuracy!"
Tags:
2023-07-20 About
Jerry Liu sur Twitter : Hot take: if you want to... deliver technical differentiation, you will need to learn LLM development in a “bottoms-up” fashion
Tags:
2023-07-16 About
Jerry Liu sur Twitter : "If you’re building “chat over your PDFs” with LLMs, you need to deal with the pesky issue of how to parse embedded tables/diagrams..."
Tags:
2023-07-07 About
Jerry Liu sur Twitter : "The DSP project carries a lot of insights for improving RAG..."
Tags:
2023-06-18 About
Jerry Liu sur Twitter : "Tuning top-k for semantic search is challenging... Introducing the LlamaIndex AutoRetriever for vector databases"
Tags:
2023-05-13 About