Tweet AND Jerry Liu
Descendants partagés
29 Documents
Jerry Liu sur X : "To better augment LLMs with context, it makes a lot of sense to organize context not just as a flat list of text chunks, but as a hierarchy of high-level to low-level details. RAPTOR..."
Tags:
2024-03-03 A propos
Jerry Liu sur X : "Build a RAG backend over any website in a single CLI command ..."
Tags:
2024-02-03 A propos
Jerry Liu sur X : "4 Levels of Agents for RAG..."
Tags:
2024-01-23 A propos
LlamaIndex: "Instead of using a global fixed chunk size for RAG, try splitting based on the semantics of the text"
Tags:
2024-01-13 A propos
Jerry Liu sur X : "Naive chunking strategies cause poor RAG performance...."
Tags:
2023-12-06 A propos
Jerry Liu sur X : "evaluating RAG: purely evaluating retrieval metrics (MRR, precision) isn’t the whole picture - you need end-to-end response evals..."
Tags:
2023-09-26 A propos
Jerry Liu sur X : "A simple trick to improve retrieval for RAG 💡: Embed “references” to each text chunk instead of the chunk itself (e.g. smaller chunks, summaries)..."
Tags:
2023-09-06 A propos
Jerry Liu sur X : "how do you get a good retrieval dataset w/o spending a ton of money on human labels? Answer: use LLMs"
Tags:
2023-08-30 A propos
Jerry Liu sur X : "One major way to improve your RAG system is to fine-tune your embedding model"
Tags:
2023-08-25 A propos
Jerry Liu sur X : "8 key considerations for building *production-grade* LLM apps over your data (RAG)..."
Tags:
2023-08-20 A propos
Jerry Liu on X: “Graph RAG” in @llama_index: a new method of augmenting LLMs with context from a graph database
Tags:
2023-08-17 A propos
Jerry Liu sur Twitter : "Some critical data considerations that you must take into account to make your LLM application production-ready"
Tags:
2023-07-23 A propos
Jerry Liu sur Twitter : "if you have access to a rich query language (e.g. SQL / any DSL), use a vector db to index additional metadata to help the LLM execute queries using this query language, while preventing prompt overflows!
Tags:
2023-07-20 A propos
Jerry Liu sur Twitter : "Using cross-encoding as a reranking step can dramatically speed up LLM inference time AND improve accuracy!"
Tags:
2023-07-20 A propos
Jerry Liu sur Twitter : Hot take: if you want to... deliver technical differentiation, you will need to learn LLM development in a “bottoms-up” fashion
Tags:
2023-07-16 A propos
Jerry Liu sur Twitter : "Adding metadata to text can help w/ disambiguation and boost retrieval performance for LLM QA systems, using LLMs to... extract rich context to augment each chunk"
Tags:
2023-07-09 A propos
Jerry Liu sur Twitter : "If you’re building “chat over your PDFs” with LLMs, you need to deal with the pesky issue of how to parse embedded tables/diagrams..."
Tags:
2023-07-07 A propos
Jerry Liu sur Twitter : "LLMs can directly extract structured data (esp w/ Function API), but can be slow/expensive. 🤔 Instead: use LLMs to generate code, run code to extract data..."
Tags:
2023-07-03 A propos
Jerry Liu sur Twitter : "The `camelot` package is an awesome module for extracting tables from PDFs..."
Tags:
2023-07-03 A propos
Jerry Liu sur Twitter : "The DSP project carries a lot of insights for improving RAG..."
Tags:
2023-06-18 A propos
Jerry Liu sur Twitter : "The new OpenAI Function API simplifies agent development by A LOT."
Tags:
2023-06-15 A propos
Jerry Liu sur Twitter : "LLMs + knowledge graphs backed by a graph db (@NebulaGraph). New stack for retrieval-augmented generation. Now possible with @llama_index..."
Tags:
2023-06-09 A propos
Jerry Liu sur Twitter : "Tuning top-k for semantic search is challenging... Introducing the LlamaIndex AutoRetriever for vector databases"
Tags:
2023-05-13 A propos
Jerry Liu sur Twitter : "LlamaIndex... has deep integrations with @MongoDB..."
Tags:
2023-05-11 A propos
Jerry Liu sur Twitter : "LlamaIndex: define your *own* (simplified) hybrid search"
Tags:
2023-04-29 A propos
Jerry Liu sur Twitter : "Building a Unified Query Interface. @gpt_index provides a crazy amount of functionality to make data retrieval + LLM’s really good for different use cases."
Tags:
2023-04-15 A propos
Jerry Liu sur Twitter : "To evaluate retrieval-augmented LLM’s, we can compare the query/response/source context to see if they match. We just added this to @gpt_index..."
Tags:
2023-04-11 A propos
Jerry Liu sur Twitter : "Sparse-Dense Hybrid Search..."
Tags:
2023-04-09 A propos
Jerry Liu sur Twitter : "A key goal of @gpt_index is to enable end users to ask an LLM *any* questions over their own data..."
Tags:
2023-02-27 A propos