Semanlink - Knowledge bases AND Neural Search

Printer friendly

Search Tag:

Search Doc:

Preferences...

Knowledge bases AND Neural Search

Common descendants

35 Documents

Leonie sur X : "Ollama allows you to run open source LLMs LOCALLY..."

Tags:

2024-03-30 About

ColBERT gist:c1182551fa609736d47df4af82f7c5ab

Tags:

2024-03-08 About

ColBERT Inference in the Browser

Tags:

2024-03-08 About

Announcing Vespa Long-Context ColBERT | Vespa Blog

Tags:

2024-03-03 About

Omar Khattab sur X : "ColBERT in 81 languages by generalizing from English training! ..."

Tags:

2024-02-28 About

Omar Khattab sur X : "A thread on late interaction, how it works efficiently, and why/where it's been shown to improve quality"

Tags:

2024-02-05 About

Craig Macdonald sur X : "a thread of our main ColBERT research findings"

Tags:

2024-02-01 About

long document ranking · Issue #11 · stanford-futuredata/ColBERT

Tags:

2024-01-31 About

Exploring ColBERT with RAGatouille | Simon Willison’s TILs

Tags:

2024-01-29 About

Jo Kristian Bergum sur X : (on "why using ColBERT?")

Tags:

2024-01-28 About

bclavie/RAGatouille

Tags:

2024-01-26 About

Omar Khattab sur X : "A🧵on beating the hardware lottery for retrieval: the internals of the late interaction stack. ColBERT..."

Tags:

2023-12-29 About

raphaelsty/neural-cherche: Neural Search

Tags:

2023-11-17 About

Omar Khattab sur X : "This isn't the main point of this great new paper by @sophiaalthammer et al. But it's incredible how ColBERT at 1000 training queries is better than DPR trained at *50,000* queries!"

Tags:

2023-09-14 About

LangChain Retrieval Webinar - YouTube

Tags:

2023-05-27 About

[2304.01982] Rethinking the Role of Token Retrieval in Multi-Vector Retrieval

Tags:

2023-04-05 About

deepset sur Twitter : " Generative models have taken the world of NLP by storm. But LLMs do not know about your personal data. This makes personal assistants, enterprise knowledge management and many other applications challenging. Retrieval augmented pipelines are the answer"

Tags:

2023-02-02 About

Omar Khattab sur Twitter : "New features in 𝗖𝗼𝗹𝗕𝗘𝗥𝗧 ‣ Index Updater. Simple API to add/remove documents..."

Tags:

2023-01-30 About

[2207.06300] Re2G: Retrieve, Rerank, Generate

Tags:

2022-07-14 About

[2203.13088] Introducing Neural Bag of Whole-Words with ColBERTer: Contextualized Late Interactions using Enhanced Reduction

Tags:

2022-03-30 About

SPIKE for Knowledge Base Construction

Tags:

2022-02-22 About

Yosi Shamay sur Twitter : "a new platform for rapid ad-hoc knowledgebase construction using extractive search...."

Tags:

2022-02-22 About

REALM: Retrieval-Augmented Language Model Pre-Training (Paper Explained) - YouTube

Tags:

2022-01-23 About

Integrate ORQA and REALM for Open Domain Question Answering · Issue #312 · deepset-ai/haystack

Tags:

2022-01-12 About

[2004.12832] ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT

Tags:

2022-01-12 About

[2007.00814] Relevance-guided Supervision for OpenQA with ColBERT

Tags:

2022-01-07 About

Semantic search through a vectorized Wikipedia (SentenceBERT) with the Weaviate vector search engine

Tags:

2021-12-05 About

[2112.01488] ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction

Tags:

2021-12-05 About

Building Scalable, Explainable, and Adaptive NLP Models with Retrieval | SAIL Blog

Tags:

2021-10-07 About

A Moderate Proposal for Radically Better AI-powered Web Search

Tags:

2021-07-10 About

[2002.08909] REALM: Retrieval-Augmented Language Model Pre-Training

Tags:

**Augment language model pre-training with a retriever module**, which
is trained using the masked language modeling objective.

> To capture knowledge in a more modular and interpretable way, we augment language model pre-training with a latent knowledge retriever, which allows the model to retrieve and attend over documents from a large corpus such as Wikipedia, used during pre-training, fine-tuning and inference. **For the first time, we show how to pre-train such a knowledge retriever in an unsupervised manner**, using masked language modeling as the learning signal and backpropagating through a retrieval step that considers millions of documents

Hum, #TODO: parallel to be drawn with techniques in [KG-augmented Language Models](tag:knowledge_graph_augmented_language_models) which focus "on the problem of capturing declarative knowledge in the learned parameters of a language model."

[Google AI Blog Post](doc:2020/08/google_ai_blog_realm_integrat)

[Summary](https://joeddav.github.io/blog/2020/03/03/REALM.html) for the [Hugging Face awesome-papers reading group](doc:2021/03/huggingface_awesome_papers_pap)

2020-12-12 About

[2012.04584] Distilling Knowledge from Reader to Retriever for Question Answering

Tags:

> a method to train an information retrieval module for downstream tasks, **without using pairs of queries and documents as annotations**.

Uses two models (standard pipeline for open-domain QA):

- the first one retrieves documents from a large source of knowledge (the retriever)
- the second one processes the support documents to solve the task (the reader).

> First the retriever selects support passages in a large knowledge
source. Then these passages are processed by the reader, along with the question, to generate an
answer

Inspired by knowledge distillation: the reader model is the teacher and the retriever is the student.

> More precisely, we use a sequence-to-sequence model as the reader, and use
the attention activations over the input documents as synthetic labels to train the retriever. 
> (**train the retriever by learning to approximate the attention score of the reader**)

Refers to:

- [REALM: Retrieval-Augmented Language Model Pre-Training](doc:2020/12/2002_08909_realm_retrieval_a)
- [Dehghani: Neural Ranking Models with Weak Supervision](doc:?uri=https%3A%2F%2Farxiv.org%2Fabs%2F1704.08803)

2020-12-11 About

Google AI Blog: REALM: Integrating Retrieval into Language Representation Models

Tags:

2020-08-13 About

A Tri-Partite Neural Document Language Model for Semantic Information Retrieval (2018 - ESWC conference)

Tags:

2018-06-08 About

Modèle Neuronal de Recherche d'Information Augmenté par une Ressource Sémantique (2017)

Tags:

2018-02-12 About