Semanlink - Retrieval augmented LM

RDF

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

Arxiv Doc - Cheat sheet - DeepMind - Discuté avec Raphaël - EMNLP 2021 - Few-shot learning - Fine-tuning - Gautier Izacard - GitHub project - Good - Hard negative mining - J'y étais - k-nearest neighbors - Knowledge distillation - Knowledge Extraction - Knowledge-Intensive NLP Tasks - Knowledge management - LangChain - LlamaIndex - LLM - LLMs: extended context window - LM + Search - LM evaluation - Michael Glass - Named Entity Recognition - Natural language generation - Neural Search - NLP@ENS - NLP@Google - NLP@IBM - NLP@Meta - NLP@Microsoft - NLP@Stanford - NLP based IR - Omar Khattab - Personal assistant - Prompting/In-context learning - Prompts - Question Answering - RAG (Retrieval-Augmented Generation) - Retriever-Reader - Sample code - SIGIR 2022 - Slides - Slot filling - Tweet - Webinar - YouTube video - Zero shot -

Parents:

Retrieval augmented LM

Related Tags:

Descendants

18 Documents (Long List)

[2310.03025] Retrieval meets Long Context Large Language Models

Tags:

2023-10-07 About

Fine-tuning with Retrieval Augmentation - LlamaIndex

Tags:

2023-10-07 About

[2310.01352] RA-DIT: Retrieval-Augmented Dual Instruction Tuning

Tags:

2023-10-07 About

Retrieval-augmented LMs, and prompting

Tags:

2023-06-16 About

[2305.15294] Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

Tags:

2023-05-26 About

Jerry Liu sur Twitter : "To evaluate retrieval-augmented LLM’s, we can compare the query/response/source context to see if they match. We just added this to @gpt_index..."

Tags:

2023-04-11 About

deepset sur Twitter : " Generative models have taken the world of NLP by storm. But LLMs do not know about your personal data. This makes personal assistants, enterprise knowledge management and many other applications challenging. Retrieval augmented pipelines are the answer"

Tags:

2023-02-02 About

fly51fly sur Twitter : "REPLUG: Retrieval-Augmented Black-Box Language Models..."

Tags:

2023-01-31 About

Uri Alon sur Twitter : "K-nearest neighbors language models (kNN-LMs; @ukhndlwl et al., ICLR'2020) improve the perplexity of standard LMs... Why?"

Tags:

2023-01-11 About

Yi Tay sur Twitter : "Don't retrieve, recite!..."

Tags:

2022-10-06 About

[2208.03299] Few-shot Learning with Retrieval Augmented Language Model

Tags:

2022-08-08 About

Recent Advances in Retrieval-Augmented Text Generation

Tags:

2022-07-11 About

Jason Weston sur Twitter : "SeeKeR: An open source search-augmented language model"

Tags:

2022-03-25 About

Improving Language Models by Retrieving from Trillions of Tokens | DeepMind

Tags:

2021-12-09 About

Building Scalable, Explainable, and Adaptive NLP Models with Retrieval | SAIL Blog

Tags:

2021-10-07 About

Hugging Face sur Twitter : "Transformers release of the Retrieval-Augmented Generation model in collaboration with @facebookai!"

Tags:

2021-02-23 About

Retrieval Augmented Generation with Huggingface Transformers and Ray | Distributed Computing with Ray

Tags:

2021-02-11 About

[2002.08909] REALM: Retrieval-Augmented Language Model Pre-Training

Tags:

**Augment language model pre-training with a retriever module**, which
is trained using the masked language modeling objective.

> To capture knowledge in a more modular and interpretable way, we augment language model pre-training with a latent knowledge retriever, which allows the model to retrieve and attend over documents from a large corpus such as Wikipedia, used during pre-training, fine-tuning and inference. **For the first time, we show how to pre-train such a knowledge retriever in an unsupervised manner**, using masked language modeling as the learning signal and backpropagating through a retrieval step that considers millions of documents

Hum, #TODO: parallel to be drawn with techniques in [KG-augmented Language Models](tag:knowledge_graph_augmented_language_models) which focus "on the problem of capturing declarative knowledge in the learned parameters of a language model."

[Google AI Blog Post](doc:2020/08/google_ai_blog_realm_integrat)

[Summary](https://joeddav.github.io/blog/2020/03/03/REALM.html) for the [Hugging Face awesome-papers reading group](doc:2021/03/huggingface_awesome_papers_pap)

2020-12-12 About

Properties

sl:creationDate : 2021-02-23
sl:creationTime : 2021-02-23T11:36:03Z
rdf:type : sl:Tag
skos:altLabel :
- RALM
- Retrieval augmented Language Models
- Retrieval augmented Language Model
- Retrieval augmented LMs
- Search augmented LM
skos:prefLabel : Retrieval augmented LM