Semanlink - Retrieval augmented LM

RDF

Impression

Recherche de Mot-clé

Recherche de Doc

Préférences...

Mots-clés liés

Parents :

Retrieval augmented LM

Amis :

Descendants

18 Documents (Liste longue)

[2310.03025] Retrieval meets Long Context Large Language Models

Tags:

2023-10-07 A propos

Fine-tuning with Retrieval Augmentation - LlamaIndex

Tags:

2023-10-07 A propos

[2310.01352] RA-DIT: Retrieval-Augmented Dual Instruction Tuning

Tags:

2023-10-07 A propos

Retrieval-augmented LMs, and prompting

Tags:

2023-06-16 A propos

[2305.15294] Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

Tags:

2023-05-26 A propos

Jerry Liu sur Twitter : "To evaluate retrieval-augmented LLM’s, we can compare the query/response/source context to see if they match. We just added this to @gpt_index..."

Tags:

2023-04-11 A propos

deepset sur Twitter : " Generative models have taken the world of NLP by storm. But LLMs do not know about your personal data. This makes personal assistants, enterprise knowledge management and many other applications challenging. Retrieval augmented pipelines are the answer"

Tags:

2023-02-02 A propos

fly51fly sur Twitter : "REPLUG: Retrieval-Augmented Black-Box Language Models..."

Tags:

2023-01-31 A propos

Uri Alon sur Twitter : "K-nearest neighbors language models (kNN-LMs; @ukhndlwl et al., ICLR'2020) improve the perplexity of standard LMs... Why?"

Tags:

2023-01-11 A propos

Yi Tay sur Twitter : "Don't retrieve, recite!..."

Tags:

2022-10-06 A propos

[2208.03299] Few-shot Learning with Retrieval Augmented Language Model

Tags:

2022-08-08 A propos

Recent Advances in Retrieval-Augmented Text Generation

Tags:

2022-07-11 A propos

Jason Weston sur Twitter : "SeeKeR: An open source search-augmented language model"

Tags:

2022-03-25 A propos

Improving Language Models by Retrieving from Trillions of Tokens | DeepMind

Tags:

2021-12-09 A propos

Building Scalable, Explainable, and Adaptive NLP Models with Retrieval | SAIL Blog

Tags:

2021-10-07 A propos

Hugging Face sur Twitter : "Transformers release of the Retrieval-Augmented Generation model in collaboration with @facebookai!"

Tags:

2021-02-23 A propos

Retrieval Augmented Generation with Huggingface Transformers and Ray | Distributed Computing with Ray

Tags:

2021-02-11 A propos

[2002.08909] REALM: Retrieval-Augmented Language Model Pre-Training

Tags:

**Augment language model pre-training with a retriever module**, which
is trained using the masked language modeling objective.

> To capture knowledge in a more modular and interpretable way, we augment language model pre-training with a latent knowledge retriever, which allows the model to retrieve and attend over documents from a large corpus such as Wikipedia, used during pre-training, fine-tuning and inference. **For the first time, we show how to pre-train such a knowledge retriever in an unsupervised manner**, using masked language modeling as the learning signal and backpropagating through a retrieval step that considers millions of documents

Hum, #TODO: parallel to be drawn with techniques in [KG-augmented Language Models](tag:knowledge_graph_augmented_language_models) which focus "on the problem of capturing declarative knowledge in the learned parameters of a language model."

[Google AI Blog Post](doc:2020/08/google_ai_blog_realm_integrat)

[Summary](https://joeddav.github.io/blog/2020/03/03/REALM.html) for the [Hugging Face awesome-papers reading group](doc:2021/03/huggingface_awesome_papers_pap)

2020-12-12 A propos

Propriétés

sl:creationDate : 2021-02-23
sl:creationTime : 2021-02-23T11:36:03Z
rdf:type : sl:Tag
skos:altLabel :
- RALM
- Retrieval augmented Language Models
- Retrieval augmented Language Model
- Retrieval augmented LMs
- Search augmented LM
skos:prefLabel : Retrieval augmented LM