Semanlink - AI teams ; Unsupervised deep pre-training AND NLP and Search

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

Arxiv Doc - Benjamin Clavié - BERT - Domain adaptation (NLP) - GitHub project - Information retrieval - J'y étais - Knowledge distillation - Knowledge-Intensive NLP Tasks - LangChain - Language Models + Knowledge - LM + Search - Multilingual embeddings - Multiple negatives ranking (MNR) loss - Neural Search - Nils Reimers - NLP@Meta - NLP@Microsoft - NLP@Stanford - NLP and Search - NLP based IR - Not Encoding Factual Knowledge in Language Model - Omar Khattab - Pinecone - Prompting/In-context learning - RAGatouille - Semantic Search - Sentence-BERT - Sentence-BERT: Domain adaptation - Sentence Embeddings - Synthetic data (NLP) - Synthetic QA data - TensorFlow - Text Similarity - Transformers - Tweet - Unsupervised Domain Adaptation (NLP) - Unsupervised Sentence Embedding Learning - Webinar - Wikipedia - YouTube video -

AI teams ; Unsupervised deep pre-training AND NLP and Search

Common descendants

20 Documents

bclavie/RAGatouille

Tags:

2024-01-26 About

[2002.06275] TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval

Tags:

2023-08-27 About

LangChain Retrieval Webinar - YouTube

Tags:

2023-05-27 About

Domain Adaptation with Generative Pseudo-Labeling (GPL) | Pinecone

Tags:

2023-04-09 About

stanfordnlp/dspy: 𝗗𝗦𝗣: Demonstrate-Search-Predict. A framework for composing retrieval and language models for knowledge-intensive NLP.

Tags:

2023-02-18 About

Multilingual Sentence Transformers | Pinecone

Tags:

2023-01-13 About

Akari Asai sur Twitter : "Can we solely rely on LLMs’ memories (eg replace search w ChatGPT)? Probably not... Our analysis shows how retrieval is complementary to LLMs’ parametric knowledge..."

Tags:

2022-12-21 About

BERTopic: The Future of Topic Modeling | Pinecone

Tags:

2022-05-12 About

NAVER LABS Europe : "@Nils_Reimers of @huggingface on 'Unsupervised domain adaptation for neural search'"

Tags:

2022-03-09 About

Domain Transfer with BERT | Pinecone

Tags:

2022-01-04 About

Making the Most of Data: Augmentation with BERT | Pinecone

Tags:

2021-12-18 About

[2112.07577] GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval

Tags:

An unsupervised domain adaptation technique for dense retrieval models

1. synthetic queries
are generated for each passage from the target corpus (using an existing pre-trained [T5](tag:text_to_text_transfer_transformer)
encoder-decoder)
2. the generated queries are used for mining negative
passages (retrieving the most similar
paragraphs using an existing dense retrieval
model == hard negatives!)
3. the query-passage pairs are labeled by a cross-encoder and used to train the domain-adapted
dense retriever (using method described in [Hofstätter et al.,
2020](doc:2021/12/2010_02666_improving_efficien))

[Nils Reimers sur Twitter](doc:2021/12/nils_reimers_sur_twitter_do_), [GitHub](https://github.com/UKPLab/gpl),  by the author of [TSDAE](doc:2021/09/2104_06979_tsdae_using_trans)

Claims to improve "Doc2Query" [Document Expansion by Query Prediction](doc:2022/01/1904_08375_document_expansion): ([src](https://twitter.com/KexinWang2049/status/1471435779415150598))

> - GPL: Uses doc2query to construct synthetic data and does knowledge distillation (i.e. training) on that data.
> - Doc2query: Generates queries to extend the documents and use BM25 on top of them w/o training.

2021-12-15 About

Semantic search through a vectorized Wikipedia (SentenceBERT) with the Weaviate vector search engine

Tags:

2021-12-05 About

Unsupervised Training for Sentence Transformers | Pinecone

Tags:

2021-11-24 About

Multilingual Sentence Transformers | Pinecone

Tags:

2021-11-04 About

Next-Gen Sentence Embeddings with Multiple Negatives Ranking Loss | Pinecone

Tags:

2021-10-27 About

Sentence Embeddings and Transformers | Pinecone

Tags:

2021-10-23 About

[2007.12603] IR-BERT: Leveraging BERT for Semantic Search in Background Linking for News Articles

Tags:

2021-04-12 About

Building a Search Engine with BERT and TensorFlow - Towards Data Science

Tags:

2020-01-12 About

Elasticsearch meets BERT: Building Search Engine with Elasticsearch and BERT

Tags:

2020-01-10 About