Semanlink - Technical girls and guys ; NLP tasks / problems AND NLP@Facebook

Printer friendly

Search Tag:

Search Doc:

Preferences...

Technical girls and guys ; NLP tasks / problems AND NLP@Facebook

Common descendants

15 Documents

[2012.15156] A Memory Efficient Baseline for Open Domain Question Answering

Tags:

2022-08-08 About

[2112.09118] Towards Unsupervised Dense Information Retrieval with Contrastive Learning

Tags:

2021-12-21 About

[1906.04980] Unsupervised Question Answering by Cloze Translation

Tags:

2021-12-08 About

[1705.06476] ParlAI: A Dialog Research Software Platform

Tags:

2021-11-21 About

[2010.00904] Autoregressive Entity Retrieval

Tags:

2021-01-14 About

[2012.04584] Distilling Knowledge from Reader to Retriever for Question Answering

Tags:

> a method to train an information retrieval module for downstream tasks, **without using pairs of queries and documents as annotations**.

Uses two models (standard pipeline for open-domain QA):

- the first one retrieves documents from a large source of knowledge (the retriever)
- the second one processes the support documents to solve the task (the reader).

> First the retriever selects support passages in a large knowledge
source. Then these passages are processed by the reader, along with the question, to generate an
answer

Inspired by knowledge distillation: the reader model is the teacher and the retriever is the student.

> More precisely, we use a sequence-to-sequence model as the reader, and use
the attention activations over the input documents as synthetic labels to train the retriever. 
> (**train the retriever by learning to approximate the attention score of the reader**)

Refers to:

- [REALM: Retrieval-Augmented Language Model Pre-Training](doc:2020/12/2002_08909_realm_retrieval_a)
- [Dehghani: Neural Ranking Models with Weak Supervision](doc:?uri=https%3A%2F%2Farxiv.org%2Fabs%2F1704.08803)

2020-12-11 About

Teaching Machines to Understand Natural Language (2018)

Tags:

2018-10-26 About

Unsupervised Machine Translation. G. Lample (slides)

Tags:

2018-09-29 About

Paris NLP Season 3 Meetup #1 | Meetup

Tags:

2018-09-27 About

[Learning Note] StarSpace For Multi-label Text Classification

Tags:

2018-09-11 About

[1603.01360] Neural Architectures for Named Entity Recognition

Tags:

2018-03-05 About

[1712.09405] Advances in Pre-Training Distributed Word Representations

Tags:

2017-12-29 About

facebookresearch/MUSE: A library for Multilingual Unsupervised or Supervised word Embeddings

Tags:

2017-12-22 About

[1710.04087] Word Translation Without Parallel Data

Tags:

2017-10-14 About

[1607.01759] Bag of Tricks for Efficient Text Classification

Tags:

2017-09-10 About