Semanlink - NLP: pretraining

RDF

Impression

Recherche de Mot-clé

Recherche de Doc

Préférences...

Mots-clés liés

AI@Google - Andrej Karpathy - Arxiv Doc - Attention mechanism - Classification - Discuté avec Raphaël - Domain adaptation - Domain adaptation (NLP) - Embeddings - Entities - Entity Retrieval - Fine-tuning - GitHub - GitHub project - Google - Howto, tutorial, FAQ - Hugging Face - Information extraction - Information retrieval - Knowledge-augmented Language Models - Knowledge Graphs - Knowledge Graphs and NLP - Language Model - Language Models + Knowledge - LM Fine-tuning - Neural Search - NLP@Google - NLP@Meta - NLP@Microsoft - NLP and Search - NLP based IR - NLP girls and guys - Not Encoding Factual Knowledge in Language Model - OpenAI - Question Answering - Retrieval Augmentation - Retrieval-based NLP - Sample code - Self-Attention - Sentence Embeddings - Structured knowledge - Text Classification - Text Embeddings - Tools - Transfer learning - Transfer learning in NLP - Transformers - Tweet - Vector database -

Parents :

NLP techniques

NLP: pretraining

Amis :

Descendants

Pre-Trained Language Models

5 Documents (Liste longue)

[2205.05131] Unifying Language Learning Paradigms

Tags:

2022-05-12 A propos

Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."

Tags:

2021-10-16 A propos

[2010.02194] Self-training Improves Pre-training for Natural Language Understanding

Tags:

2021-03-12 A propos

[2004.10964] Don't Stop Pretraining: Adapt Language Models to Domains and Tasks

Tags:

2020-12-01 A propos

[2006.15020] Pre-training via Paraphrasing

Tags:

2020-06-30 A propos

Propriétés

sl:creationDate : 2020-06-30
sl:creationTime : 2020-06-30T11:33:52Z
rdf:type : sl:Tag
skos:altLabel : nlp: pre-training@en
skos:prefLabel : NLP: pretraining@en