Semanlink - Favoris ; Géographie ; Deep Learning AND Transformers

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

ADAM (ML) - Alpaca - Arxiv Doc - Baidu - BERT - Biomedical NLP - CamemBERT - ChatGPT - Contextualized word representations - Dan Jurafsky - Dataset quality - Discuté avec Raphaël - Domain adaptation (NLP) - EMNLP 2019 - EMNLP 2020 - Fine-tuning - Generalization - GitHub project - Good - Human-AI collaboration - Information extraction - INRIA - Instruction tuning - Knowledge-augmented Language Models - Knowledge Graph Completion - Knowledge Graph Embeddings - LLaMA - Long documents - Low-Resource Languages - MLM - NLP: French - NLP: pretraining - NLP@Facebook - NLP@Google - NLP@Harvard - NLP@Stanford - NLP + Human Resources - NLP + juridique - NLP 4 Africa - NLP sample code - Paris NLP meetup - Pointwise mutual information - RL from Human Feedback - Sentence-BERT - Siamese networks - Slides - Toyota - Transformers - Tree structure - Tweet -

Favoris ; Géographie ; Deep Learning AND Transformers

Common descendants

25 Documents

How to use Alpaca-LoRA to fine-tune a model like ChatGPT

Tags:

2023-05-26 About

Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."

Tags:

2023-04-05 About

Alpaca Finetuning of Llama on a 24G Consumer GPU

Tags:

2023-03-27 About

tloen/alpaca-lora: Instruct-tune LLaMA on consumer hardware

Tags:

2023-03-22 About

LLM Zoo at Home: LLaMA & Alpaca | bergis universe of software, hardware and ideas

Tags:

2023-03-20 About

Prompting, Instruction Finetuning, and RLHF (CS224N)

Tags:

2023-02-16 About

Comparing Africa-centric Models to OpenAI's GPT3.5 - Lelapa

Tags:

2023-02-10 About

shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "

Tags:

2022-12-09 About

Meet CoAuthor, an Experiment in Human-AI Collaborative Writing

Tags:

2022-11-13 About

[2208.01066] What Can Transformers Learn In-Context? A Case Study of Simple Function Classes

Tags:

2022-09-17 About

Sentence Embedding Fine-tuning for the French Language | by La Javaness R&D | Feb, 2022 | Medium

Tags:

2022-03-31 About

[2006.05987] Revisiting Few-sample BERT Fine-tuning

Tags:

2022-03-21 About

Document Matching for Job Descriptions | Semantic Scholar (2021)

Tags:

2022-03-09 About

Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."

Tags:

2021-10-16 About

Sahajtomar/french_semantic · Hugging Face

Tags:

2021-10-14 About

Inria Paris NLP (ALMAnaCH team) sur Twitter : "#PAGnol, a new, free, GPT-3-like generative LM for French

Tags:

2021-05-04 About

exBERT: Extending Pre-trained Models with Domain-specific Vocabulary Under Constrained Training Resources - ACL Anthology

Tags:

**Focus on the Embedding of Domain-specific Vocabulary.**

> exBERT
adds a new domain-specific vocabulary and the corresponding
embedding layer, as well as a small
extension module to the original unmodified model

> a pretraining
method allowing **low-cost embedding of
domain-specific vocabulary in the context of an
existing large pre-trained model such as BERT**

> exBERT... explicitly incorporates
the new domain’s vocabulary, while being able to
**reuse the original pre-trained model’s weights as is**
to reduce required computation and training data. Specifically, exBERT extends BERT by augmenting
its embeddings for the original vocabulary with
new embeddings for the domain-specific vocabulary
via **a learned small “extension” module**. **The
output of the original and extension modules are
combined via a trainable weighted sum operation**

In a way similar to concept developed in

> [[1902.00751] Parameter-Efficient Transfer Learning for NLP](doc:2021/04/1902_00751_parameter_efficien), but not in the fine-tuning paradigm.

[Github](https://github.com/cgmhaicenter/exBERT)

2021-04-11 About

BERT, ELMo, & GPT-2: How Contextual are Contextualized Word Representations? | SAIL Blog

Tags:

2020-03-28 About

[1911.02168] CoKE: Contextualized Knowledge Graph Embedding

Tags:

2020-03-22 About

Paris NLP Season 4 Meetup #3 – Paris NLP (2020)

Tags:

2020-01-23 About

Lecture 14 – Contextual Vectors | Stanford CS224U: Natural Language Understanding | Spring 2019

Tags:

2020-01-05 About

[1911.00172] Generalization through Memorization: Nearest Neighbor Language Models

Tags:

2019-12-20 About

CamemBERT

Tags:

CamemBERT

2019-11-10 About

Meet ALBERT: a new ‘Lite BERT’ from Google & Toyota with State of the Art NLP performance and 18x fewer parameters.

Tags:

2019-10-01 About

Romain Vial (Hyperlex) at Paris NLP meetup, slides

Tags:

2019-01-24 About