Semanlink - EMNLP AND Language Model

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

Active learning - Allen Institute for AI (AI2) - Arxiv Doc - BERT - BERT + Sentence Embeddings - Biomedical NLP - Contextualized word representations - Discuté avec Raphaël - Domain adaptation (NLP) - EMNLP 2018 - EMNLP 2019 - EMNLP 2020 - EMNLP 2021 - EMNLP 2022 - EMNLP 2023 - Entity embeddings - Good - Grounded Language Learning - Hard negative mining - Ikuya Yamada - Imbalanced Data - Information bottleneck method - Information theory AND Deep Learning - KD-MKB biblio - Knowledge-augmented Language Models - Knowledge-driven embeddings - Knowledge Extraction - Knowledge Graphs and NLP - Knowledge Graphs in NLP - Language Model - Memory in deep learning - Michael Glass - Multiple Knowledge Bases - Nearest neighbor search - NLP@Harvard - NLP@IBM - NLP@Stanford - Sebastian Ruder - Self-Attention - Sentence Similarity - Siamese networks - Slot filling - Text Classification - Transfer learning - Transformers - Tutorial - Tweet - Zero shot -

EMNLP AND Language Model

Common descendants

15 Documents

EMNLP 2023 sur X : "EMNLP 2023 Best Paper Demo PaperMage: A Unified Toolkit for Processing, Representing, and Manipulating Visually-Rich Scientific Documents"

Tags:

2023-12-10 About

UKP Lab sur X : "a lightweight solution for few-shot domain-specific sentence classification: AdaSent!..."

Tags:

2023-12-09 About

EMNLP 2022 Tutorial — “Modular and Parameter-Efficient Fine-Tuning for NLP Models” | by Oscar Shih | Jun, 2023 | Medium

Tags:

2023-08-08 About

Allen Institute for AI sur Twitter : "MemPrompt, appearing at #EMNLP2022, is a new way to "fix" #GPT3 after deployment via user interaction"

Tags:

2022-12-11 About

Active Learning for BERT: An Empirical Study - ACL Anthology

Tags:

2022-09-02 About

[2108.13934] Robust Retrieval Augmented Generation for Zero-shot Slot Filling

Tags:

2022-01-19 About

[2011.05864] On the Sentence Embeddings from Pre-trained Language Models

Tags:

2021-04-19 About

exBERT: Extending Pre-trained Models with Domain-specific Vocabulary Under Constrained Training Resources - ACL Anthology

Tags:

**Focus on the Embedding of Domain-specific Vocabulary.**

> exBERT
adds a new domain-specific vocabulary and the corresponding
embedding layer, as well as a small
extension module to the original unmodified model

> a pretraining
method allowing **low-cost embedding of
domain-specific vocabulary in the context of an
existing large pre-trained model such as BERT**

> exBERT... explicitly incorporates
the new domain’s vocabulary, while being able to
**reuse the original pre-trained model’s weights as is**
to reduce required computation and training data. Specifically, exBERT extends BERT by augmenting
its embeddings for the original vocabulary with
new embeddings for the domain-specific vocabulary
via **a learned small “extension” module**. **The
output of the original and extension modules are
combined via a trainable weighted sum operation**

In a way similar to concept developed in

> [[1902.00751] Parameter-Efficient Transfer Learning for NLP](doc:2021/04/1902_00751_parameter_efficien), but not in the fine-tuning paradigm.

[Github](https://github.com/cgmhaicenter/exBERT)

2021-04-11 About

[2010.01057] LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention

Tags:

2020-11-26 About

Knowledge Graphs in NLP @ EMNLP 2020 | by Michael Galkin | Nov, 2020 | Medium

Tags:

2020-11-24 About

[1909.04164] Knowledge Enhanced Contextual Word Representations

Tags:

2020-05-13 About

BERT, ELMo, & GPT-2: How Contextual are Contextualized Word Representations? | SAIL Blog

Tags:

2020-03-28 About

Evolution of Representations in the Transformer (2019)

Tags:

2019-09-16 About

[1908.10084] Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Tags:

2019-08-28 About

Transfer learning with language models

Tags:

2018-11-05 About