Semanlink - Unsupervised NER

Βρες μου:

Search Doc:

Προτιμήσεις...

Ετικέτες

Arxiv Doc - Entity type - Knowledge-augmented Language Models - NLP@Facebook - RNN based Language Model -

Γονείς:

Unsupervised NER

Σχετικές ετικέτες:

Απόγονοι

1 Document (Όλα τα έγγραφα)

[1904.04458] Knowledge-Augmented Language Model and its Application to Unsupervised Named-Entity Recognition

Tags:

Knowledge Augmented
Language Model (KALM)

a language
model with access to information available in a
KB, no assumptions
about the availability of additional components
(such as Named Entity Taggers) or annotations

> While classes of
named entities (e.g., person or location) occur frequently,
each individual name (e.g, Atherton or
Zhouzhuang) may be observed infrequently even
in a very large corpus of text. As a result language
models learn to represent accurately only the most
popular named entities

> knowing that Alice is a name
used to refer to a person should give ample information
about the context in which the word may
occur (e.g., Bob visited Alice).

> ---

> extends a traditional **RNN LM**

> we enhance a traditional LM with a
gating mechanism that controls whether a particular
word is modeled as a general word or as a reference
to an entity
>
> We train the model end-to-end
with only the traditional predictive language modeling
perplexity objective
>
> KALM is trained end-to-end using
a predictive objective on large corpus of text.

> To the best of our knowledge, KALM is the first
unsupervised neural NER approach.

> KALM extends a traditional, RNN-based neural
LM.

2022-08-31 About

Ιδιότητες

sl:creationDate : 2022-08-31
sl:creationTime : 2022-08-31T01:10:02Z
rdf:type : sl:Tag
skos:altLabel : Unsupervised Named-Entity Recognition
skos:prefLabel : Unsupervised NER