Semanlink - Graph Embeddings AND Attention in Graphs

Recherche de Mot-clé

Recherche de Doc

Préférences...

Mots-clés liés

ACL 2019 - AI@Google - Arxiv Doc - Attention + Knowledge Graphs - Attention in Graphs - Baidu - Discuté avec Raphaël - Entity embeddings - Good - Knowledge Graph Embeddings - Link Prediction - Node Embeddings - TheWebConf 2021 -

Graph Embeddings AND Attention in Graphs

Descendants partagés

5 Documents

[2010.03496] Inductive Entity Representations from Text via Link Prediction

Tags:

BLP "BERT for Link Prediction". Central idea: **training an entity encoder with a
link prediction objective** (using the textual descriptions of entities when computing entity representations - hence not failing with entities unknown in training)

> a method for **learning representations
of entities**, that uses a **pre-trained Transformer** based
architecture as an entity encoder, and
**link prediction training on a knowledge graph
with textual entity descriptions**.

> using entity descriptions,
an entity encoder is trained for link prediction in
a knowledge graph. The encoder can then be used
without fine-tuning to obtain features for entity classification
and information retrieval

Cites [Xie et al](doc:2020/10/representation_learning_of_know) and [Kepler](doc:2020/11/1911_06136_kepler_a_unified_). They claim that their
objective targeted exclusively for link prediction (and not an objective that combines language modeling
and link prediction as Kepler)
performs better than Kepler's more complex one.

2020-11-03 A propos

Deepak Nathani | Pay Attention, Relations are Important

Tags:

2020-04-30 A propos

[1906.01195] Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs

Tags:

2020-04-30 A propos

[1911.02168] CoKE: Contextualized Knowledge Graph Embedding

Tags:

2020-03-22 A propos

Watch Your Step: Learning Node Embeddings via Graph Attention

Tags:

2019-08-23 A propos