Semanlink - Word Embedding Compositionality

Γονείς:

Word embeddings

Word Embedding Compositionality

Σχετικές ετικέτες:

Απόγονοι

SIF embeddings

5 Έγγραφα (Όλα τα έγγραφα)

[1902.10618] Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition

Tags:

2019-02-28 About

A Word Embedding Approach to Predicting the Compositionality of Multiword Expressions (2015)

Tags:

2018-06-08 About

Deep Unordered Composition Rivals Syntactic Methods for Text Classification (2015)

Tags:

2018-05-29 About

Improving Word Embedding Compositionality using Lexicographic Definitions

Tags:

2018-05-10 About

Improving the Compositionality of Word Embeddings (2017)

Tags:

(MS thesis, a [paper at TheWebConf 2018](/doc/?uri=https%3A%2F%2Fdoi.org%2F10.1145%2F3178876.3186007))

> This thesis explores a method to find better encodings of meaning a computer can work with. We specifically want to combine encodings of word meanings in such a way that a good encoding of their joint meaning is created. The act of combining multiple representations of meaning into a new representation of meaning is called semantic composition.

Analysis of four word embeddings (Word2Vec, GloVe, fastText and Paragram)  in terms of their semantic compositionality. A method to tune these embeddings towards better compositionality, using a simple neural network architecture with definitions and lemmas from WordNet.

> Since dictionary definitions are semantically similar to their associated lemmas, they are the ideal candidate for our tuning method, as well as evaluating for compositionality. Our architecture allows for the embeddings to be composed using simple arithmetic operations, which makes these embeddings specifically suitable for production applications such as web search and data mining. We also explore more elaborate and involved compositional models, such as recurrent composition and convolutional composition.

2018-02-13 About

Ιδιότητες

sl:creationDate : 2018-05-10
sl:creationTime : 2018-05-10T17:05:29Z
rdf:type : sl:Tag
skos:prefLabel : Word Embedding Compositionality