Semanlink - Sparse coding

Parents:

Wikipedia Sparse coding

Related Tags:

Descendants

5 Documents (Long List)

Linear algebraic structure of word meanings – Off the convex path

Tags:

2018-09-20 About

[1601.03764] Linear Algebraic Structure of Word Senses, with Applications to Polysemy

Tags:

> Here it is shown that multiple word senses reside
in linear superposition within the word
embedding and simple sparse coding can recover
vectors that approximately capture the
senses

> Each extracted word sense is accompanied by one of about  2000 “discourse atoms” that gives a succinct description of which other words co-occur with that word sense.

> The success of the approach is mathematically explained using a variant of
the random walk on discourses model

("random walk": a generative model for language). Under the assumptions of this model,  there
exists a linear relationship between the vector of a
word w and the vectors of the words in its contexts (It is not the average of the words in w's context, but in a given corpus the matrix of the linear relationship does not depend on w. It can be estimated, and so we can compute the embedding of a word from the contexts it belongs to)

[Related blog post](/doc/?uri=https%3A%2F%2Fwww.offconvex.org%2F2016%2F07%2F10%2Fembeddingspolysemy%2F)

2018-08-28 About

Computational Neuroscience: Why does the brain adopt mechanisms like sparse coding to represent the environment? - Quora

Tags:

2017-06-19 About

Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning - YouTube

Tags:

2014-10-06 About

Provable Algorithms for Machine Learning Problems by Rong Ge.

Tags:

2014-04-23 About

Properties

sl:creationDate : 2014-10-06
sl:creationTime : 2014-10-06T00:58:02Z
sl:describedBy : https://en.wikipedia.org/wiki/Sparse_dictionary_learning
rdf:type : sl:Tag
skos:altLabel : Sparse dictionary learning@en
skos:prefLabel : Sparse coding@en