Semanlink - Semanlink related AND NLP

> for each unseen instance, its K nearest neighbors in the training set are firstly identified. After that, based on statistical information gained from the label sets of these neighboring instances, i.e. the number of neighboring instances belonging to each possible class, [Maximum a posteriori (MAP)](tag:maximum_a_posteriori_estimation) principle is utilized to determine the label set for the unseen instance.

Implemented in [scikit-multilearn](http://scikit.ml/api/skmultilearn.adapt.mlknn.html), in [java](https://github.com/lefman/mulan-extended/blob/master/mulan/src/mulan/classifier/lazy/MLkNN.java)

> the first lazy approach proposed specifically for multi-label classification. This is also a binary relevance approach which considers each label independently as a binary classification problem. Instead of a standard k-NN method, however, MLkNN uses the maximum a-posteriori (MAP) (Kelleher et al., 2015) approach combined with k-NN. [src](https://pdfs.semanticscholar.org/af9b/33da37d290c063cd826ab5923d96892a9767.pdf)

2018-03-18 About

Extreme Multi-label Learning with Label Features for Warm-start Tagging, Ranking & Recommendation (2018)

Tags:

2018-03-04 About

RESEARCH TRACK: Web Content Analysis, Semantics and Knowledge

Tags:

[CFP](https://www2018.thewebconf.org/call-for-papers/research-tracks-cfp/web-content-analysis/)

> In previous years, ‘content analysis’ and ‘semantic and knowledge’ were in separate track. This year, we combined these tracks to emphasize the close relationship between these topics; **the use of content to curate knowledge and the use of knowledge to guide content analysis and intelligent usage**.

Some of the accepted papers:
### [Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN](https://doi.org/10.1145/3178876.3186005)

[Hierarchical Text Classification](/tag/nlp_hierarchical_text_classification): Text classification to a hierarchical taxonomy of topics, using graph representation of text, and CNN over this graph

Renvoie à ce qui a été vu dans le tutorial "Graph-based Text Representations"

from the abstract:

> a graph-CNN based deep learning model to first convert texts to graph-of-words, and then use graph convolution operations to convolve the word graph. Graph-of-words representation of texts has the advantage of capturing non-consecutive and long-distance semantics. CNN models have the advantage of learning different level of semantics. To further leverage the hierarchy of labels, we regularize the deep architecture with the dependency among labels

Conversion of text to graph: potentially given a single document

### [Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learning](https://doi.org/10.1145/3178876.3186024 )

Extraction de relations de corpus de textes de façon semi-supervisée, dans un contexte où on a peu de données labellisées décrivant les relations.

Par exemple, des données labellisées indique que le texte "Beijing, capital of China" correspond à la relation entre entités : ("Beijing", "Capital Of", "China), et on voudrait pouvoir extraire les entités et relations pertinentes à partir de texte tel que "Paris, France's capital,..."

Le papier décrit une méthode qui combine deux modules, l'un basé sur l'extraction automatique de patterns (par ex "[Head], Capital Of [Tail]") et l'autre sur la "sémantique distributionnelle" (du type "word embeddings"). Ces deux modules collaborent, le premier permettant de créer des instances de relations augmentant la base de connaissance sur lequel entrainer le second, et le second aidant le premier à déterminer des patterns informatifs ("co-entrainement")

### [Scalable Instance Reconstruction in Knowledge Bases via Relatedness Affiliated Embedding](https://doi.org/10.1145/3178876.3186017)

Knowledge base completion problem: usually, it is formulated as a link prediction problem, but not here. A novel knowledge embedding model ("Joint Modelling and Learning of Relatedness and Embedding")

### [Improving Word Embedding Compositionality using Lexicographic Definitions](https://doi.org/10.1145/3178876.3186007)

comment obtenir les meilleures représentations de texte à partir de représentations de mots (word embeddings) ? L'auteur utilise des ressources lexicographiques (wordnet) pour ses tests : l'embedding obtenu pour la définition d'un mot est-il proche de celui du mot ?

Le papier s'appuie sur une [thèse du même auteur](https://esc.fnwi.uva.nl/thesis/centraal/files/f1554608041.pdf), claire et bien écrite.

### [CESI: Canonicalizing Open Knowledge Bases using Embeddings and Side Information](https://doi.org/10.1145/3178876.3186030)

Amélioration de l'extraction de triplets (nom phrase, property, nom phrase) à partir de texte en calculant des embeddings pour les "nom phrases" (~entités)

### [Short-Text Topic Modeling via Non-negative Matrix Factorization Enriched with Local Word-Context Correlations](https://doi.org/10.1145/3178876.3186009)

Topic modeling for short texts, leveraging the word-context semantic correlations in the training

### [Towards Annotating Relational Data on the Web with Language Models](https://doi.org/10.1145/3178876.3186029)

### A paper by [David Blei](/tag/david_blei): (Dynamic Embeddings for Language Evolution)

2018-01-27 About

[1705.08039] Poincaré Embeddings for Learning Hierarchical Representations

Tags:

2017-12-16 About

Efficient unsupervised keywords extraction using graphs

Tags:

2017-10-04 About

Enriching Word Embeddings Using Knowledge Graph for Semantic Tagging in Conversational Dialog Systems - Microsoft Research (2015)

Tags:

> new simple, yet effective approaches to
learn domain specific word embeddings.

## Intro

> Adapting word embeddings, such as jointly capturing
syntactic and semantic information, can further enrich semantic
word representations for several tasks, e.g., sentiment
analysis (Tang et al. 2014), named entity recognition
(Lebret, Legrand, and Collobert 2013), entity-relation extraction
(Weston et al. 2013), etc. (Yu and Dredze 2014)
has introduced a lightly supervised word embedding learning
extending word2vec. They incorporate prior information to the objective
function as a regularization term considering synonymy relations
between words from Wordnet (Fellbaum 1999).

> In this work, we go one step further and investigate if
enriching the word2vec word embeddings trained on unstructured/
unlabeled text with domain specific semantic relations
obtained from knowledge sources (e.g., knowledge
graphs, search query logs, etc.) can help to discover relation
aware word embeddings. Unlike earlier work, **we encode the
information about the relations between phrases, thereby,
entities and relation mentions are all embedded into a low dimensional
vector space**.

## Related work (Learning Word Embeddings with Priors)

- word2vec
- Relational Constrained Model (RTM) (Yu and Dredze 2014)
While CBOW learns lexical word embeddings from provided text, the RTM learns embeddings of words based on their similarity to other words provided by a knowledge resource (eg. wordnet)
- Joint model  (Yu and Dredze 2014)
combines CBOW and RTM through linear combination

2017-10-02 About

What is a simple but detailed explanation of Textrank? - Quora

Tags:

TextRank

2017-07-12 About

How does Textrank work? (slides)

Tags:

TextRank

2017-07-12 About

gensim: models.phrases – Phrase (collocation) detection

Tags:

2017-07-10 About

A Ranking Approach to Keyphrase Extraction - Microsoft Research (2009)

Tags:

2017-06-27 About

Salmon Run: Implementing the RAKE Algorithm with NLTK

Tags:

2017-06-26 About

Kea (Keyphrase Extraction Algorithm)

Tags:

Keyword/keyphrase extraction

2017-06-26 About

RAKE: A python implementation of the Rapid Automatic Keyword Extraction

Tags:

2017-06-26 About

Automatic Keyphrase Extraction (Poster): A Survey of the State of the Art (2014)

Tags:

Keyword/keyphrase extraction

2017-06-20 About

Automatic Keyphrase Extraction: A Survey of the State of the Art (2014)

Tags:

Keyword/keyphrase extraction

2017-06-20 About

TextRank: Bringing Order into Texts (2004)

Tags:

2017-06-14 About

Conundrums in Unsupervised Keyphrase Extraction: Making Sense of the State-of-the-Art (2010)

Tags:

Keyword/keyphrase extraction

2017-06-14 About

Intro to Automatic Keyphrase Extraction

Tags:

2017-06-14 About

Automated Keyword Extraction – TF-IDF, RAKE, and TextRank (Less Than Dot - Blog)

Tags:

2017-06-13 About

Text Summarization with Gensim

Tags:

2017-06-02 About

NLP keyword extraction tutorial with RAKE and Maui

Tags:

2 tools:

- simple keyword extraction with a Python library (RAKE)
- Java tool (Maui) that uses a machine-learning technique.

Focus on 2 tasks:

- Extracting the most significant words and phrases that appear in given text
- Identifying a set of topics from a predefined vocabulary that match a given text

Typical steps:

- Candidate selection (extract all possible words, phrases, terms or concepts that can potentially be keywords).
- Properties calculation (for each candidate, properties that indicate that it may be a keyword)
- Scoring and selecting keywords

RAKE: finding multi-word phrases containing frequent words. +: simplicity, ease of use -: limited accuracy, parameter configuration requirement, throws away many valid phrases, doesn’t normalize candidates (no stemming).

Maui: ("Multi-purpose automatic topic indexing"). Based on [Weka](/semanlink/tag/weka) (GPL, java, maven, github). Compared to RAKE:

- Extract keywords not just from text, but also with a reference to a controlled vocabulary
- Improve the accuracy by training Maui on manually chosen keywords
    - but requires a training model.

Maui can use a controlled vocabulary expressed in SKOS - so I could use it in semanlink!

2017-05-24 About

Swayy | Blog — An algorithm for generating automatic hashtags

Tags:

2017-05-24 About

An Efficient Way to Extract the Main Topics from a Sentence | The Tokenizer

Tags: