Semanlink - sl:creationDate : 2017-05-24

NLP keyword extraction tutorial with RAKE and Maui

Tags:

2 tools:

- simple keyword extraction with a Python library (RAKE)
- Java tool (Maui) that uses a machine-learning technique.

Focus on 2 tasks:

- Extracting the most significant words and phrases that appear in given text
- Identifying a set of topics from a predefined vocabulary that match a given text

Typical steps:

- Candidate selection (extract all possible words, phrases, terms or concepts that can potentially be keywords).
- Properties calculation (for each candidate, properties that indicate that it may be a keyword)
- Scoring and selecting keywords

RAKE: finding multi-word phrases containing frequent words. +: simplicity, ease of use -: limited accuracy, parameter configuration requirement, throws away many valid phrases, doesn’t normalize candidates (no stemming).

Maui: ("Multi-purpose automatic topic indexing"). Based on [Weka](/semanlink/tag/weka) (GPL, java, maven, github). Compared to RAKE:

- Extract keywords not just from text, but also with a reference to a controlled vocabulary
- Improve the accuracy by training Maui on manually chosen keywords
    - but requires a training model.

Maui can use a controlled vocabulary expressed in SKOS - so I could use it in semanlink!

2017-05-24 About

Swayy | Blog — An algorithm for generating automatic hashtags

Tags:

2017-05-24 About

An Efficient Way to Extract the Main Topics from a Sentence | The Tokenizer

Tags:

2017-05-24 About

Build your own summary tool! | The Tokenizer

Tags:

2017-05-24 About

Extract Subject Matter of Documents Using NLP – Alexander Crosson – Medium

Tags:

2017-05-24 About

Summarize Documents using Tf-Idf – Alexander Crosson – Medium

Tags:

2017-05-24 About