Semanlink - Dev ; NLP ; Semanlink Feature Request AND Semantic annotation

Search Tag:

Search Doc:

Preferences...

Tag Cloud

Keyword/keyphrase extraction - Semanlink Feature Request -

Dev ; NLP ; Semanlink Feature Request AND Semantic annotation

Common descendants

1 Document

NLP keyword extraction tutorial with RAKE and Maui

Tags:

2 tools:

- simple keyword extraction with a Python library (RAKE)
- Java tool (Maui) that uses a machine-learning technique.

Focus on 2 tasks:

- Extracting the most significant words and phrases that appear in given text
- Identifying a set of topics from a predefined vocabulary that match a given text

Typical steps:

- Candidate selection (extract all possible words, phrases, terms or concepts that can potentially be keywords).
- Properties calculation (for each candidate, properties that indicate that it may be a keyword)
- Scoring and selecting keywords

RAKE: finding multi-word phrases containing frequent words. +: simplicity, ease of use -: limited accuracy, parameter configuration requirement, throws away many valid phrases, doesn’t normalize candidates (no stemming).

Maui: ("Multi-purpose automatic topic indexing"). Based on [Weka](/semanlink/tag/weka) (GPL, java, maven, github). Compared to RAKE:

- Extract keywords not just from text, but also with a reference to a controlled vocabulary
- Improve the accuracy by training Maui on manually chosen keywords
    - but requires a training model.

Maui can use a controlled vocabulary expressed in SKOS - so I could use it in semanlink!

2017-05-24 About