Semanlink - Tools AND NLP

> Toolformer, **a model
trained to decide which APIs to call, when to
call them, what arguments to pass, and how to
best incorporate the results into future token
prediction**.

> fulfills the
following desiderata:
> - The use of tools should be learned in a
self-supervised way without requiring large
amounts of human annotations
>- The LM should be able to decide for itself when
and how to use which tool.

> Approach based
on the recent idea of using large LMs with incontext
learning (Brown et al., 2020) to generate
entire datasets from scratch.
>
> Given just a handful of human-written examples
of how an API can be used, 
> - we let a LM annotate
a huge language modeling dataset with potential
API calls. 
> - We then use a self-supervised loss to
determine which of these API calls actually help
the model in predicting future tokens. 
>- Finally, we
finetune the LM itself on the API calls that it considers
useful.

[Jay Hack @mathemagic1an sur twitter](https://twitter.com/mathemagic1an/status/1624870248221663232):

> from a small seed set of human inputs (essentially demonstrating usage of APIs), the training set for this behavior is generated by the LLM itself.
> 
> So what does this mean? We've found a promising way to tightly integrate arbitrary APIs with our best-performing models.

2023-02-13 A propos

Jay Hack sur Twitter : "My thoughts on Toolformer IMO the most important paper in the past few weeks..."

Tags:

2023-02-13 A propos

Timo Schick sur Twitter : "Introducing the Toolformer, a language model that teaches itself to use various tools in a self-supervised way..."

Tags:

2023-02-13 A propos

explosion/prodigy-openai-recipes: ✨ Bootstrap annotation with zero- & few-shot learning via OpenAI GPT-3

Tags:

2023-02-11 A propos

Towards a Tagalog NLP pipeline

Tags:

2023-02-04 A propos

deepset sur Twitter : " Generative models have taken the world of NLP by storm. But LLMs do not know about your personal data. This makes personal assistants, enterprise knowledge management and many other applications challenging. Retrieval augmented pipelines are the answer"

Tags:

2023-02-02 A propos

Jaided AI: EasyOCR

Tags:

2023-01-30 A propos

Where does hugging face's transformers save models? - Stack Overflow

Tags:

2023-01-04 A propos

IBM/zshot: Zero and Few shot named entity & relationships recognition

Tags:

2022-12-23 A propos

Matthew Honnibal sur Twitter : "We've been working on new prodi.gy workflows that let you use the @OpenAI API to kickstart your annotations, via zero- or few-shot learning. ..."

Tags:

2022-12-20 A propos

cardiffnlp/tweetnlp: "TweetNLP for all the NLP enthusiasts working on Twitter!..."

Tags:

2022-10-27 A propos

merve sur Twitter : "@huggingface transformers includes a new pipeline called Document Question Answering. This is a pipeline you can use to extract information from PDFs!...

Tags:

2022-09-20 A propos

Active Learning with AutoNLP and Prodigy

Tags:

2022-09-06 A propos

A framework for designing document processing solutions

Tags:

2022-09-02 A propos

Philip Vollet sur Twitter : "Extracting information from PDFs or scanned documents is still a challenge! Use the @huggingface LayoutLMv3 model and Prodigy..."

Tags:

2022-09-02 A propos

AllenNLP sur Twitter : "Dataset: training data for @MetaAI 's No Language Left Behind NLLB-200 models!..."

Tags:

2022-08-25 A propos

Connor Shorten sur Twitter : "Wow, incredible to see this from NASA! 🚀 Weaviate's integration of Vector Search with Graph Data and Symbolic Relations is a very interesting combination of technologies!..."

Tags:

2022-08-11 A propos

[2006.01969] REL: An Entity Linker Standing on the Shoulders of Giants

Tags:

2022-07-12 A propos

Cohere

Tags:

2022-07-08 A propos

Understanding Semantic Search and Question Answering | deepset

Tags:

2022-06-03 A propos

jboynyc/textnets: Text analysis with networks.

Tags:

2022-05-30 A propos

Max Irwin sur Twitter : "Instant Neural Search for your website! ..."

Tags:

2022-05-19 A propos

DataBorg - Knowledge management simplified

Tags:

2022-05-14 A propos

SPIKE for Knowledge Base Construction

Tags:

2022-02-22 A propos

Yosi Shamay sur Twitter : "a new platform for rapid ad-hoc knowledgebase construction using extractive search...."

Tags:

2022-02-22 A propos

Modern Question Answering Systems Explained

Tags:

Haystack

2022-01-27 A propos

Haystack Annotation Tool

Tags:

Haystack Annotation Tool

2022-01-27 A propos

allenai/macaw: Multi-angle c(q)uestion answering

Tags:

2022-01-22 A propos

Integrate ORQA and REALM for Open Domain Question Answering · Issue #312 · deepset-ai/haystack

Tags:

2022-01-12 A propos

How to build a chatbot that reads all your data to find the right answer - Xatkit

Tags:

2022-01-11 A propos

Explosion 💥 sur Twitter : "...annotation tool and AutoNLP to train state-of-the-art NLP models!"

Tags:

2021-12-30 A propos

semi-technologies/weaviate: Weaviate is a cloud-native, modular, real-time vector search engine

Tags:

2021-12-05 A propos

Semantic search through a vectorized Wikipedia (SentenceBERT) with the Weaviate vector search engine

Tags:

2021-12-05 A propos

Building a sentence embedding index with fastText and BM25 | by David Mezzetti | Towards Data Science

Tags:

2021-09-30 A propos

neuml/txtai: Build AI-powered semantic search applications

Tags:

txtai

2021-09-30 A propos

Haystack (deepset)

Tags:

2021-09-20 A propos

Build NLP features into your product | deepset

Tags:

2021-09-20 A propos

stanfordnlp/stanza: Official Stanford NLP Python Library for Many Human Languages

Tags:

2021-09-20 A propos

librAIry

Tags:

2021-06-22 A propos

Improving Quality of Search Results Clustering with Approximate Matrix Factorisations (2006)

Tags:

Lingo

2021-06-02 A propos

Carrot2 search results clustering engine (online)

Tags:

Carrot2

2021-05-27 A propos

Why we switched from Spacy to Flair to anonymize French case law | by Michaël Benesty | Towards Data Science

Tags:

2021-02-10 A propos

[1911.03876] Dynamic Neuro-Symbolic Knowledge Graph Construction for Zero-shot Commonsense Question Answering

Tags:

2021-02-08 A propos

Weaviate

Tags:

2021-01-18 A propos

[2004.10964] Don't Stop Pretraining: Adapt Language Models to Domains and Tasks

Tags:

2020-12-01 A propos

[2011.06993] FLERT: Document-Level Features for Named Entity Recognition

Tags:

2020-12-01 A propos

Semantic Scholar | AI-Powered Research Tool

Tags:

2020-11-24 A propos

Wikifier

Tags:

2020-10-11 A propos

TAGME: on-the-fly annotation of short text fragments!

Tags:

2020-10-11 A propos

dicksontsai/stanford-nlp-local-extension: Chrome extension for sending content to localhost server running Stanford NLP tools.

Tags:

2020-07-03 A propos

Denny Britz sur Twitter : "I built a little frontend for my AI/ML papergraph tool..."

Tags:

2020-05-27 A propos

20,000 Roam Tags with Spacy

Tags:

2020-05-15 A propos

AmbiverseNLU: A Natural Language Understanding suite by Max Planck Institute for Informatics

Tags:

2020-03-13 A propos

Distilling BERT models with spaCy - Towards Data Science (2019)

Tags:

2020-02-15 A propos

Extractive Text Summarization Using spaCy in Python

Tags:

2020-02-09 A propos

fastai/nbdev: Create delightful python projects using Jupyter Notebooks

Tags:

2020-01-12 A propos

[1711.00046] Replace or Retrieve Keywords In Documents at Scale

Tags:

2020-01-09 A propos

[1912.08904] Macaw: An Extensible Conversational Information Seeking Platform

Tags:

2020-01-01 A propos

Custom Named Entity Recognition Using spaCy - Towards Data Science

Tags:

2019-12-31 A propos

Elasticsearch RSS feed indexer with Spacy entity extraction

Tags:

2019-11-24 A propos

Document analysis with machine learning

Tags:

2019-10-28 A propos

Sebastian Ruder sur Twitter : "It's great to see the growing landscape of NLP transfer learning libraries"

Tags:

2019-09-13 A propos

Blackstone Concept Extractor — ICLR&D

Tags:

2019-08-21 A propos

Sofie Van Landeghem: Entity linking functionality in spaCy (spaCy IRL 2019) - Slides

Tags:

2019-07-13 A propos

Sofie Van Landeghem: Entity linking functionality in spaCy (spaCy IRL 2019) - YouTube

Tags:

2019-07-13 A propos

SpacyIRL 2019 Conference in Overview | LinkedIn

Tags:

spaCy

2019-07-13 A propos

spaCy sur Twitter : "THE VIDEOS FROM #spaCyIRL ARE NOW LIVE!"

Tags:

spaCy

2019-07-12 A propos

State-of-the-art neural coreference resolution for chatbots

Tags:

2019-05-28 A propos

Dandelion API - Semantic Text Analytics as a service

Tags:

2019-04-24 A propos

Sent2Vec: An unsupervised approach towards learning sentence embeddings | RARE Technologies

Tags:

2019-03-25 A propos

Keywords2vec

Tags:

2019-02-09 A propos

Jeremy Howard on Twitter: "Such a ridiculously simple idea couldn't possibly work, could it? Or... could it? "

Tags:

2019-02-09 A propos

StanfordNLP | StanfordNLP

Tags:

2019-01-30 A propos

Open-sourcing PyText for faster NLP development

Tags:

2018-12-15 A propos

Prodigy · An annotation tool for AI, Machine Learning & NLP

Tags:

2018-12-09 A propos

Matthew Honnibal sur Twitter : "Have been experimenting with an unsupervised pre-training technique for @spacy_io, similar to ULMFit/Elmo/BERT etc.

Tags:

2018-11-18 A propos

Writing Code for NLP Research, AllenNLP's tutorial at #emnlp2018

Tags:

2018-10-31 A propos

Key topics extraction and contextual sentiment of users’ reviews

Tags:

2018-09-18 A propos

zalandoresearch/flair: A very simple framework for state-of-the-art NLP

Tags:

2018-08-24 A propos

Natural Language Processing is Fun! – Adam Geitgey – Medium

Tags:

2018-07-23 A propos

Serving a model with Flask

Tags:

2018-05-21 A propos

How to Train your Own Model with NLTK and Stanford NER Tagger? (for English, French, German…)

Tags:

2018-05-20 A propos

Tutorial on Poincaré Embeddings (Jupyter Notebook )

Tags:

2018-05-20 A propos

Implementing Poincaré Embeddings | RARE Technologies

Tags:

2018-05-20 A propos

NLP using Word Vectors with Spacy - CLDSPN | Kaggle

Tags:

2018-05-11 A propos

Text Data Preprocessing: A Walkthrough in Python

Tags:

2018-04-09 A propos

Sense2vec with spaCy and Gensim · Blog · Explosion AI

Tags:

2018-04-08 A propos

A short introduction to NLP in Python with spaCy – Towards Data Science

Tags:

2018-04-05 A propos

GitHub - anvaka/word2vec-graph: Exploring word2vec embeddings as a graph of nearest neighbors

Tags:

2018-03-12 A propos

SPACY'S ENTITY RECOGNITION MODEL: incremental parsing with Bloom embeddings & residual CNNs - YouTube

Tags:

2018-03-06 A propos

Intro to text classification with Keras: automatically tagging Stack Overflow posts | Google Cloud Big Data and Machine Learning Blog

Tags:

2018-03-04 A propos

[1710.04099] Wembedder: Wikidata entity embedding web service

Tags:

2018-02-13 A propos

gensim/WMD_tutorial.ipynb

Tags:

2017-12-23 A propos

How to use pre-trained word vectors from Facebook’s fastText

Tags:

2017-11-25 A propos

Modifications for the Cluster Content Discovery and the Cluster Label Induction Phases of the Lingo Algorithm (2014)

Tags:

Lingo

2017-11-11 A propos

How to Write a Spelling Corrector (Peter Norvig)

Tags:

2017-10-25 A propos

Using Gensim Word2Vec Embeddings in Keras | Ben Bolte's Blog

Tags:

2017-10-23 A propos

Concept Search on Wikipedia · Chris McCormick

Tags:

2017-09-10 A propos

Embed, encode, attend, predict: The new deep learning formula for state-of-the-art NLP models | Blog | Explosion AI

Tags:

2017-07-20 A propos

Gensim tutorial: Similarity Queries

Tags:

2017-07-19 A propos

Watson: Alchemy Language v1 API Explorer

Tags:

2017-07-18 A propos

Dealing with Human Language | Elasticsearch: The Definitive Guide [master]

Tags:

2017-07-18 A propos

Dive Into NLTK, Part V: Using Stanford Text Analysis Tools in Python – Text Mining Online

Tags:

2017-07-11 A propos

NLTK: Installing Third Party Software · nltk Wiki

Tags:

2017-07-11 A propos

Lingo: Search Results Clustering Algorithm Based on Singular Value Decomposition (slides)

Tags:

2017-07-11 A propos

Lingo: Search Results Clustering Algorithm Based on Singular Value Decomposition (2004) (paper)

Tags:

2017-07-11 A propos

Source code for nltk.tag.stanford — NLTK documentation

Tags:

2017-07-11 A propos

RDRPOSTagger: A Rule-based Part-of-Speech and Morphological Tagging Toolkit

Tags:

2017-07-11 A propos

TreeTagger - a part-of-speech tagger for many languages

Tags:

2017-07-11 A propos

nltk.tag.stanford module — NLTK documentation

Tags:

2017-07-11 A propos

Stanford Log-linear Part-Of-Speech Tagger

Tags:

Stanford POS Tagger

2017-07-11 A propos

What are all possible pos tags of NLTK? - Stack Overflow

Tags:

2017-07-11 A propos

Tags:

2017-07-10 A propos

gensim: models.phrases – Phrase (collocation) detection

Tags:

2017-07-10 A propos

Teaching a Computer to Read: - Scripted

Tags:

2017-07-10 A propos

Cortical.io - Fast, precise, intuitive NLP

Tags:

Cortical.io

2017-07-10 A propos

spaCy - Industrial-strength Natural Language Processing in Python

Tags:

spaCy

2017-06-29 A propos

How can I tag and chunk French text using NLTK and Python? - Stack Overflow

Tags:

2017-06-29 A propos

TextBlob: Simplified Text Processing

Tags:

TextBlob

2017-06-29 A propos

Document Clustering with Python

Tags:

2017-06-28 A propos

gensim/FastText_Tutorial.ipynb

Tags:

2017-06-28 A propos

NLTK Book

Tags:

NLTK

2017-06-26 A propos

Salmon Run: Implementing the RAKE Algorithm with NLTK

Tags:

2017-06-26 A propos

RAKE: A python implementation of the Rapid Automatic Keyword Extraction

Tags:

2017-06-26 A propos

Gensim tutorials

Tags:

2017-06-23 A propos

Accessing Text Corpora and Lexical Resources

Tags:

2017-06-20 A propos

html2text

Tags:

2017-06-13 A propos

Automated Keyword Extraction – TF-IDF, RAKE, and TextRank (Less Than Dot - Blog)

Tags:

2017-06-13 A propos

An Intuitive Understanding of Word Embeddings: From Count Vectors to Word2Vec

Tags:

2017-06-09 A propos

word2vec-api

Tags:

2017-06-09 A propos

News classification with topic models in gensim

Tags:

2017-06-07 A propos

Lingo3G or Carrot2? | Carrot Search

Tags:

Carrot2

2017-06-04 A propos

Using Gensim for LDA (notebook)

Tags:

2017-06-02 A propos

(Relatively) quick and easy Gensim example code | William Bert

Tags:

2017-06-02 A propos

Text Summarization with Gensim

Tags:

2017-06-02 A propos

pyLDAvis

Tags:

2017-06-02 A propos

gensim: models.word2vec – Deep learning with word2vec

Tags:

2017-06-01 A propos

Word2vec in gensim Tutorial | RaRe Technologies

Tags:

2017-06-01 A propos

NLP keyword extraction tutorial with RAKE and Maui

Tags:

2 tools:

- simple keyword extraction with a Python library (RAKE)
- Java tool (Maui) that uses a machine-learning technique.

Focus on 2 tasks:

- Extracting the most significant words and phrases that appear in given text
- Identifying a set of topics from a predefined vocabulary that match a given text

Typical steps:

- Candidate selection (extract all possible words, phrases, terms or concepts that can potentially be keywords).
- Properties calculation (for each candidate, properties that indicate that it may be a keyword)
- Scoring and selecting keywords

RAKE: finding multi-word phrases containing frequent words. +: simplicity, ease of use -: limited accuracy, parameter configuration requirement, throws away many valid phrases, doesn’t normalize candidates (no stemming).

Maui: ("Multi-purpose automatic topic indexing"). Based on [Weka](/semanlink/tag/weka) (GPL, java, maven, github). Compared to RAKE:

- Extract keywords not just from text, but also with a reference to a controlled vocabulary
- Improve the accuracy by training Maui on manually chosen keywords
    - but requires a training model.

Maui can use a controlled vocabulary expressed in SKOS - so I could use it in semanlink!

2017-05-24 A propos

An Efficient Way to Extract the Main Topics from a Sentence | The Tokenizer

Tags: