Semanlink - Few-shot text classification

Parents :

Few-shot text classification

Amis :

Descendants

9 Documents (Liste longue)

UKP Lab sur X : "a lightweight solution for few-shot domain-specific sentence classification: AdaSent!..."

Tags:

2023-12-09 A propos

Nils Reimers sur Twitter : "Cross-Lingual Text-Classification just from English Data"

Tags:

2023-07-20 A propos

Andrej Karpathy sur Twitter : "Base LLMs (non-finetuned) make very strong few-shot classifiers. Describe task in English, give few examples, read off the label probabilities on test example. No gradient-based optimization necessary. It brings a cannon to a knife fight but is fast, convenient, strong baseline." / Twitter

Tags:

2023-03-19 A propos

Few-Shot Text Classification (Cloudera 2020)

Tags:

2022-11-24 A propos

What Makes a Good Classification Example?

Tags:

2022-08-16 A propos

Sentence Transformer Fine-Tuning (SetFit): Outperforming GPT-3 on few-shot Text-Classification while being 1600 times smaller | by Moshe Wasserblat (2021-12)

Tags:

2022-03-31 A propos

[2203.14655] Few-Shot Learning with Siamese Networks and Label Tuning

Tags:

> the problem of building text classifiers with little or no training data.
>
> In recent years, an approach based on neural textual entailment models has been found to give strong results on a diverse range of tasks.

(cf. #[NLI](tag:nli), using the input text as the premise and the text representing the label as the hypothesis)

> In this work, we show that **with proper pre-training, Siamese Networks that embed texts and labels** offer a competitive alternative.
>
> We introduce **label tuning: fine-tuning the label embeddings only**. While giving lower performance than model fine-tuning (which updates all params of the model), this approach has the architectural advantage that a single encoder can be shared by many different tasks (we only fine-tune the label embeddings)
> The drop in quality can
be compensated by using a variant of **[Knowledge distillation](tag:knowledge_distillation)**

[Github](https://tinyurl.com/label-tuning), [Tweet](doc:2022/03/thomas_muller_sur_twitter_pa)

2022-03-30 A propos

Towards Unsupervised Text Classification Leveraging Experts and Word Embeddings - (ACL 2019)

Tags:

2020-10-05 A propos

Knowledge-Based Short Text Categorization Using Entity and Category Embedding | Springer for Research & Development (2019)

Tags:

2019-05-30 A propos

Propriétés

sl:creationDate : 2020-10-05
sl:creationTime : 2020-10-05T00:44:12Z
rdf:type : sl:Tag
skos:altLabel :
- Unsupervised Text Classification@en
- Dataless Text Classication@en
skos:prefLabel : Few-shot text classification