LM Fine-tuning AND NLP: pretraining
Common descendants
25 Documents
LlamaIndex 🦙 sur X : "Fine-tuning Embedding Models for RAG with LoRA'
Tags:
2024-04-23 About
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
UKP Lab sur X : "a lightweight solution for few-shot domain-specific sentence classification: AdaSent!..."
Tags:
2023-12-09 About
How many Labelled Examples do you need for a BERT-sized Model to Beat GPT-4 on Predictive Tasks? - Speaker Deck
Tags:
2023-10-27 About
fast.ai - Can LLMs learn from a single example?
Tags:
2023-10-21 About
Leandro von Werra sur X : "Companies are currently deciding whether to invest in fine-tuning their own open LLMs (e.g. Llama 2) or to use closed LLMs via an API (e.g. Claude or GPT4)..."
Tags:
2023-10-01 About
[2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Tags:
2023-09-26 About
P-tuning for sequence classification
Tags:
2023-08-28 About
Why You (Probably) Don't Need to Fine-tune an LLM - Tidepool by Aquarium
Tags:
2023-08-19 About
Rachel Woods sur X : "There's a resurgence of interest in fine tuning LLMs I've yet to see a successful public use case where fine tuning > prompting. But here's where I see fine tuning *mattering*..."
Tags:
2023-08-19 About
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Models to Unique Applications | Anyscale
Tags:
2023-08-18 About
Easily Finetune Llama 2 for Your Text-to-SQL Applications | by Jerry Liu | Aug, 2023
Tags:
2023-08-18 About
Knowledge Graphs & LLMs: Fine-Tuning Vs. Retrieval-Augmented Generation | by Tomaz Bratanic | Neo4j Developer Blog (June 6 2023)
Tags:
2023-08-13 About
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 About
How to use Alpaca-LoRA to fine-tune a model like ChatGPT
Tags:
2023-05-26 About
Google "We Have No Moat, And Neither Does OpenAI"
Tags:
2023-05-04 About
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 About
[2205.05638] Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Tags:
2022-12-15 About
[2106.10199] BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
Tags:
2022-09-01 About
On Stability of Few-Sample Transformer Fine-Tuning | Kaggle
Tags:
2022-08-29 About
[2006.05987] Revisiting Few-sample BERT Fine-tuning
Tags:
2022-03-21 About
On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines (2021)
Tags:
2021-10-30 About
[1902.00751] Parameter-Efficient Transfer Learning for NLP
Tags:
2021-04-11 About
How many data points is a prompt worth?
Tags:
2021-04-08 About
[2004.10964] Don't Stop Pretraining: Adapt Language Models to Domains and Tasks
Tags:
2020-12-01 About