Tweet AND Fine-tuning
Descendants partagés
24 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 A propos
LlamaIndex 🦙 sur X : "RAFT - Retrieval Augmented Fine Tuning..."
Tags:
2024-03-28 A propos
UKP Lab sur X : "a lightweight solution for few-shot domain-specific sentence classification: AdaSent!..."
Tags:
2023-12-09 A propos
Leandro von Werra sur X : "Companies are currently deciding whether to invest in fine-tuning their own open LLMs (e.g. Llama 2) or to use closed LLMs via an API (e.g. Claude or GPT4)..."
Tags:
2023-10-01 A propos
Jerry Liu sur X : "One major way to improve your RAG system is to fine-tune your embedding model"
Tags:
2023-08-25 A propos
Rachel Woods sur X : "There's a resurgence of interest in fine tuning LLMs I've yet to see a successful public use case where fine tuning > prompting. But here's where I see fine tuning *mattering*..."
Tags:
2023-08-19 A propos
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 A propos
Sanjeev Arora sur Twitter : "new `skills' induced by LLM fine-tuning can be localized in tiny fraction of the model."
Tags:
2023-07-07 A propos
Sanjeev Arora sur Twitter : "Fine-tuning language models using just forward pass!...r
Tags:
2023-06-09 A propos
Peter J. Liu sur Twitter : "RLHF-alternative without RL"
Tags:
2023-05-18 A propos
Hyung Won Chung sur Twitter : "RLHF as an instance of using a learned objective function"
Tags:
2023-05-18 A propos
Niels Rogge sur Twitter : "Made some new demo notebooks! - fine-tune @MetaAI's SAM and @GoogleAI's Pix2Struct on custom data"
Tags:
2023-05-09 A propos
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 A propos
Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."
Tags:
2023-04-05 A propos
Shayne Longpre sur Twitter : "A 🧵 on @OpenAI LLM "Alignment" (e.g. #ChatGPT)..."
Tags:
2023-02-27 A propos
(((ل()(ل() 'yoav))))👾 sur Twitter : "there is this genre of papers that show you can train/tune only some subset of a network's weights, freezing the rest, and things still work as well as (or better than) full training/tuning..."
Tags:
2023-02-15 A propos
Shital Shah sur Twitter : "Surprising and important paper: TLDR; All the gains we get by first pre-training on large dataset and then fine tuning on small dataset could be obtained by just small dataset but with pre-training objective!!"
Tags:
2023-02-04 A propos
Shayne Longpre sur Twitter : "What’s the best completely public competitor to #ChatGPT? Flan-T5 beats all public models we tested..."
Tags:
2023-02-01 A propos
Lewis Tunstall sur Twitter : "The SetFit library for few-shot learning with Sentence Transformers now supports *multi-label text classification*..."
Tags:
2022-10-14 A propos
Sanjeev Arora sur Twitter : "A priori, fine-tuning a huge LM on a few datapoints could lead to catastrophic overfitting. So why doesn’t it? Our theory + experiments..."
Tags:
2022-10-14 A propos
Nils Reimers sur Twitter : "GPL goes multi-lingual..."
Tags:
2022-06-01 A propos
Ramsri Goutham Golla sur Twitter : "Hi @Nils_Reimers For GPL you used "msmarco-distilbert-base-tas-b" model and ..."
Tags:
2022-04-27 A propos
Nils Reimers sur Twitter : "Great post on SetFit"
Tags:
2022-03-31 A propos
Ananya Kumar sur Twitter : "How should you fine-tune a large pretrained model (CLIP, SimCLR) robustly?..."
Tags:
2022-03-03 A propos