Generative Transformer LM AND Fine-tuning
Common descendants
25 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
How many Labelled Examples do you need for a BERT-sized Model to Beat GPT-4 on Predictive Tasks? - Speaker Deck
Tags:
2023-10-27 About
Leandro von Werra sur X : "Companies are currently deciding whether to invest in fine-tuning their own open LLMs (e.g. Llama 2) or to use closed LLMs via an API (e.g. Claude or GPT4)..."
Tags:
2023-10-01 About
[2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Tags:
2023-09-26 About
openai-cookbook/examples/Customizing_embeddings.ipynb
Tags:
2023-09-17 About
GPT-3.5 Turbo fine-tuning and API updates
Tags:
2023-08-22 About
Why You (Probably) Don't Need to Fine-tune an LLM - Tidepool by Aquarium
Tags:
2023-08-19 About
Rachel Woods sur X : "There's a resurgence of interest in fine tuning LLMs I've yet to see a successful public use case where fine tuning > prompting. But here's where I see fine tuning *mattering*..."
Tags:
2023-08-19 About
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Models to Unique Applications | Anyscale
Tags:
2023-08-18 About
Easily Finetune Llama 2 for Your Text-to-SQL Applications | by Jerry Liu | Aug, 2023
Tags:
2023-08-18 About
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 About
[2306.07536] TART: A plug-and-play Transformer module for task-agnostic reasoning
Tags:
2023-06-15 About
How to use Alpaca-LoRA to fine-tune a model like ChatGPT
Tags:
2023-05-26 About
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 About
Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."
Tags:
2023-04-05 About
Alpaca Finetuning of Llama on a 24G Consumer GPU
Tags:
2023-03-27 About
tloen/alpaca-lora: Instruct-tune LLaMA on consumer hardware
Tags:
2023-03-22 About
LLM Zoo at Home: LLaMA & Alpaca | bergis universe of software, hardware and ideas
Tags:
2023-03-20 About
Shayne Longpre sur Twitter : "A 🧵 on @OpenAI LLM "Alignment" (e.g. #ChatGPT)..."
Tags:
2023-02-27 About
Prompting, Instruction Finetuning, and RLHF (CS224N)
Tags:
2023-02-16 About
[2302.04870] Offsite-Tuning: Transfer Learning without Full Model
Tags:
2023-02-11 About
karpathy/nanoGPT: The simplest, fastest repository for training/finetuning medium-sized GPTs.
Tags:
2023-02-02 About
Shayne Longpre sur Twitter : "What’s the best completely public competitor to #ChatGPT? Flan-T5 beats all public models we tested..."
Tags:
2023-02-01 About
[2205.05638] Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Tags:
2022-12-15 About
How many data points is a prompt worth?
Tags:
2021-04-08 About