Fine-tuning AND LLM
Descendants partagés
41 Documents
LlamaIndex 🦙 sur X : "Fine-tuning Embedding Models for RAG with LoRA'
Tags:
2024-04-23 A propos
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 A propos
LlamaIndex 🦙 sur X : "RAFT - Retrieval Augmented Fine Tuning..."
Tags:
2024-03-28 A propos
Sanjeev Arora sur X : "It's better to use just 5% of the instruction-tuning data (suitably selected) instead of the full dataset."
Tags:
2024-02-15 A propos
How many Labelled Examples do you need for a BERT-sized Model to Beat GPT-4 on Predictive Tasks? - Speaker Deck
Tags:
2023-10-27 A propos
fast.ai - Can LLMs learn from a single example?
Tags:
2023-10-21 A propos
Fine-tuning with Retrieval Augmentation - LlamaIndex
Tags:
2023-10-07 A propos
Fine Tuning with Function Calling - LlamaIndex
Tags:
2023-10-07 A propos
[2310.01352] RA-DIT: Retrieval-Augmented Dual Instruction Tuning
Tags:
2023-10-07 A propos
Leandro von Werra sur X : "Companies are currently deciding whether to invest in fine-tuning their own open LLMs (e.g. Llama 2) or to use closed LLMs via an API (e.g. Claude or GPT4)..."
Tags:
2023-10-01 A propos
[2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Tags:
2023-09-26 A propos
Fine-Tuning a Linear Adapter for Any Embedding Model | LlamaIndex Blog | Sep, 2023
Tags:
2023-09-18 A propos
openai-cookbook/examples/Customizing_embeddings.ipynb
Tags:
2023-09-17 A propos
Fine-Tuning Your Embedding Model to Maximize Relevance Retrieval in RAG Pipeline | by Wenqi Glantz | Sep, 2023 | Better Programming
Tags:
2023-09-13 A propos
Jerry Liu sur X : "One major way to improve your RAG system is to fine-tune your embedding model"
Tags:
2023-08-25 A propos
GPT-3.5 Turbo fine-tuning and API updates
Tags:
2023-08-22 A propos
Why You (Probably) Don't Need to Fine-tune an LLM - Tidepool by Aquarium
Tags:
2023-08-19 A propos
Rachel Woods sur X : "There's a resurgence of interest in fine tuning LLMs I've yet to see a successful public use case where fine tuning > prompting. But here's where I see fine tuning *mattering*..."
Tags:
2023-08-19 A propos
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Models to Unique Applications | Anyscale
Tags:
2023-08-18 A propos
Easily Finetune Llama 2 for Your Text-to-SQL Applications | by Jerry Liu | Aug, 2023
Tags:
2023-08-18 A propos
Knowledge Graphs & LLMs: Fine-Tuning Vs. Retrieval-Augmented Generation | by Tomaz Bratanic | Neo4j Developer Blog (June 6 2023)
Tags:
2023-08-13 A propos
clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."
Tags:
2023-07-19 A propos
[2305.12517] Retrieving Texts based on Abstract Descriptions
Tags:
2023-06-15 A propos
[2306.07536] TART: A plug-and-play Transformer module for task-agnostic reasoning
Tags:
2023-06-15 A propos
How to use Alpaca-LoRA to fine-tune a model like ChatGPT
Tags:
2023-05-26 A propos
Hyung Won Chung sur Twitter : "RLHF as an instance of using a learned objective function"
Tags:
2023-05-18 A propos
Google "We Have No Moat, And Neither Does OpenAI"
Tags:
2023-05-04 A propos
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 A propos
Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."
Tags:
2023-04-05 A propos
Alpaca Finetuning of Llama on a 24G Consumer GPU
Tags:
2023-03-27 A propos
tloen/alpaca-lora: Instruct-tune LLaMA on consumer hardware
Tags:
2023-03-22 A propos
LLM Zoo at Home: LLaMA & Alpaca | bergis universe of software, hardware and ideas
Tags:
2023-03-20 A propos
Shayne Longpre sur Twitter : "A 🧵 on @OpenAI LLM "Alignment" (e.g. #ChatGPT)..."
Tags:
2023-02-27 A propos
[2212.09741] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Tags:
2023-02-17 A propos
Prompting, Instruction Finetuning, and RLHF (CS224N)
Tags:
2023-02-16 A propos
[2302.04870] Offsite-Tuning: Transfer Learning without Full Model
Tags:
2023-02-11 A propos
The Flan Collection: Advancing open source methods for instruction tuning – Google AI Blog
Tags:
2023-02-02 A propos
karpathy/nanoGPT: The simplest, fastest repository for training/finetuning medium-sized GPTs.
Tags:
2023-02-02 A propos
Shayne Longpre sur Twitter : "What’s the best completely public competitor to #ChatGPT? Flan-T5 beats all public models we tested..."
Tags:
2023-02-01 A propos
[2205.05638] Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Tags:
2022-12-15 A propos
How many data points is a prompt worth?
Tags:
2021-04-08 A propos