Favoris ; AI girls and guys ; Pre-Trained Language Models AND LM Fine-tuning
Common descendants
6 Documents
Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."
Tags:
2024-04-23 About
How many Labelled Examples do you need for a BERT-sized Model to Beat GPT-4 on Predictive Tasks? - Speaker Deck
Tags:
2023-10-27 About
fast.ai - Can LLMs learn from a single example?
Tags:
2023-10-21 About
Easily Finetune Llama 2 for Your Text-to-SQL Applications | by Jerry Liu | Aug, 2023
Tags:
2023-08-18 About
Andrej Karpathy sur Twitter : "There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic..."
Tags:
2023-04-21 About
[2106.10199] BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
Tags:
2022-09-01 About