Semanlink - Open-source LLM

Parents :

Open-source LLM

Amis :

Descendants

8 Documents (Liste longue)

Leonie sur X : "Ollama allows you to run open source LLMs LOCALLY..."

Tags:

2024-03-30 A propos

Guillaume Lample sur X : "Mistral 7B is out. It outperforms Llama 2 13B on every benchmark we tried..."

Tags:

2023-09-28 A propos

Yam Peleg sur X : "Qwen-14B (Alibaba) The most powerful open-source model for it's size. And the longest trained: 3T tokens..."

Tags:

2023-09-28 A propos

Bindu Reddy sur X : "The Ongoing Case For Open Source LLMs..."

Tags:

2023-09-26 A propos

Releasing 3B and 7B RedPajama-INCITE family of models including base, instruction-tuned & chat models — TOGETHER

Tags:

Open-source LLM

2023-05-07 A propos

Google "We Have No Moat, And Neither Does OpenAI"

Tags:

> low-cost public involvement was enabled
by a vastly cheaper mechanism for fine tuning called low
rank adaptation ()[LoRA](tag:lora)

> **Part of what makes LoRA so effective is that ... it’s stackable.**
>
> By contrast, training giant models from scratch not only
throws away the pretraining, but also any iterative
improvements that have been made on top.

> LoRA updates are very cheap to produce (~$100) for the
most popular model sizes.

> Many of these projects are saving time by training on
small, highly curated datasets...
> These
datasets are built using synthetic methods (e.g. filtering
the best responses from an existing model) and
scavenging from other projects

> Directly Competing With Open Source
Is a Losing Proposition

> Paradoxically, the one clear winner in all of this is Meta.
Because the leaked model was theirs ([LLaMA](tag:llama)), they have
effectively garnered an entire planet's worth of free labor.
Since most open source innovation is happening on top of
their architecture, there is nothing stopping them from
directly incorporating it into their products.

2023-05-04 A propos

Ramsri Goutham Golla sur Twitter : "The most practical open-source competitor to @OpenAI 's GPT-3 is Google's Flan-T5 Here are 5 Flan-T5 resources to try out easily, deploy, or fine-tune it! 🧵" / Twitter

Tags:

2023-02-04 A propos

merve sur Twitter : "Do you want to know how models like ChatGPT work? Did you know you could build your own conversational product using open-source alternatives..."

Tags:

2022-12-06 A propos

Propriétés

sl:creationDate : 2023-05-07
sl:creationTime : 2023-05-07T09:50:23Z
rdf:type : sl:Tag
skos:altLabel : Open-source LLMs
skos:prefLabel : Open-source LLM