Semanlink - OpenAI

Parents :

Artificial Intelligence

Home Page OpenAI

Amis :

Descendants

16 Documents (Liste longue)

Jeremy Howard sur X : "OK everyone's asking me for my take on the OpenAI stuff, so here it is...."

Tags:

2023-11-18 A propos

OpenAI, concurrencé, baisse ses prix et tente de s’adapter

Tags:

OpenAI

2023-11-07 A propos

ChatPDF - Chat with any PDF!

Tags:

2023-05-18 A propos

Hyung Won Chung sur Twitter : "RLHF as an instance of using a learned objective function"

Tags:

2023-05-18 A propos

Google "We Have No Moat, And Neither Does OpenAI"

Tags:

> low-cost public involvement was enabled
by a vastly cheaper mechanism for fine tuning called low
rank adaptation ()[LoRA](tag:lora)

> **Part of what makes LoRA so effective is that ... it’s stackable.**
>
> By contrast, training giant models from scratch not only
throws away the pretraining, but also any iterative
improvements that have been made on top.

> LoRA updates are very cheap to produce (~$100) for the
most popular model sizes.

> Many of these projects are saving time by training on
small, highly curated datasets...
> These
datasets are built using synthetic methods (e.g. filtering
the best responses from an existing model) and
scavenging from other projects

> Directly Competing With Open Source
Is a Losing Proposition

> Paradoxically, the one clear winner in all of this is Meta.
Because the leaked model was theirs ([LLaMA](tag:llama)), they have
effectively garnered an entire planet's worth of free labor.
Since most open source innovation is happening on top of
their architecture, there is nothing stopping them from
directly incorporating it into their products.

2023-05-04 A propos

openai/evals: Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Tags:

2023-05-04 A propos

Notebook by OpenAI which demos a Q&A workflow using ChatGPT API· openai/openai-cookbook

Tags: