Semanlink - Microsoft AND AI girls and guys

Printer friendly

Search Tag:

Search Doc:

Preferences...

Microsoft AND AI girls and guys

Common descendants

19 Documents

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 About

Nils Reimers sur X : "The Azure team did a fantastic job bringing Cohere's latest LLMs on their platform..."

Tags:

2024-04-05 About

Answer.AI - You can now train a 70b language model at home

Tags:

2024-03-09 About

New Theory Suggests Chatbots Can Understand Text | Quanta Magazine

Tags:

2024-02-11 About

Sebastien Bubeck sur X : "How far does one billion parameters take you? ... Releasing phi-1.5, a 1.3B parameter LLM exhibiting emergent behaviors surprisingly close to much larger LLMs"

Tags:

2023-09-12 About

State of GPT (Andrej Karpathy at Microsoft Build)

Tags:

2023-05-24 About

Physics of AI - YouTube

Tags:

- Intelligence has emerged: why? how?
- Let's study this with *controlled experiments* and *toy models*
- Clean and clear insights that peer slightly behind the magic curtain

emergence; rise of scale. Phase transition: fct(compute time for training: nb of params, dataset size)

(12:25) Transformers: the jump when compared to traditional NN: instead on oparating on single input X, operates on a set of inputs. (cf. training to say whether an image contains 2 elements of the same kind). **The aptitude to compare elements in the input sequence enables analogies** - the essence of reasoning.(Classical NN treats one high dimensional vector, tranformers hanlde sets of vectors. Attention layer replaces learned filters W of classical NN by the other elements in the sequence. Attention module compares part of input against other part of input. "Relative machines rather than absolute". Sets are a very powerful level of abstraction)

emergence
> The truth is that nobody has a clue what is going on"
>
> "**Something unknown is doing we don't know what**" (A. Eddington)

being inspired by physics' methodology: controled experiments and toy mathematical models

2023-03-28 About

Talking to Models: Stanford U & Microsoft Method Enables Developers to Correct Model Bugs via Natural Language Patches | Synced

Tags:

2022-11-27 About

Unveiling Transformers with LEGO - YouTube

Tags:

2022-06-30 About

Lenka Zdeborova sur Twitter : "Amazing lecture of @SebastienBubeck giving intuition on transformers and how to approach them theoretically..."

Tags:

2022-06-30 About

The Extreme Classification Repository

Tags:

2020-08-12 About

Everything you always wanted to know about extreme classification (but were afraid to ask) - Microsoft Research - 2019

Tags:

2020-08-12 About

SLEEC: Sparse Local Embeddings for Extreme Multi-label Classification (2015)

Tags:

2020-08-11 About

Neural Models for Information Retrieval (2017)

Tags:

2019-08-18 About

[1602.01137] A Dual Embedding Space Model for Document Ranking

Tags:

2019-07-17 About

Extreme Multi-label Learning with Label Features for Warm-start Tagging, Ranking & Recommendation (2018)

Tags:

2018-03-04 About

Vectorland: Brief Notes from Using Text Embeddings for Search

Tags:

2017-09-18 About

Using Text Embeddings for Information Retrieval

Tags:

2017-09-18 About

Scientists See Advances in Deep Learning, a Part of Artificial Intelligence - NYTimes.com

Tags:

2012-11-30 About