Semanlink - Emergence

Parents:

Emergence

Related Tags:

Descendants

Emergent behaviours (AI)

4 Documents (Long List)

Physics of AI - YouTube

Tags:

- Intelligence has emerged: why? how?
- Let's study this with *controlled experiments* and *toy models*
- Clean and clear insights that peer slightly behind the magic curtain

emergence; rise of scale. Phase transition; fct(compute time for training: nb of params, dataset size)

(12:25) Transformers: the jump when compared to traditional NN: instead on oparating on single input X, operates on a set of inputs. (cf. training to say whether an image contains 2 elements of the same kind). **The aptitude to compare elements in the input sequence enables analogies** - the essence of reasoning.(Classical NN treat one high dimensional vector, tranformers hanlde sets of vectors. Attention layer replaces learned filters W of classical NN by the other elements in the sequence. Attention module compares part of input against other part of input. "Relative machines rather than absolute". Sets are a very powerful level of abstraction)

emergence
> The truth is that nobody has a clue what is going on"
>
> "Something unknown is doing we don't know what" (A. Eddington)

being inspired by physics' methodology: controled experiments and toy mathematical models

2023-03-28 About

Andrew Lampinen sur Twitter : "What is emergence, and why is it of recent interest in AI... A thread: 1/" / Twitter

Tags:

2023-02-26 About

From Random Grammars to Learning Language - Département de Physique de l'Ecole Normale supérieure

Tags:

2020-09-17 About

Le langage, une émergence explosive

Tags:

2020-09-17 About

Properties

sl:creationDate : 2020-09-17
sl:creationTime : 2020-09-17T23:49:53Z
rdf:type : sl:Tag
skos:prefLabel : Emergence