Semanlink - Lenka Zdeborova sur X : "Emergence in LLMs is a mystery. Emergence in physics is linked to phase transitions. We identify a phase transition between semantic and positional learning in a toy model of dot-product attention"

Printer friendly

Search Tag:

Search Doc:

Preferences...

Lenka Zdeborova sur X : "Emergence in LLMs is a mystery. Emergence in physics is linked to phase transitions. We identify a phase transition between semantic and positional learning in a toy model of dot-product attention"

Tags:

About This Document

sl:bookmarkOf : https://twitter.com/zdeborova/status/1755158457785704771?s=20
sl:creationDate : 2024-02-07
sl:creationTime : 2024-02-07T22:19:57Z

File info

Bookmark of: https://twitter.com/zdeborova/status/1755158457785704771?s=20

Documents with similar tags (experimental)

Cracking big data with statistical physics

Tags:

2018-10-18 About