Emergence in LLMs AND Phase transition
Common descendants
1 Document
Lenka Zdeborova sur X : "Emergence in LLMs is a mystery. Emergence in physics is linked to phase transitions. We identify a phase transition between semantic and positional learning in a toy model of dot-product attention"
Tags:
2024-02-07 About