Bertology ; Attention mechanism AND Technical girls and guys
Common descendants
5 Documents
Unveiling Transformers with LEGO - YouTube
Tags:
2022-06-30 About
Chris Olah sur Twitter : "I'm excited to *finally* be making progress on understanding the first MLP layer in large transformer LMs. I've tried really hard and prior to SoLU had little success." / Twitter
Tags:
2022-06-27 About
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 About
NLP's Clever Hans Moment has Arrived
Tags:
2020-01-10 About
[1906.04341] What Does BERT Look At? An Analysis of BERT's Attention
Tags:
2019-06-21 About