Chris Olah AND Attention mechanism
Common descendants
3 Documents
Chris Olah sur Twitter : "I'm excited to *finally* be making progress on understanding the first MLP layer in large transformer LMs. I've tried really hard and prior to SoLU had little success." / Twitter
Tags:
2022-06-27 About
Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."
Tags:
2021-12-23 About
Attention and Augmented Recurrent Neural Networks (2016)
Tags:
2018-05-31 About