Generalization AND Transformers
Common descendants
2 Documents
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 About
[1911.00172] Generalization through Memorization: Nearest Neighbor Language Models
Tags:
2019-12-20 About