Semanlink - Evolution of Representations in the Transformer (2019)

Impression

Recherche de Mot-clé

Recherche de Doc

Préférences...

Evolution of Representations in the Transformer (2019)

Tags:

Au sujet de ce document

sl:bookmarkOf : https://lena-voita.github.io/posts/emnlp19_evolution.html
sl:creationDate : 2019-09-16
sl:creationTime : 2019-09-16T22:02:56Z
sl:relatedDoc : http://www.semanlink.net/doc/2019/09/_1909_01380_the_bottom_up_evol

Infos sur le fichier

Bookmark of: https://lena-voita.github.io/posts/emnlp19_evolution.html

Linked From

[1909.01380] The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives

Tags:

Arxiv Doc

2019-09-16 A propos

Documents with similar tags (experimental)

Unveiling Transformers with LEGO - YouTube

Tags:

2022-06-30 A propos

Anthropic sur Twitter : "a mathematical framework for trying to reverse engineer transformer language models..."

Tags:

2021-12-23 A propos

Information Bottleneck for NLP (parsing & summarization)

Tags:

2020-06-29 A propos

[1910.00163] Specializing Word Embeddings (for Parsing) by Information Bottleneck

Tags:

2020-06-29 A propos

BERT, ELMo, & GPT-2: How Contextual are Contextualized Word Representations? | SAIL Blog

Tags:

2020-03-28 A propos

[1908.01580] The HSIC Bottleneck: Deep Learning without Back-Propagation

Tags:

2019-08-15 A propos

[1503.02406] Deep Learning and the Information Bottleneck Principle

Tags:

2019-08-15 A propos