Semanlink - Guillaume Lample

RDF

Impression

Recherche de Mot-clé

Recherche de Doc

Préférences...

Mots-clés liés

Arxiv Doc - Connectionist vs symbolic debate - Cross-lingual NLP - Deep Learning - Facebook FAIR - Foundation Models - Language Model - LLM - Ludovic Denoyer - Machine translation - Mathématiques - Named Entity Recognition - NLP@Facebook - NLP@Meta - Paris NLP meetup - Publicly available datasets - Slides - Tweet - Word embeddings -

Parents :

NLP girls and guys

Guillaume Lample

Amis :

Descendants

11 Documents (Liste longue)

Guillaume Lample sur X : "Mistral 7B is out. It outperforms Llama 2 13B on every benchmark we tried..."

Tags:

2023-09-28 A propos

Guillaume Lample sur Twitter : "Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters..."

Tags:

2023-02-25 A propos

Guillaume Lample sur Twitter : "Last year, we showed that you can outperform a 24-layer transformer in language modeling with just...

Tags:

2020-10-10 A propos

[1912.01412] Deep Learning for Symbolic Mathematics

Tags:

2019-12-09 A propos

Product-Key Memory (PKM) Minimalist implementation of a Product-Key Memory layer

Tags:

2019-08-30 A propos

[1907.05242] Large Memory Layers with Product Keys

Tags:

> **a structured memory which can be easily integrated into a neural network.** The memory is very large by design and therefore significantly increases the capacity of the architecture, by up to a billion parameters with a negligible computational overhead. Its design and access pattern is based on **product keys**, which enable fast and exact nearest neighbor search. The ability to increase the number of parameters while keeping the same computational budget lets the overall system strike a better trade-off between prediction accuracy and computation efficiency both at training and test time.

> a key-value memory layer that can increase model capacity for a negligible computational cost. A 12-layer transformer with a memory outperforms a 24-layer transformer, and is 2x faster!

[Implementation](/doc/2019/08/product_key_memory_pkm_minima)

TODO: compare with [[2007.00849] Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledge](doc:2020/07/2007_00849_facts_as_experts_)

2019-07-13 A propos

Unsupervised Machine Translation. G. Lample (slides)

Tags:

2018-09-29 A propos

Paris NLP Season 3 Meetup #1 | Meetup

Tags:

2018-09-27 A propos

[1603.01360] Neural Architectures for Named Entity Recognition

Tags:

2018-03-05 A propos

facebookresearch/MUSE: A library for Multilingual Unsupervised or Supervised word Embeddings

Tags:

2017-12-22 A propos

[1710.04087] Word Translation Without Parallel Data

Tags:

2017-10-14 A propos

Propriétés

sl:creationDate : 2018-09-27
sl:creationTime : 2018-09-27T11:29:39Z
rdf:type : sl:Tag
skos:prefLabel : Guillaume Lample