Semanlink - Favoris ; Neural networks AND Cross-lingual NLP

Printer friendly

Search Tag:

Search Doc:

Preferences...

Favoris ; Neural networks AND Cross-lingual NLP

Common descendants

Neural machine translation

41 Documents

[2305.11778] Cross-Lingual Supervision improves Large Language Models Pre-training

Tags:

2023-05-22 About

Text Translation cognitive skill - Azure Cognitive Search | Microsoft Learn

Tags:

2023-05-09 About

Inria Paris NLP (ALMAnaCH team) sur Twitter : “Writing in two languages: Neural machine translation as an assistive bilingual writing tool”

Tags:

2023-03-13 About

[2302.04907] Binarized Neural Machine Translation

Tags:

2023-02-13 About

[2302.01398] The unreasonable effectiveness of few-shot learning for machine translation

Tags:

2023-02-07 About

Multilingual Sentence Transformers | Pinecone

Tags:

2023-01-13 About

joeynmt/joeynmt: Minimalist NMT for educational purposes

Tags:

Neural machine translation

2023-01-05 About

Colin Leong sur Twitter : "This book is about the only "dataset" I ever found for Hani. My first ever foray into the field, I found an electronic copy and munged it into a Hani/English parallel corpus, and trained a JoeyNMT model with the help of @MasakhaneNLP and @KreutzerJulia in particular." / Twitter

Tags:

2023-01-05 About

Meta AI sur Twitter : "Universal Speech Translator (UST) is the 1st AI-powered speech-to-speech translation system for a primarily oral language..."

Tags:

2022-10-19 About

UKPLab/EasyNMT: Easy to use, state-of-the-art Neural Machine Translation for 100+ languages

Tags:

2022-10-14 About

How to Train an mT5 Model for Translation With Simple Transformers | by Thilina Rajapakse | Towards Data Science

Tags:

2022-09-25 About

Continuous Learning in NMT using Bilingual Dictionaries

Tags:

2022-09-17 About

Ikuya Yamada sur Twitter : "Is entity representation effective to improve multilingual language models?..."

Tags:

2022-04-13 About

Multilingual Sentence Transformers | Pinecone

Tags:

2021-11-04 About

VaLaR NMT: Vastly Lacking Resources Neural Machine Translation (2019)

Tags:

2021-10-14 About

NMT Training through the Lens of SMT

Tags:

2021-09-07 About

Joey NMT’s documentation!

Tags:

Neural machine translation

2021-08-26 About

[1906.05685] A Focus on Neural Machine Translation for African Languages

Tags:

2021-06-30 About

Nils Reimers sur Twitter : EasyNMT Easy-to-use (3 lines of code), state-of-the-art neural machine translations

Tags:

2021-04-27 About

GitHub - OpenNMT/OpenNMT-py: Open Source Neural Machine Translation in PyTorch

Tags:

2020-01-17 About

[1911.01464] Emerging Cross-lingual Structure in Pretrained Language Models

Tags:

2019-11-06 About

Efficient multi-lingual language model fine-tuning · fast.ai NLP

Tags:

2019-10-22 About

Jade Abbott sur Twitter : "Calling all African NLPers! Goal: Let's publish a paper with NMT baselines for all African languages Slides

Tags:

2019-09-02 About

[1812.04616] Von Mises-Fisher Loss for Training Sequence to Sequence Models with Continuous Outputs

Tags:

2018-12-14 About

Monolingual data in NMT

Tags:

2018-12-04 About

Paris NLP Season 3 Meetup #2 – Paris NLP

Tags:

2018-12-04 About

Using Monolingual Data in Neural Machine Translation: a Systematic Study

Tags:

2018-11-28 About

Encoder-Decoder Recurrent Neural Network Models for Neural Machine Translation

Tags:

2018-11-07 About

[1810.04805] BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Tags:

2018-10-12 About

Found in translation: Building a language translator from scratch with deep learning - FloydHub

Tags:

Neural machine translation

2018-10-11 About

The Illustrated Transformer – Jay Alammar

Tags:

2018-07-09 About

Under the hood: Multilingual embeddings | Engineering Blog | Facebook Code

Tags:

2018-05-11 About

GitHub - Babylonpartners/fastText_multilingual: Multilingual word vectors

Tags:

2018-05-11 About

facebookresearch/MUSE: A library for Multilingual Unsupervised or Supervised word Embeddings

Tags:

2017-12-22 About

Monolingual and Cross-Lingual Information Retrieval Models Based on (Bilingual) Word Embeddings (2015)

Tags:

2017-11-12 About

[1710.04087] Word Translation Without Parallel Data

Tags:

2017-10-14 About

TensorFlow Neural Machine Translation (seq2seq) Tutorial

Tags:

2017-09-18 About

Research Blog: Transformer: A Novel Neural Network Architecture for Language Understanding

Tags:

2017-09-01 About

DeepL

Tags:

2017-08-30 About

Attention and Memory in Deep Learning and NLP – WildML

Tags:

cf. visual attention

In standard [#seq2seq](/tag/sequence_to_sequence_learning) NMT, the decoder is supposed to generate a translation solely based on the last hidden state of the encoder - which therefore must capture everything from the source sentence (it must be a sentence embedding). Not good. Hence the attention mechanism.

> we allow the decoder to “attend” to different parts of the source sentence at each step of the output generation. Importantly, we let the model learn what to attend to based on the input sentence and what it has produced so far

> each decoder output word now depends on a weighted combination of all the input states, not just the last state.

Possible to interpret what the model is doing by looking at the Attention weight matrix

Cost: We need to calculate an attention value for each combination of input and output word (-> attention is a bit of a misnomer: we look at everything in details before deciding what to focus on)

> attention mechanism is simply giving the network access to its internal memory, which is the hidden state of the encoder

> Unlike typical memory, the memory access mechanism here is soft, which means that the network retrieves a weighted combination of all memory locations, not a value from a single discrete location

2016-01-03 About

Scientists See Advances in Deep Learning, a Part of Artificial Intelligence - NYTimes.com

Tags:

2012-11-30 About