Neural Bag of Words
http://www.semanlink.net/tag/neural_bag_of_words
Documents tagged with Neural Bag of WordsDeep Unordered Composition Rivals Syntactic Methods for Text Classification (2015)
http://www.cs.cornell.edu/courses/cs5740/2016sp/resources/dans.pdf
> Many existing deep learning models for natural language processing tasks focus on learning the compositionality of their inputs, which requires many expensive computations. We present a simple deep neural network that competes with and, in some cases, outperforms such models on sentiment analysis and factoid question answering tasks while taking only a fraction of the training time. While our model is syntactically-ignorant, we show significant improvements over previous bag-of-words models by deepening our network and applying a novel variant of dropout
2018-05-29T16:52:50Z[1803.11175] Universal Sentence Encoder
https://arxiv.org/abs/1803.11175
models for encoding sentences into embedding vectors that specifically target transfer learning to other NLP tasks.
> With transfer learning via sentence embeddings, we observe surprisingly good performance with minimal amounts of supervised training data for a transfer task
mixes an unsupervised task using a large corpus together with the supervised SNLI task, leveraging the [#Transformer](/tag/attention_is_all_you_need) architecture
2018-05-29T16:50:18Z