@prefix rdf: . @prefix sl: . @prefix skos: . @prefix rdfs: . @prefix tag: . @prefix foaf: . @prefix dc: . tag:virtual_knowledge_graph a sl:Tag ; skos:prefLabel "Virtual knowledge graph" . tag:multi_hop_reasonning a sl:Tag ; skos:prefLabel "Multi-hop reasonning" . tag:ruslan_salakhutdinov a sl:Tag ; skos:prefLabel "Ruslan Salakhutdinov" . tag:neural_memory a sl:Tag ; skos:prefLabel "Neural Memory" . tag:end_to_end_learning a sl:Tag ; skos:prefLabel "End-to-End Learning" . tag:knowledge_base a sl:Tag ; skos:prefLabel "Knowledge bases" . dc:title "[2002.10640] Differentiable Reasoning over a Virtual Knowledge Base" ; sl:comment "> We consider the task of answering complex multi-hop questions **using a corpus as a virtual knowledge base** (KB). In particular, we describe a neural module, DrKIT, that traverses textual data like a KB, softly following paths of relations between mentions of entities in the corpus. At each step the module uses a combination of sparse-matrix TFIDF indices and a maximum inner product search (MIPS) on a **special index of contextual representations of the mentions**. This module is **differentiable**, so the full system can be trained end-to-end using gradient based methods, starting from natural language inputs. We also describe a pretraining scheme for the contextual representation encoder by generating hard negative examples using existing knowledge bases.\r\n\r\n[(Bhuwan Dhingra PhD Thesis)](doc:2020/07/end_to_end_learning_with_text_)" ; sl:creationDate "2020-07-11" ; sl:tag tag:multi_hop_reasonning , tag:ruslan_salakhutdinov , tag:arxiv_doc , tag:neural_memory , tag:virtual_knowledge_graph , tag:knowledge_base , tag:differentiable_reasoning_over_text , tag:end_to_end_learning . tag:question_answering a sl:Tag ; skos:prefLabel "Question Answering" . tag:differentiable_reasoning_over_text a sl:Tag ; rdfs:isDefinedBy ; skos:prefLabel "Differentiable Reasoning over Text" ; foaf:page tag:differentiable_reasoning_over_text.html . dc:title "Differentiable Reasoning over Text – Machine Learning Blog | ML@CMU | Carnegie Mellon University" ; sl:creationDate "2020-05-16" ; sl:tag tag:question_answering , tag:differentiable_reasoning_over_text . tag:arxiv_doc a sl:Tag ; skos:prefLabel "Arxiv Doc" .