Au sujet de ce document
- sl:arxiv_author :
- sl:arxiv_firstAuthor : Pat Verga
- sl:arxiv_num : 2007.00849
- sl:arxiv_published : 2020-07-02T03:05:41Z
- sl:arxiv_summary : Massive language models are the core of modern NLP modeling and have been
shown to encode impressive amounts of commonsense and factual information.
However, that knowledge exists only within the latent parameters of the model,
inaccessible to inspection and interpretation, and even worse, factual
information memorized from the training corpora is likely to become stale as
the world changes. Knowledge stored as parameters will also inevitably exhibit
all of the biases inherent in the source materials. To address these problems,
we develop a neural language model that includes an explicit interface between
symbolically interpretable factual information and subsymbolic neural
knowledge. We show that this model dramatically improves performance on two
knowledge-intensive question-answering tasks. More interestingly, the model can
be updated without re-training by manipulating its symbolic representations. In
particular this model allows us to add new facts and overwrite existing ones in
ways that are not possible for earlier models.@en
- sl:arxiv_title : Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledge@en
- sl:arxiv_updated : 2020-07-02T03:05:41Z
- sl:bookmarkOf : https://arxiv.org/abs/2007.00849
- sl:creationDate : 2020-07-09
- sl:creationTime : 2020-07-09T23:54:59Z
- sl:relatedDoc :
Documents with similar tags (experimental)
Préférences...