Semanlink - 2D-NLP AND Text and structured data (ML-NLP)

2D-NLP AND Text and structured data (ML-NLP)

Common descendants

1 Document

Google AI Blog: Extracting Structured Data from Templatic Documents (2020)

Tags:

[About this paper](doc:2020/06/representation_learning_for_inf)

Templatic documents (eg. invoices): such documents do not contain “natural
language” but
instead resemble forms, with data often presented in tables

> an approach that **uses knowledge of target field types to identify
candidate fields**. These are then scored using **a neural network that
learns a dense representation of each candidate using the words in its
neighborhood**. Experiments on two corpora (invoices and receipts) show
that we’re able to generalize well to unseen layouts.
>
> An understanding of the **two-dimensional layout of text**
on the page is key to understanding such documents. On the other hand,
treating this purely as an image segmentation problem makes it difficult
to take advantage of the semantics of the text.
>
> Our approach to this problem allows developers to train and deploy an
extraction system for a given domain (like invoices) using **two inputs — a
target schema (i.e., a list of fields to extract and their corresponding
types) and a small collection of documents labeled with the ground truth
for use as a training set**

- The input document is first run through an [OCR service](doc:2020/06/detecter_le_texte_dans_les_fich).
- a candidate generator identifies spans of text in the OCR output that might correspond to
an instance of a given field (uses pre-existing
libraries associated with each field type)
- Each candidate is then scored using a neural
network (that is trained as a binary classifier)

2020-06-15 About