Pointwise mutual information ; NLP: pretraining AND Transformers
Common descendants
1 Document
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 About