Parents:
LM: tokenization
Related Tags:
 
ExpandDescendants
3 Documents (Long List) 
Jo Kristian Bergum sur X : "...helping people understand the shortcomings of text embedding models for their data. The most powerful has been demonstrating how the embedding models' tokenizers work."
Tags:
2024-03-16 About
[2305.07185] MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
Tags:
2023-07-01 About
Andrej Karpathy sur Twitter : "Promising. Everyone should hope that we can throw away tokenization in LLMs..."
Tags:
2023-07-01 About
Properties