Favoris ; Education AND Tweet
Common descendants
23 Documents
Omar Khattab sur X : "ColBERT in 81 languages by generalizing from English training! ..."
Tags:
2024-02-28 About
Omar Khattab sur X : "A thread on late interaction, how it works efficiently, and why/where it's been shown to improve quality"
Tags:
2024-02-05 About
Craig Macdonald sur X : "a thread of our main ColBERT research findings"
Tags:
2024-02-01 About
Jo Kristian Bergum sur X : (on "why using ColBERT?")
Tags:
2024-01-28 About
Omar Khattab sur X : "A🧵on beating the hardware lottery for retrieval: the internals of the late interaction stack. ColBERT..."
Tags:
2023-12-29 About
Zain Hasan sur X : "why do large language models pay more attention to and reason better over the beginning and end of what you tell them in prompts?"
Tags:
2023-11-19 About
Omar Khattab sur X : "This isn't the main point of this great new paper by @sophiaalthammer et al. But it's incredible how ColBERT at 1000 training queries is better than DPR trained at *50,000* queries!"
Tags:
2023-09-14 About
Sanjeev Arora sur Twitter : "new `skills' induced by LLM fine-tuning can be localized in tiny fraction of the model."
Tags:
2023-07-07 About
Sanjeev Arora sur Twitter : "Fine-tuning language models using just forward pass!...r
Tags:
2023-06-09 About
Archit Sharma sur Twitter : "Direct Preference Optimization (DPO) allows you to fine-tune LMs directly from preferences via a simple classification loss, no RL required"
Tags:
2023-05-31 About
Eric sur Twitter : "...Introducing Direct Preference Optimization (DPO), a simple classification loss provably equivalent to RLHF"
Tags:
2023-05-31 About
Andrej Karpathy sur Twitter : "Excellent TED talk from Sal Khan: - many inspiring examples of GPTs finetuned into socratic tutors, assisting without giving away answers...
Tags:
2023-05-02 About
Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."
Tags:
2023-04-05 About
Omar Khattab sur Twitter : "New features in 𝗖𝗼𝗹𝗕𝗘𝗥𝗧 ‣ Index Updater. Simple API to add/remove documents..."
Tags:
2023-01-30 About
shikhar sur Twitter : "Instead of asking whether tree structure should be baked into NNs, our new paper asks if transformers already have a tendency to learn tree structured computations when trained on language, and if this structure is predictive of generalization! "
Tags:
2022-12-09 About
Stanford NLP Group sur Twitter : "YONO: You Only Need One Model for Open-domain Question Answering..."
Tags:
2022-12-05 About
Sanjeev Arora sur Twitter : "A priori, fine-tuning a huge LM on a few datapoints could lead to catastrophic overfitting. So why doesn’t it? Our theory + experiments..."
Tags:
2022-10-14 About
I.A.B sur Twitter : "When we "know the meaning" of a word, what is it that we know? For example, what does knowing the words "dolphin" and "tiger" entail?..."
Tags:
2022-04-15 About
Stanford NLP Group sur Twitter : "...how to use AI systems to augment the work of humans in interactive systems "
Tags:
2022-03-05 About
AK sur Twitter : "You Only Need One Model for Open-domain Question Answering..."
Tags:
2021-12-23 About
Seth Stafford sur Twitter : "Here’s a nice paper (ICLR spotlight) on how to apply masking in LM training..."
Tags:
2021-10-16 About
Pablo Castro sur Twitter : "Random finding of the day for word embeddings: vec("apple")-vec("apples") yields a vector close to ipad, ipod, etc. (apples removes the "fruitness" from apple)
Tags:
2020-12-18 About
Jeremy Howard sur Twitter : "The fastai paper (with @GuggerSylvain) covers v2..."
Tags:
2020-02-13 About