Parents :
 Wikipedia Sanjeev Arora
Amis :
ExpandDescendants
26 Documents (Liste longue) 
[2307.15936] A Theory for Emergence of Complex Skills in Language Models
Tags:
2024-02-24 A propos
Sanjeev Arora sur X : "It's better to use just 5% of the instruction-tuning data (suitably selected) instead of the full dataset."
Tags:
2024-02-15 A propos
New Theory Suggests Chatbots Can Understand Text | Quanta Magazine
Tags:
2024-02-11 A propos
[2302.06600] Task-Specific Skill Localization in Fine-tuned Language Models
Tags:
2023-08-25 A propos
Sanjeev Arora sur Twitter : "new `skills' induced by LLM fine-tuning can be localized in tiny fraction of the model."
Tags:
2023-07-07 A propos
Sanjeev Arora sur Twitter : "Fine-tuning language models using just forward pass!...r
Tags:
2023-06-09 A propos
ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation
Tags:
2023-05-04 A propos
Sanjeev Arora sur Twitter : "A priori, fine-tuning a huge LM on a few datapoints could lead to catastrophic overfitting. So why doesn’t it? Our theory + experiments..."
Tags:
2022-10-14 A propos
[2202.14037] Understanding Contrastive Learning Requires Incorporating Inductive Biases
Tags:
2022-03-05 A propos
How to allow deep learning on your data without revealing the data – Off the convex path
Tags:
2020-11-12 A propos
[1902.09229] A Theoretical Analysis of Contrastive Unsupervised Representation Learning
Tags:
2019-03-20 A propos
Contrastive Unsupervised Learning of Semantic Representations: A Theoretical Framework – Off the convex path (2019-03)
Tags:
2019-03-20 A propos
Word Embeddings: Explaining their properties – Off the convex path (2016)
Tags:
2019-03-20 A propos
Linear algebraic structure of word meanings – Off the convex path
Tags:
2018-09-20 A propos
Simple and efficient semantic embeddings for rare words, n-grams, and language features – Off the convex path
Tags:
2018-09-18 A propos
Off the convex path
Tags:
2018-09-09 A propos
A Latent Variable Model Approach to PMI-based Word Embeddings (2016)
Tags:
2018-08-28 A propos
[1601.03764] Linear Algebraic Structure of Word Senses, with Applications to Polysemy
Tags:
2018-08-28 A propos
Mathematics of Machine Learning: An introduction
Tags:
2018-08-08 A propos
Mathematics of Machine Learning and Deep Learning - Plenary talk at International Congress of Mathematicians 2018
Tags:
2018-08-08 A propos
Deep-learning-free Text and Sentence Embedding, Part 2 – Off the convex path
Tags:
2018-06-25 A propos
Deep-learning-free Text and Sentence Embedding, Part 1 – Off the convex path
Tags:
2018-06-25 A propos
Sanjeev Arora on "A theoretical approach to semantic representations" - YouTube (2016)
Tags:
2018-06-10 A propos
A Theoretical Approach to Semantic Coding and Hashing | Simons Institute for the Theory of Computing (2016)
Tags:
2018-05-26 A propos
A Simple but Tough-to-Beat Baseline for Sentence Embeddings (2017)
Tags:
2018-05-10 A propos
Semantic Word Embeddings – Off the convex path
Tags:
2017-11-21 A propos
Propriétés