Yuanzhi Li

LoRA: Low-Rank Adaptation of Large Language Models

J. Edward Hu, Yelong Shen, Phillip Wallis et al. · arXiv (Cornell University) · 2021 · 2.4K citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +19

A Convergence Theory for Deep Learning via Over-Parameterization

Zeyuan Allen-Zhu, Yuanzhi Li, Zhao Song · arXiv (Cornell University) · 2018 · 626 citations · Full text

Artificial Intelligence, Deep Neural Networks, Engineering +13

Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data

Yuanzhi Li, Yingyu Liang · arXiv (Cornell University) · 2018 · 318 citations · Full text

Artificial Intelligence, Structured Prediction, Engineering +18

A Latent Variable Model Approach to PMI-based Word Embeddings

Sanjeev Arora, Yuanzhi Li, Yingyu Liang et al. · Transactions of the Association for Computational Linguistics · 2016 · 288 citations · Full text

Engineering, Semantics, Pmi-based Word Embeddings +19

Convergence Analysis of Two-layer Neural Networks with ReLU Activation

Yuanzhi Li, Yuan Yang · arXiv (Cornell University) · 2017 · 273 citations · Full text

Model Optimization, Neural Scaling Law, Engineering +14