LightGBM: A Highly Efficient Gradient Boosting Decision Tree

Guolin Ke, Qi Meng, Thomas Finley, +5

HAL (Le Centre pour la Communication Scientifique Directe)

Artificial IntelligenceEngineeringMachine LearningSmall GradientsMachine Learning Tool +17

R-Drop: Regularized Dropout for Neural Networks

Xiaobo Liang, Lijun Wu, Juntao Li, +6

arXiv (Cornell University)

Natural Language ProcessingDeep Neural NetworksEngineeringMachine LearningSparse Neural Network +10

Asynchronous Stochastic Gradient Descent with Delay Compensation

Shuxin Zheng, Qi Meng, Taifeng Wang, +4

arXiv (Cornell University)

Delay CompensationTime Delay SystemEngineeringMachine LearningStochastic Optimization +12

A Highly Efficient Gradient Boosting Decision Tree

Guolin Ke, Qi Meng, Taifeng Wang, +3

Neural Information Processing Systems

Artificial IntelligenceEngineeringMachine LearningSmall GradientsFeature Selection +17

Convergence analysis of distributed stochastic gradient descent with shuffling

Qi Meng, Wei Chen, Yue Wang, +2

Neurocomputing

EngineeringMachine LearningStochastic OptimizationStochastic Gradient DescentParallel Learning +2

A Communication-Efficient Parallel Algorithm for Decision Tree

Qi Meng, Guolin Ke, Taifeng Wang, +4

arXiv (Cornell University)

Cluster ComputingEngineeringMachine LearningComputational ComplexityParallel Algorithms +18

Asynchronous Stochastic Gradient Descent with Delay Compensation for Distributed Deep Learning.

Shuxin Zheng, Qi Meng, Taifeng Wang, +4

arXiv (Cornell University)

EngineeringMachine LearningDistributed AlgorithmsSequential SgdSparse Neural Network +14

Reinforcement Learning with Dynamic Boltzmann Softmax Updates

Ling Pan, Qingpeng Cai, Qi Meng, +2

Artificial IntelligenceSoftmax OperatorEngineeringMachine LearningData Science +8

UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost

Zhen Wu, Lijun Wu, Qi Meng, +5

EngineeringZhen WuLanguage ProcessingText MiningNatural Language Processing +14

Convergence Analysis of Distributed Stochastic Gradient Descent with Shuffling

Qi Meng, Wei Chen, Yue Wang, +2

arXiv (Cornell University)

EngineeringMachine LearningData ScienceStochastic OptimizationFederated Learning +12