Concepedia

Songyang Gao

SG

Statistics

Publications

5

Citations

97

H-Index

5

Active since

2022

Affiliations

Fudan University(Current)

Songyang Gao is an author at Fudan University specializing in computer science, large language models, and computing.

Publications per year

2022–2024

5

Publications

5

LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin

Shihan Dou, Enyu Zhou, Yan Liu et al. · 2024 · 44 citations · Full text

, , +7

Secrets of RLHF in Large Language Models Part I: PPO

Rui Zheng, Shihan Dou, Songyang Gao et al. · arXiv (Cornell University) · 2023 · 19 citations · Full text

, , +16

Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement

Zhiheng Xi, Senjie Jin, Yuhao Zhou et al. · 2023 · 14 citations · Full text

, , +15

Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model

Xiao Wang, Weikang Zhou, Qi Zhang et al. · 2023 · 10 citations · Full text

, , +9

Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding

Songyang Gao, Shihan Dou, Qi Zhang et al. · 2022 · 10 citations · Full text

, , +16

1–5 of 5