Concepedia

A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT

Ce Zhou, Qian Li, Chen Li, Jun Yu, Yixin Liu, Guangjing Wang, Kai Zhang, Cheng Ji, Qiben Yan, Lifang He,

International Journal of Machine Learning and Cybernetics · 2024 · 373 citations · 213 references

DOI

Concepts

References

213

Deep Residual Learning for Image Recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text

, , +11

Long Short-Term Memory

Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations

, , +16

ImageNet: A large-scale hierarchical image database

Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations

, , +12

Going deeper with convolutions

Christian Szegedy, Wei Liu, Yangqing Jia et al. · 2015 · 46.8K citations

, , +15

Densely Connected Convolutional Networks

Gao Huang, Zhuang Liu, Laurens van der Maaten et al. · 2017 · 44.7K citations

, , +10