2023 · 11 citations · 23 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingKnowledge RetrievalLanguage LearningLanguage ModelingLanguage ModelsQuestion AnsweringRetrieval ModelsKnowledge DistillationLanguage Model PretrainingLanguage Model RetrievalLanguage Modeling Approach To RetrievalLanguage Modeling For Information RetrievalLanguage Modeling For RetrievalRetrieval-augmented Language ModelsSemantic Retrieval
Jianyi Zhang, Aashiq Muhamed, Aditya Anantharaman, Guoyin Wang, Changyou Chen, Kai Zhong, Qingjun Cui, Yi Xu, Belinda Zeng, Trishul Chilimbi, Yiran Chen. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2023.
23
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 14K citations · Full text