2023 · 20 citations · 14 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDialogue SystemsLanguage ModelingCold-start ProblemData AugmentationDomain AdaptationFine-tuningIntent ClassificationLanguage Model Fine-tuningLarge Language ModelsZero-shot Classification
Conversational NLU providers often need to scale to thousands of intent-classification models where new customers often face the cold-start problem. Scaling to so many customers puts a constraint on storage space as well. In this paper, we explore four different zero and few-shot intent classification approaches with this low-resource constraint: 1) domain adaptation, 2) data augmentation, 3) zero-shot intent classification using descriptions large language models (LLMs), and 4) parameter-efficient fine-tuning of instruction-finetuned language models. Our results show that all these approaches are effective to different degrees in low-resource settings. Parameter-efficient fine-tuning using T-few recipe on Flan-T5 yields the best performance even with just one sample per intent. We also show that the zero-shot method of prompting LLMs using intent descriptions is also very competitive.
14
Scaling Instruction-Finetuned Language Models
Hyung Won Chung, Le Hou, Shayne Longpre et al. · arXiv (Cornell University) · 2022 · 1.2K citations · Full text