IEEE Transactions on Big Data · 2024 · 31 citations · 45 references
ComputingAgricultural EngineeringFood ScienceComputational LinguisticsFood EngineeringNatural Language ProcessingAgricultural TechnologyLanguage ModelingLanguage ModelsNamed Entity RecognitionPart-of-speech TaggingWord EmbeddingsLarge Language ModelsLarge-scale Natural Language ProcessingNeural Language ModelsWord N-gramsWord Representation Learning
This paper explores new frontiers in agricultural natural language processing (NLP) by investigating the effectiveness of food-related text corpora for pretraining transformer-based language models. Specifically, we focus on semantic matching, establishing mappings between food descriptions and nutrition data through fine-tuning AgriBERT with the FoodOn ontology. Our work introduces an expanded comparison with state-of-the-art language models such as GPT-4, Mistral-large, Claude 3 Sonnet, and Gemini 1.0 Ultra. This exploratory investigation, rather than a direct comparison, aims to understand how AgriBERT, a domain-specific, fine-tuned, open-source model, complements the broad knowledge and generative abilities of these advanced LLMs in addressing the unique challenges of the agricultural sector. We also experiment with other applications, such as cuisine prediction from ingredients, expanding our research to include various NLP tasks beyond semantic matching. Overall, this paper underscores the potential of integrating domain-specific models like AgriBERT with advanced LLMs to enhance the performance and applicability of agricultural NLP applications.
45
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
George A. Miller · Communications of the ACM · 1995 · 14.1K citations · Full text