arXiv (Cornell University) · 2021 · 12 citations · 16 references
AgricultureComputer ScienceNutritionComputer VisionFood AnalysisHuman NutritionFood CompositionNutritional AssessmentNutritional Label AnalysisDataset DescriptionsNutritional StateTraining
Understanding the nutritional content of food from visual data is a challenging computer vision problem, with the potential to have a positive and widespread impact on public health. Studies in this area are limited to existing datasets in the field that lack sufficient diversity or labels required for training models with nutritional understanding capability. We introduce Nutrition5k, a novel dataset of 5k diverse, real world food dishes with corresponding video streams, depth images, component weights, and high accuracy nutritional content annotation. We demonstrate the potential of this dataset by training a computer vision algorithm capable of predicting the caloric and macronutrient values of a complex, real world dish at an accuracy that outperforms professional nutritionists. Further we present a baseline for incorporating depth sensor data to improve nutrition predictions. We will publicly release Nutrition5k in the hope that it will accelerate innovation in the space of nutritional understanding.
16
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe et al. · 2016 · 30.9K citations
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Chen Sun, Abhinav Shrivastava, Saurabh Singh et al. · 2017 · 2.3K citations
Im2Calories: Towards an Automated Mobile Vision Food Diary
Austin Myers, Nick Johnston, Vivek Rathod et al. · 2015 · 497 citations
Learning Cross-Modal Embeddings for Cooking Recipes and Food Images
Amaia Salvador, Nicholas Hynes, Yusuf Aytar et al. · 2017 · 408 citations · Full text
Deep-based Ingredient Recognition for Cooking Recipe Retrieval
Jingjing Chen, Chong‐Wah Ngo · 2016 · 407 citations · Full text
Agriculture, Food Science, Nutrition +12