Smart Refrigerator for Healthcare Using Food Image Classification

Abstract

In this paper, we propose a sensor-equipped food container, Smart Refrigerator, which discriminates foods and monitors their status. The system is composed of 1) sensor system for the detection of humidity, temperature, and the image information of food, 2) information server to perform machine learning-based classification of food images, and 3) user applications to monitor the refrigerator and to recommend appropriate meal pattern with recipes for healthy life. We demonstrated the performance in detection of food and suggested that automatic monitoring of food intake can provide intuitive feedback to users.