HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy

TLDR

Artificial intelligence is a hot topic in medicine, yet medical data are sparse and hard to obtain because of legal restrictions and a shortage of personnel, making it difficult to develop automatic analysis systems. This article introduces HyperKvasir, the largest gastrointestinal image and video dataset currently available. The dataset comprises 110,079 images and 374 videos collected during real gastro‑ and colonoscopies at Bærum Hospital, Norway, labeled by expert endoscopists, and includes roughly one million image and video frames depicting anatomical landmarks, normal and pathological findings. Initial experiments show that AI‑based computer‑assisted diagnosis systems can benefit from HyperKvasir, which can help develop better algorithms for gastro‑, colonoscopy, and other medical fields.

Abstract

Abstract Artificial intelligence is currently a hot topic in medicine. However, medical data is often sparse and hard to obtain due to legal restrictions and lack of medical personnel for the cumbersome and tedious process to manually label training data. These constraints make it difficult to develop systems for automatic analysis, like detecting disease or other lesions. In this respect, this article presents HyperKvasir , the largest image and video dataset of the gastrointestinal tract available today. The data is collected during real gastro- and colonoscopy examinations at Bærum Hospital in Norway and partly labeled by experienced gastrointestinal endoscopists. The dataset contains 110,079 images and 374 videos, and represents anatomical landmarks as well as pathological and normal findings. The total number of images and video frames together is around 1 million. Initial experiments demonstrate the potential benefits of artificial intelligence-based computer-assisted diagnosis systems. The HyperKvasir dataset can play a valuable role in developing better algorithms and computer-assisted examination systems not only for gastro- and colonoscopy, but also for other fields in medicine.