2023 · 11 citations · 26 references
ComputingComputer ScienceComputer VisionGastroenterologyMachine LearningDeep LearningFeature DetectionGastrointestinal EndoscopyImage Feature EngineeringImage FusionMedical Image AnalysisBleedingCapsule EndoscopyConvolutional Neural NetworksDeep Learning-based ClassificationFeature FusionImage Feature FusionMultilayer PerceptronVision Transformers
Vision Transformer (ViT) and its variants have gained significant prominence in computer vision due to their exceptional performance across various tasks. However, ViTs are data-hungry models that require vast amounts of data for training. Given the scarcity of medical data, this paper presents a fine-tuned vision transformer specifically designed for small-size datasets. We fine-tuned the original model using convolutional neural networks (CNNs) to extract both high and low-level features from wireless capsule endoscopy (WCE) images. In this work, we integrate a CNN module into the original ViT to extract features from WCE patches, which are then fused with the original ViT features. The classification is accomplished using a multilayer perceptron (MLP) to categorize images into normal and abnormal categories on the Kvasir Capsule Endoscopy dataset, as well as bleeding or non-bleeding categories on the Red Lesion Endoscopy dataset. The experimental findings substantiate the efficacy of the suggested approach, yielding favorable outcomes in comparison to other state-of-the-art methods.
26
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Densely Connected Convolutional Networks
Gao Huang, Zhuang Liu, Laurens van der Maaten et al. · 2017 · 44.7K citations
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe et al. · 2016 · 30.9K citations
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov et al. · arXiv (Cornell University) · 2020 · 21.6K citations · Full text
Rebecca L. Siegel, Kimberly D. Miller, Nikita Sandeep Wagle et al. · CA A Cancer Journal for Clinicians · 2023 · 16.7K citations · Full text