FTMF-Net: A Fourier Transform-Multiscale Feature Fusion Network for Segmentation of Small Polyp Objects

Abstract

The detection and resection of small polyp objects in colonoscopy images is of great significance for the prevention of colorectal cancer. At present, blurred edges, variable lesion shapes, and intra-class dissimilarity pose challenges for accurately segmenting small polyp objects. In recent years, many deep learning methods based on convolutional neural networks (CNNs) have been proposed and successfully applied to polyp segmentation tasks. However, these methods still have two limitations: (1) Limited ability to mine boundary detail information, (2) Insufficient ability to capture rich global context information, and (3) Introduced additional complex feature extraction operations. To alleviate these challenges, we propose a Fourier transform-multiscale feature fusion network (FTMF-Net) for segmentation of small polyp objects. The core idea includes two points: (1) Fourier transform module extracts more detailed boundary information, and (2) Multiscale feature fusion module enriches global semantic feature information. FTMF-Net mainly has the following advantages: (1) The proposed model has excellent performance for small polyp object segmentation, (2) This method greatly reduces the complexity of the model without significantly increasing the number of network parameters, and (3) The network is relatively simple and easy to understand. Extensive experiments with eleven state-of-the-art (SOTA) methods on five small polyp object datasets show that our proposed FTMF-Net has superior segmentation performance.