Adaptive IoU Thresholding for Improving Small Object Detection: A Proof-of-Concept Study of Hand Erosions Classification of Patients with Rheumatic Arthritis on X-ray Images

Abstract

In recent years, much research evaluating the radiographic destruction of finger joints in patients with rheumatoid arthritis (RA) using deep learning models was conducted. Unfortunately, most previous models were not clinically applicable due to the small object regions as well as the close spatial relationship. In recent years, a new network structure called RetinaNets, in combination with the focal loss function, proved reliable for detecting even small objects. Therefore, the study aimed to increase the recognition performance to a clinically valuable level by proposing an innovative approach with adaptive changes in intersection over union (<i>IoU</i>) values during training of Retina Networks using the focal loss error function. To this end, the erosion score was determined using the Sharp van der Heijde (<i>SvH</i>) metric on 300 conventional radiographs from 119 patients with RA. Subsequently, a standard RetinaNet with different <i>IoU</i> values as well as adaptively modified <i>IoU</i> values were trained and compared in terms of accuracy, mean average accuracy (<i>mAP</i>), and <i>IoU</i>. With the proposed approach of adaptive <i>IoU</i> values during training, erosion detection accuracy could be improved to 94% and an <i>mAP</i> of 0.81 ± 0.18. In contrast Retina networks with static <i>IoU</i> values achieved only an accuracy of 80% and an <i>mAP</i> of 0.43 ± 0.24. Thus, adaptive adjustment of <i>IoU</i> values during training is a simple and effective method to increase the recognition accuracy of small objects such as finger and wrist joints.