Object detection is an important application of optical satellite remote sensing imagery interpretation. Since the objects of interest, such as aircraft, ships, and vehicles, are small in size with obscure contour and texture, it is difficult for object detection in satellite images. The spatial resolution of aerial images is higher than satellite images, and the object detection model can achieve higher precision. Knowledge distillation has been validated as an effective technique by learning the common features of aerial and satellite images to improve the precision of object detection in satellite images. It means that a teacher model pre-trained on aerial image datasets guides the training of a compact student model on satellite image datasets. However, there are data distribution differences between aerial images and satellite images. The distribution differences may cause the teacher model to give guidance signals that deviate from the ground truth, thus leading to sub-optimization of the student model. In this paper, we proposed a new distillation scheme, termed DC-KD, which updates the teacher model using the predictions of the teacher model that are inconsistent with the ground truth, and the rest are used to guide the training of the student model. We achieved a 3.88% mAP50 improvement on the xView dataset based on the YOLOX-S model.
DC-KD: double-constraint knowledge distillation for optical satellite imagery object detection based on YOLOX model
Fourth International Conference on Machine Learning and Computer Application (ICMLCA 2023) ; 2023 ; Hangzhou, China
Proc. SPIE ; 13176 ; 131761V
2024-05-22
Conference paper
Electronic Resource
English
Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection
DataCite | 2024
|Residual YOLOX-based Ship Object Detection Method
IEEE | 2022
|YOLOX-based dynamic vehicle target detection
IEEE | 2022
|