Object-level change detection with a dual correlation attention-guided detector

Abstract

Abstract Automatic change detection from remotely sensed imagery is extremely important for many applications, including land use mapping. In recent years, a growing number of researchers have applied capable deep-learning methods to the research on change detection. The majority of deep learning-based change detection methods currently perform pixel-by-pixel classification at the original image scale, but they can hardly avoid the false changes caused by strong parallax effects and projected shadows, without considering the totality of changed objects/regions. In this study, we propose an object-level change detection framework to detect changed geographic entities (such as newly built buildings or changed artificial structures) by paying more attention to the overall characteristics and context association of changed object instances. The detected changed objects are represented as bounding boxes, which are simple, regular, and convenient to use in object feature extraction. In terms of data handling, a special data augmentation method for change detection called Alternative-Mosaic is proposed to effectively accelerate model training and improve model performance. For the model, we propose a one-stage change detection network called dual correlation attention-guided detector (DCA-Det) to detect the changed objects. In particular, we feed the dual-temporal images into a weight-shared backbone network to extract the change features of different scales. The change features on the same scale are further refined, and then the features between different scales are fused by the correlation attention-guided feature fusion neck. Finally, the change detection heads output the prediction results of the changed objects/regions of different scales. Experiments were conducted on public LEVIR building change detection and aerial imagery change detection (AICD) datasets. The quantitative evaluation and visualization results proved the superiority and robustness of our framework. Our DCA-Det can obtain state-of-the-art performance on object-level metrics (99.50% AP IoU = . 50 and 79.72% AP IoU = . 50 : . 05 : . 95 ) on the AICD-2012 dataset.