FDCNN

This repository contains code, network definitions and pre-trained models for change detection on remote sensing images using deep learning.

The implementation uses the Caffe framework.

Motivation

In this work, we use scene-level samples (from the AID data set) of remote sensing scene classification, which are easier to obtain than pixel-level samples, for learning deep features from different remote sensing scenes at different scales. These features learned from specific scenes (cultivated land, lakes, vegetation, etc.) are more affected. The changes in these scenes are usually more important. Based on this idea, A new CNN structure and training strategies are proposed for remote sensing image change detection, which is supervised but requires very few pixel-level training samples. Advantageously, it has good generalization ability and multi-scale change detection capabilities.

Content

Networks

We provide a deep neural network based on the VGG16 architecture. It was trained on the AID dataset to learn the multi-scale deep features from remote sensing images. The pre-trained weights can be download from the link.

We proposed a novel FDCNN to produce change detection maps from high-resolution RS images. It is suitable for multi-scale remote sensing image change detection tasks.

Datasets

The available datasets can be downloaded from the table below:

How to start

1. Install Caffe with Python 2.7

   1. Follow the instructions in Installation, note the version of Python. Or using our pre-build runtime (with CUDA 8.0 and for Windows only).
   2. Please add the absolute path of folder "caffe_layers" to the PYTHONPATH so that PyCaffe can search for the layer implementation file.

2. Training VGG16 & FDCNN

   1. Training VGG16 using the AID dataset.

   2. Training FDCNN using the WV2 site 1 dataset.

3. Testing FDCNN

   1. Download the test data sets and unzip them to the "datasets" subfolder.

   2. Use your own trained FDCNN model, or download our pre-trained FDCNN model.

   3. Evaluation

      • To test the accuracy of FDCNN on the test datasets, run the following commands:

        python exp_test_custom.py \
            --sensor=ZY3 \
            --alpha=2.0
        

      • To test the accuracy of FDCNN on the SZTAKI datasets, run the following commands:

        python exp_test_SZTAKI.py \
            --alpha=2.66
        

      • To test the accuracy of FDCNN on the OSCD datasets, run the following commands:

        python exp_test_OSCD.py \
            --threshold=0.98
        

        The ground truth of OSCD remains undisclosed and the results need be uploaded to the IEEE GRSS DASE website for evaluation, see figure 1.

        Figure 1. FDCNN accuracy evaluation on the OSCD dataset.

   Change magnitude map (CMM.tif) and binary image (BM.tif) will be generated under the "output" subfolder.

References

If you use this work for your projects, please take the time to cite our paper.

@Article{9052762,
AUTHOR = {Zhang, Min and Shi, Wenzhong},
TITLE = {A Feature Difference Convolutional Neural Network-Based Change Detection Method},
JOURNAL = {IEEE Transactions on Geoscience and Remote Sensing},
VOLUME = {},
YEAR = {2020},
NUMBER = {},
URL = {https://ieeexplore.ieee.org/document/9052762},
DOI = {10.1109/TGRS.2020.2981051}
}

License

Code and datasets are released under the GPLv3 license for non-commercial and research purposes only. For commercial purposes, please contact the authors.