Evaluation of U-Net Backbones for Cloud Segmentation in Satellite Images

Laura Arakaki, Leandro Silva, Leandro Silva, Matheus Silva, Bruno Melo, André Backes, Mauricio Escarpinati, João Mari

2023

Abstract

Remote sensing images are an important resource for obtaining information for different types of applications. The occlusion of regions of interest by clouds is a common problem in this type of image. Thus, the objective of this work is to evaluate methods based on convolutional neural networks (CNNs) for cloud segmentation in satellite images. We compared three segmentation models, all of them based on the U-Net architecture with different backbones. The first considered backbone is simpler and consists of three contraction blocks followed by three expansion blocks. The second model has a backbone based on the VGG-16 CNN and the third one on the ResNet-18. The methods were tested using the Cloud-38 dataset, composed of 8400 satellite images in the training set and 9201 in the test set. The model considering the simplest backbone was trained from scratch, while the models with backbones based on VGG-16 and ResNet-18 were trained using fine-tuning on pre-trained models with ImageNet. The results demonstrate that the tested models can segment the clouds in the images satisfactorily, reaching up to 97% accuracy on the validation set and 95% on the test set.

Paper Citation

in Harvard Style

Arakaki L., Silva L., Silva M., Melo B., Backes A., Escarpinati M. and Mari J. (2023). Evaluation of U-Net Backbones for Cloud Segmentation in Satellite Images. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 452-458. DOI: 10.5220/0011787200003417

in Bibtex Style

@conference{visapp23,
author={Laura Arakaki and Leandro Silva and Matheus Silva and Bruno Melo and André Backes and Mauricio Escarpinati and João Mari},
title={Evaluation of U-Net Backbones for Cloud Segmentation in Satellite Images},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP},
year={2023},
pages={452-458},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011787200003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP
TI - Evaluation of U-Net Backbones for Cloud Segmentation in Satellite Images
SN - 978-989-758-634-7
AU - Arakaki L.
AU - Silva L.
AU - Silva M.
AU - Melo B.
AU - Backes A.
AU - Escarpinati M.
AU - Mari J.
PY - 2023
SP - 452
EP - 458
DO - 10.5220/0011787200003417
PB - SciTePress