A CNN-based fusion method for feature extraction from sentinel data

Scarpa Giuseppe, Gargiulo Massimiliano, Mazza Antonio, Gaetano Raffaele. 2018. A CNN-based fusion method for feature extraction from sentinel data. Remote Sensing, 10 (2):236, 20 p.

Quartile : Q1, Sujet : REMOTE SENSING

Résumé : Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative is to benefit from weather-insensitive synthetic aperture radar (SAR) images. In many real-world applications, critical decisions are made based on some informative optical or radar features related to items such as water, vegetation or soil. Under cloudy conditions, however, optical-based features are not available, and they are commonly reconstructed through linear interpolation between data available at temporally-close time instants. In this work, we propose to estimate missing optical features through data fusion and deep-learning. Several sources of information are taken into account—optical sequences, SAR sequences, digital elevation model—so as to exploit both temporal and cross-sensor dependencies. Based on these data and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May–November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baseline methods according to all performance indicators.

Mots-clés Agrovoc : indice de végétation, imagerie par satellite, traitement des données, traitement d'images, imagerie multispectrale

Mots-clés géographiques Agrovoc : Burkina Faso

Mots-clés complémentaires : deep learning

Classification Agris : U30 - Méthodes de recherche
F40 - Écologie végétale
P40 - Météorologie et climatologie

Champ stratégique Cirad : Axe 6 (2014-2018) - Sociétés, natures et territoires

Auteurs et affiliations

• Scarpa Giuseppe, CIRAD-ES-UMR TETIS (FRA) - auteur correspondant
• Gargiulo Massimiliano, University of Naples Federico II (ITA)
• Mazza Antonio, University of Naples Federico II (ITA)
• Gaetano Raffaele, CIRAD-ES-UMR TETIS (FRA)

Source : Cirad-Agritrop (https://agritrop.cirad.fr/592818/)

Métriques

[ Page générée et mise en cache le 2024-07-17 ]