M3Fusion: A deep learning architecture for multiscale multimodal multitemporal satellite data fusion

Benedetti Paola, Ienco Dino, Gaetano Raffaele, Osé Kenji, Pensa Ruggero, Dupuy Stéphane. 2018. M3Fusion: A deep learning architecture for multiscale multimodal multitemporal satellite data fusion. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11 (2) : 4939-4949.

https://doi.org/10.1109/JSTARS.2018.2876357

Article de revue ; Article de recherche ; Article de revue à facteur d'impact

Prévisualisation

Version post-print - Anglais
Utilisation soumise à autorisation de l'auteur ou du Cirad.
M3Fusion_iee.pdf
Télécharger (2MB) | Prévisualisation

Version Online first - Anglais
Accès réservé aux personnels Cirad
Utilisation soumise à autorisation de l'auteur ou du Cirad.
IEEEJSTARS.pdf
Télécharger (7MB) | Demander une copie

Url - jeu de données - Dataverse Cirad : https://doi.org/10.18167/DVN1/TOARDN

Quartile : Q2, Sujet : ENGINEERING, ELECTRICAL & ELECTRONIC / Quartile : Q2, Sujet : IMAGING SCIENCE & PHOTOGRAPHIC TECHNOLOGY / Quartile : Q2, Sujet : REMOTE SENSING / Quartile : Q2, Sujet : GEOGRAPHY, PHYSICAL

Résumé : Modern Earth Observation systems provide remote sensing data at different temporal and spatial resolutions. Among all the available spatial mission, today the Sentinel-2 program supplies high temporal (every five days) and high spatial resolution (HSR) (10 m) images that can be useful to monitor land cover dynamics. On the other hand, very HSR (VHSR) imagery is still essential to figure out land cover mapping characterized by fine spatial patterns. Understanding how to jointly leverage these complementary sources in an efficient way when dealing with land cover mapping is a current challenge in remote sensing. With the aim of providing land cover mapping through the fusion of multitemporal HSR and VHSR satellite images, we propose a suitable end-to-end deep learning framework, namely M3Fusion , which is able to simultaneously leverage the temporal knowledge contained in time series data as well as the fine spatial information available in VHSR images. Experiments carried out on the Reunion Island study area confirm the quality of our proposal considering both quantitative and qualitative aspects.

Mots-clés géographiques Agrovoc : La Réunion, France

Mots-clés libres : Land cover mapping, Data fusion, Deep Learning, Satellite Image Time series, Very High Spatial Resolution, Sentinel-2

Classification Agris : U30 - Méthodes de recherche
C30 - Documentation et information

Champ stratégique Cirad : Axe 6 (2014-2018) - Sociétés, natures et territoires

Auteurs et affiliations