Multisensor temporal unsupervised domain adaptation for land cover mapping with spatial pseudo-labeling and adversarial learning

Capliez Emmanuel, Ienco Dino, Gaetano Raffaele, Baghdadi Nicolas, Hadj Salah Adrien, Le Goff Matthieu, Chouteau Florient. 2023. Multisensor temporal unsupervised domain adaptation for land cover mapping with spatial pseudo-labeling and adversarial learning. IEEE Transactions on Geoscience and Remote Sensing, 61:5405716 : 1-16.

https://doi.org/10.1109/TGRS.2023.3297077

Article de revue ; Article de recherche ; Article de revue à facteur d'impact

Prévisualisation

Version publiée - Anglais
Sous licence

.
608592.pdf
Télécharger (6MB) | Prévisualisation

Résumé : With the huge variety of Earth observation satellite missions available nowadays, the collection of multisensor remote sensing information depicting the same geographical area has become systematic in practice, paving the way to the further breakthroughs in automatic land cover mapping with the aim to support decision makers in a variety of land management applications. In this context, along with the increase in the volume of data available, the availability of ground-truth (GT) data to train supervised models, which is usually time-consuming and costly, may even be more critical. In this scenario, the possibility to transfer a model learned on a particular time span (source domain) to a different period of time (target domain), over the same geographical area, can be advantageous in terms of both cost and time efforts. However, such model transfer is challenging due to different climate, weather, or environmental conditions affecting remote sensing data collected at different time periods, resulting in possible distribution shifts between the source and target domains. With the aim to cope with the multisensor temporal transfer scenario in the context of land cover mapping, where multitemporal and multiscale information are used jointly, we propose a Multisensor, Multitemporal, and Multiscale SPatially Aware Domain Adaptation (M3SPADA) framework, a deep learning methodology that jointly exploits self-training and adversarial learning to transfer a multisensor land cover classifier (MSLCC) from a time period (year) to a different one on the same geographical area. Here, we consider the case in which each domain (source and target) is described by a pair of remote sensing datasets: a satellite image time series (SITS) of optical images and a single very high spatial resolution (VHR) scene. Experimental evaluation on a real-world study case located in Burkina Faso and characterized by operational constraints shows the quality of our proposal to deal with the temporal...

Mots-clés Agrovoc : télédétection, cartographie de l'occupation du sol, satellite d'observation de la Terre, imagerie par satellite, cartographie de l'utilisation des terres

Mots-clés géographiques Agrovoc : France, Burkina Faso

Mots-clés libres : Data fusion, Deep Learning, Multisensor land cover mapping, Satellite image time series (SITS), Temporal domain adaptation, Very high spatial resolution (VHR) imagery

Auteurs et affiliations