Pl@ntNet Crops: Merging citizen science observations and structured survey data to improve crop recognition for agri-food-environment applications

van der Velde Marijn, Goeau Hervé, Bonnet Pierre, d'Andrimont Raphaël, Yordanov M., Affouard Antoine, Claverie M., Czucz B., Elvekjaer N., Martinez-Sanchez L., Rotllan-Puig X., Sima A., Verhegghen Astrid, Joly Alexis. 2023. Pl@ntNet Crops: Merging citizen science observations and structured survey data to improve crop recognition for agri-food-environment applications. Environmental Research Letters, 18:025005, 12 p.

https://doi.org/10.1088/1748-9326/acadf3

Article de revue ; Article de recherche ; Article de revue à facteur d'impact Revue en libre accès total

Prévisualisation

Version publiée - Anglais
Sous licence

.
ID608524.pdf
Télécharger (10MB) | Prévisualisation

Résumé : We present a new application to recognize 218 species of cultivated crops on geo-tagged photos, 'Pl@ntNet Crops'. The application and underlying algorithms are developed using more than 750k photos voluntarily collected by Pl@ntNet users. The app is then enriched by data and photos coming from the European Union's (EU) Land Use and Coverage Area frame Survey (LUCAS). During five tri-annual LUCAS campaigns from 2006 to 2018, 242 476 close-up 'cover' photos of crops were collected. The survey protocol for these photos specified that 'the picture should be taken at a close distance, so that the structure of leaves can be clearly seen, as well as flowers or fruits'. This unique labelled data provides an opportunity to further generalize the Pl@ntNet computer vision algorithms to recognize crops and enlarge their geographic representivity across the EU. To include LUCAS cover photos, we semantically match Pl@ntNet species and LUCAS legends, predict the species on LUCAS cover photos with the existing Pl@ntNet algorithm, and consider the accuracy of the classification and the number of species enriched by the photos. By setting a threshold of 0.5 on the Pl@ntNet prediction probabilities, 70 170 LUCAS photos representing 101 species classified with an accuracy of 0.9 were added to the 'Crops' app. The thematic accuracy of the legacy LUCAS data was improved by distinguishing 218 species, opposed to the original 36 LUCAS levels. Official and publicly financed LUCAS datastreams can now be improved because of Pl@ntNet citizen science, photo collection, and deep learning model development. Further use of the app and policy-relevant workflows in the agri-food-environment domain are discussed.

Mots-clés Agrovoc : identification, imagerie, détermination des espèces, application des ordinateurs, distribution géographique, Brassica oleracea, informatique, taxonomie, plante de couverture

Mots-clés libres : Citizen science, Deep Learning, Computer vision, Authoritative data, Crowdsourcing, Common agricultural policy

Classification Agris : F70 - Taxonomie végétale et phytogéographie
U30 - Méthodes de recherche
F40 - Écologie végétale
F50 - Anatomie et morphologie des plantes

Champ stratégique Cirad : CTS 2 (2019-) - Transitions agroécologiques

Agences de financement européennes : European Commission

Projets sur financement : (EU) Co-designed Citizen Observatories Services for the EOS-Cloud

Auteurs et affiliations