A new fine-grained method for automated visual analysis of herbarium specimens: A case study for phenological data extraction

Goeau Hervé, Mora-Fallas Adán, Champ Julien, Rossington Love Natalie L., Mazer Susan J., Mata-Montero Erick, Joly Alexis, Bonnet Pierre. 2020. A new fine-grained method for automated visual analysis of herbarium specimens: A case study for phenological data extraction. Applications in Plant Sciences, 8 (6), n.spéc. Machine Learning in Plant Biology: Advances Using Herbarium Specimen Images:e11368, 11 p.

Url - jeu de données - Entrepôt autre : https://doi.org/10.5281/zenodo.3865262

Quartile : Q2, Sujet : PLANT SCIENCES

Résumé : Premise: Herbarium specimens represent an outstanding source of material with which to study plant phenological changes in response to climate change. The fine‐scale phenological annotation of such specimens is nevertheless highly time consuming and requires substantial human investment and expertise, which are difficult to rapidly mobilize. Methods: We trained and evaluated new deep learning models to automate the detection, segmentation, and classification of four reproductive structures of Streptanthus tortuosus (flower buds, flowers, immature fruits, and mature fruits). We used a training data set of 21 digitized herbarium sheets for which the position and outlines of 1036 reproductive structures were annotated manually. We adjusted the hyperparameters of a mask R‐CNN (regional convolutional neural network) to this specific task and evaluated the resulting trained models for their ability to count reproductive structures and estimate their size. Results: The main outcome of our study is that the performance of detection and segmentation can vary significantly with: (i) the type of annotations used for training, (ii) the type of reproductive structures, and (iii) the size of the reproductive structures. In the case of Streptanthus tortuosus, the method can provide quite accurate estimates (77.9% of cases) of the number of reproductive structures, which is better estimated for flowers than for immature fruits and buds. The size estimation results are also encouraging, showing a difference of only a few millimeters between the predicted and actual sizes of buds and flowers. Discussion: This method has great potential for automating the analysis of reproductive structures in high‐resolution images of herbarium sheets. Deeper investigations regarding the taxonomic scalability of this approach and its potential improvement will be conducted in future work.

Mots-clés Agrovoc : herbier, phénologie, collection botanique, analyse de données, analyse d'image, traitement numérique d'image, traitement des données

Mots-clés complémentaires : deep learning, streptanthus tortuosus

Mots-clés libres : Automated regional segmentation, Deep learning, Herbarium data, Natural history collections, Phenological stage annotation, Phenophase, Regional convolutional neural network, Visual data classification

Classification Agris : F70 - Taxonomie végétale et phytogéographie
F40 - Écologie végétale
U10 - Informatique, mathématiques et statistiques

Champ stratégique Cirad : CTS 1 (2019-) - Biodiversité

Auteurs et affiliations

• Goeau Hervé, CIRAD-BIOS-UMR AMAP (FRA)
• Mora-Fallas Adán, Instituto Tecnológico de Costa Rica (CRI)
• Champ Julien, INRIA (FRA)
• Rossington Love Natalie L., UC (USA)
• Mazer Susan J., UC (USA)
• Mata-Montero Erick, Instituto Tecnológico de Costa Rica (CRI) - auteur correspondant
• Joly Alexis, INRIA (FRA)
• Bonnet Pierre, CIRAD-BIOS-UMR AMAP (FRA) ORCID: 0000-0002-2828-4389

Source : Cirad-Agritrop (https://agritrop.cirad.fr/597013/)

Métriques

[ Page générée et mise en cache le 2024-07-17 ]