Pl@ntNet-300K : a plant image dataset with high label ambiguity and along tailed distribution

Garcin Camille, Joly Alexis, Bonnet Pierre, Lombardo Jean-Christophe, Affouard Antoine, Chouet Mathias, Servajean Maximilien, Lorieul Titouan, Salmon Joseph. 2021. Pl@ntNet-300K : a plant image dataset with high label ambiguity and along tailed distribution. In : Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1 (NeurIPS Datasets and Benchmarks 2021). Vanschoren J. (ed.), Yeung S. (ed.). s.l. : s.n., 1-19. ISBN 9781713871095 Conference on Neural Information Processing Systems (NeurIPS 2021). 35, France, 6 Décembre 2021/14 Décembre 2021.

https://datasets-benchmarks-proceedings.neurips.cc/paper_files/paper/2021/hash/7e7757b1e12abcb736ab9a754ffb617a-Abstract-round2.html

Communication avec actes

Prévisualisation

Version publiée - Anglais
Sous licence

.
607882.pdf
Télécharger (3MB) | Prévisualisation

Note générale : Le congrès s'est tenu en ligne

Résumé : This paper presents a novel image dataset with high intrinsic ambiguity specifically built for evaluating and comparing set-valued classifiers. This dataset, built from the database of Pl@ntnet citizen observatory, consists of 306,146 images covering 1,081 species. We highlight two particular features of the dataset, inherent to the way the images are acquired and to the intrinsic diversity of plants morphology: i) The dataset has a strong class imbalance, meaning that a few species account for most of the images. ii) Many species are visually similar, making identification difficult even for the expert eye.These two characteristics make the present dataset well suited for the evaluation of set-valued classification methods and algorithms. Therefore, we recommend two set-valued evaluation metrics associated with the dataset (mean top-k accuracy and mean average-k accuracy) and we provide the results of a baseline approach based on a deep neural network trained with the cross-entropy loss.

Agences de financement européennes : European Commission

Agences de financement hors UE : Agence Nationale de la Recherche

Programme de financement européen : H2020

Projets sur financement : (FRA) CooperAtive MachinE Learning and OpTimization, (EU) Co-designed Citizen Observatories Services for the EOS-Cloud

Auteurs et affiliations