Categorizing plant images at the variety level: Did you say fine-grained?

Champ Julien, Lorieul Titouan, Bonnet Pierre, Maghnaoui Najate, Sereno Christophe, Dessup Thierry, Boursiquot Jean-Michel, Audeguin Laurent, Lacombe Thierry, Joly Alexis. 2016. Categorizing plant images at the variety level: Did you say fine-grained?. Pattern Recognition Letters, 81 : pp. 71-79.

Journal article ; Article de recherche ; Article de revue à facteur d'impact
[img] Published version - Anglais
Access restricted to CIRAD agents
Use under authorization by the author or CIRAD.

Télécharger (2MB) | Request a copy


Abstract : This paper addresses the problem of categorizing plant images at the variety level, i.e. at a finer taxonomic grain than state-of-the-art studies usually working at the species level. It therefore introduces two new evaluation datasets of agro-biodiversity interest, each being related to concrete scenarios on large-scale plant resources. They have been chosen so as to involve very different acquisition protocols and visual patterns in order to evaluate if state-of-the-art image classification techniques can generalize to such specific contexts and avoid the cost of building specific ad-hoc solutions. The first one is a collection of 2071 pictures of loose rice seeds built from 95 accessions kept in a bank of seeds. The second one is a collection of 2037 pictures of grape leaves taken in the fields and belonging to 34 varieties among the most commonly ones used in viticulture. Both datasets exhibit a very low inter-class variability resulting in two challenging fine-grained classification tasks, even for expert human operators. A baseline experimental study was conducted on the two datasets using the two most effective families of classification techniques in the state-of-the-art, i.e. convolutional neural networks on one side and fisher vectors-based discriminant models on the other side. It shows that the achieved classification performance is very different between the two problems. It is actually pretty bad for the grape leaves collection but much better in the case of the rice seeds collection for which the acquisition protocol was much more constrained and the morphological variability more visible. The conclusion is that automatically identifying plant varieties might already be feasible for some specific scenarios and in controlled environments but that it is still an open problem in the general case.

Mots-clés Agrovoc : riz, Oryza, Anatomie végétale, Classification, Photographie

Mots-clés libres : Riz, Reconnaissance d'image

Classification Agris : U30 - Research methods
F50 - Plant structure

Champ stratégique Cirad : Axe 1 (2014-2018) - Agriculture écologiquement intensive

Agence(s) de financement européenne(s) : European Commission

Auteurs et affiliations

  • Champ Julien, INRIA (FRA)
  • Lorieul Titouan, INRIA (FRA)
  • Bonnet Pierre, CIRAD-BIOS-UMR AMAP (FRA) ORCID: 0000-0002-2828-4389
  • Maghnaoui Najate, CIRAD-BIOS-UMR AGAP (FRA)
  • Sereno Christophe, IFV (FRA)
  • Dessup Thierry, INRA (FRA)
  • Boursiquot Jean-Michel, Montpellier SupAgro (FRA)
  • Audeguin Laurent, IFV (FRA)
  • Lacombe Thierry, INRA (FRA)
  • Joly Alexis, INRIA (FRA) - auteur correspondant

Source : Cirad-Agritrop (

View Item (staff only) View Item (staff only)

[ Page générée et mise en cache le 2021-02-07 ]