Estimating compositions and nutritional values of seed mixes based on vision transformers

Mehreen Shamprikta, Goeau Hervé, Bonnet Pierre, Chau Sophie, Champ Julien, Joly Alexis. 2023. Estimating compositions and nutritional values of seed mixes based on vision transformers. Plant Phenomics, 5:ID0112, 11 p.

https://doi.org/10.34133/plantphenomics.0112

Article de revue ; Article de recherche ; Article de revue à facteur d'impact Revue en libre accès total

Prévisualisation

Version publiée - Anglais
Sous licence

.
plantphenomics.0112.pdf
Télécharger (13MB) | Prévisualisation

Url - jeu de données - Entrepôt autre : https://zenodo.org/records/8169473

Résumé : The cultivation of seed mixtures for local pastures is a traditional mixed cropping technique of cereals and legumes for producing, at a low production cost, a balanced animal feed in energy and protein in livestock systems. By considerably improving the autonomy and safety of agricultural systems, as well as reducing their impact on the environment, it is a type of crop that responds favorably to both the evolution of the European regulations on the use of phytosanitary products and the expectations of consumers who wish to increase their consumption of organic products. However, farmers find it difficult to adopt it because cereals and legumes do not ripen synchronously and the harvested seeds are heterogeneous, making it more difficult to assess their nutritional value. Many efforts therefore remain to be made to acquire and aggregate technical and economical references to evaluate to what extent the cultivation of seed mixtures could positively contribute to securing and reducing the costs of herd feeding. The work presented in this paper proposes new Artificial Intelligence techniques that could be transferred to an online or smartphone application to automatically estimate the nutritional value of harvested seed mixes to help farmers better manage the yield and thus engage them to promote and contribute to a better knowledge of this type of cultivation. For this purpose, an original open image dataset has been built containing 4,749 images of seed mixes, covering 11 seed varieties, with which 2 types of recent deep learning models have been trained. The results highlight the potential of this method and show that the best-performing model is a recent state-of-the-art vision transformer pre-trained with self-supervision (Bidirectional Encoder representation from Image Transformer). It allows an estimation of the nutritional value of seed mixtures with a coefficient of determination R2 score of 0.91, which demonstrates the interest of this type of approach, for its possible use on a large scale.

Mots-clés Agrovoc : intelligence artificielle, valeur nutritive, mélange de semences, système de culture, culture en mélange, variété, bilan énergétique, modèle, nutrition animale

Classification Agris : F03 - Production et traitement des semences
F01 - Culture des plantes
U10 - Informatique, mathématiques et statistiques

Champ stratégique Cirad : CTS 2 (2019-) - Transitions agroécologiques

Agences de financement hors UE : Compte d'affectation spécial Développement agricole et rural, Agence Nationale de la Recherche

Projets sur financement : (FRA) Carpeso, (FRA) Pl@ntAgroEco

Auteurs et affiliations