Detection of coffee fruits on tree branches using computer vision
ABSTRACT Coffee farmers do not have efficient tools to have sufficient and reliable information on the maturation stage of coffee fruits before harvest. In this study, we propose a computer vision system to detect and classify the Coffea arabica (L.) on tree branches in three classes: unripe (green), ripe (cherry), and overripe (dry). Based on deep learning algorithms, the computer vision model YOLO (You Only Look Once), was trained on 387 images taken from coffee branches using a smartphone. The YOLOv3 and YOLOv4, and their smaller versions (tiny), were assessed for fruit detection. The YOLOv4 and YOLOv4-tiny showed better performance when compared to YOLOv3, especially when smaller network sizes are considered. The mean average precision (mAP) for a network size of 800 × 800 pixels was equal to 81 %, 79 %, 78 %, and 77 % for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny, respectively. Despite the similar performance, the YOLOv4 feature extractor was more robust when images had greater object densities and for the detection of unripe fruits, which are generally more difficult to detect due to the color similarity to leaves in the background, partial occlusion by leaves and fruits, and lighting effects. This study shows the potential of computer vision systems based on deep learning to guide the decision-making of coffee farmers in more objective ways.
Principais autores: | , , , |
---|---|
Formato: | Digital revista |
Idioma: | English |
Publicado em: |
Escola Superior de Agricultura "Luiz de Queiroz"
2023
|
Acesso em linha: | http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0103-90162023000100103 |
Tags: |
Adicionar Tag
Sem tags, seja o primeiro a adicionar uma tag!
|
id |
oai:scielo:S0103-90162023000100103 |
---|---|
record_format |
ojs |
spelling |
oai:scielo:S0103-901620230001001032022-09-09Detection of coffee fruits on tree branches using computer visionBazame,Helizani CoutoMolin,José PauloAlthoff,DanielMartello,Maurício YOLO precision agriculture high-quality coffee ABSTRACT Coffee farmers do not have efficient tools to have sufficient and reliable information on the maturation stage of coffee fruits before harvest. In this study, we propose a computer vision system to detect and classify the Coffea arabica (L.) on tree branches in three classes: unripe (green), ripe (cherry), and overripe (dry). Based on deep learning algorithms, the computer vision model YOLO (You Only Look Once), was trained on 387 images taken from coffee branches using a smartphone. The YOLOv3 and YOLOv4, and their smaller versions (tiny), were assessed for fruit detection. The YOLOv4 and YOLOv4-tiny showed better performance when compared to YOLOv3, especially when smaller network sizes are considered. The mean average precision (mAP) for a network size of 800 × 800 pixels was equal to 81 %, 79 %, 78 %, and 77 % for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny, respectively. Despite the similar performance, the YOLOv4 feature extractor was more robust when images had greater object densities and for the detection of unripe fruits, which are generally more difficult to detect due to the color similarity to leaves in the background, partial occlusion by leaves and fruits, and lighting effects. This study shows the potential of computer vision systems based on deep learning to guide the decision-making of coffee farmers in more objective ways.info:eu-repo/semantics/openAccessEscola Superior de Agricultura "Luiz de Queiroz"Scientia Agricola v.80 20232023-01-01info:eu-repo/semantics/articletext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S0103-90162023000100103en10.1590/1678-992x-2022-0064 |
institution |
SCIELO |
collection |
OJS |
country |
Brasil |
countrycode |
BR |
component |
Revista |
access |
En linea |
databasecode |
rev-scielo-br |
tag |
revista |
region |
America del Sur |
libraryname |
SciELO |
language |
English |
format |
Digital |
author |
Bazame,Helizani Couto Molin,José Paulo Althoff,Daniel Martello,Maurício |
spellingShingle |
Bazame,Helizani Couto Molin,José Paulo Althoff,Daniel Martello,Maurício Detection of coffee fruits on tree branches using computer vision |
author_facet |
Bazame,Helizani Couto Molin,José Paulo Althoff,Daniel Martello,Maurício |
author_sort |
Bazame,Helizani Couto |
title |
Detection of coffee fruits on tree branches using computer vision |
title_short |
Detection of coffee fruits on tree branches using computer vision |
title_full |
Detection of coffee fruits on tree branches using computer vision |
title_fullStr |
Detection of coffee fruits on tree branches using computer vision |
title_full_unstemmed |
Detection of coffee fruits on tree branches using computer vision |
title_sort |
detection of coffee fruits on tree branches using computer vision |
description |
ABSTRACT Coffee farmers do not have efficient tools to have sufficient and reliable information on the maturation stage of coffee fruits before harvest. In this study, we propose a computer vision system to detect and classify the Coffea arabica (L.) on tree branches in three classes: unripe (green), ripe (cherry), and overripe (dry). Based on deep learning algorithms, the computer vision model YOLO (You Only Look Once), was trained on 387 images taken from coffee branches using a smartphone. The YOLOv3 and YOLOv4, and their smaller versions (tiny), were assessed for fruit detection. The YOLOv4 and YOLOv4-tiny showed better performance when compared to YOLOv3, especially when smaller network sizes are considered. The mean average precision (mAP) for a network size of 800 × 800 pixels was equal to 81 %, 79 %, 78 %, and 77 % for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny, respectively. Despite the similar performance, the YOLOv4 feature extractor was more robust when images had greater object densities and for the detection of unripe fruits, which are generally more difficult to detect due to the color similarity to leaves in the background, partial occlusion by leaves and fruits, and lighting effects. This study shows the potential of computer vision systems based on deep learning to guide the decision-making of coffee farmers in more objective ways. |
publisher |
Escola Superior de Agricultura "Luiz de Queiroz" |
publishDate |
2023 |
url |
http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0103-90162023000100103 |
work_keys_str_mv |
AT bazamehelizanicouto detectionofcoffeefruitsontreebranchesusingcomputervision AT molinjosepaulo detectionofcoffeefruitsontreebranchesusingcomputervision AT althoffdaniel detectionofcoffeefruitsontreebranchesusingcomputervision AT martellomauricio detectionofcoffeefruitsontreebranchesusingcomputervision |
_version_ |
1756407185209819136 |