Novel green-fruit detection algorithm based on D2D framework

In the complex orchard environment, the efficient and accurate detection of object fruit is the basie requirement to realize the orchard yield measurement and automatic harvesting. Sometimes it is hard to differentiate between the object fruits and the background because of the similar color, and it...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:International journal of agricultural and biological engineering Jg. 15; H. 1; S. 251 - 259
Hauptverfasser: Wei, Jinmeng, Ding, Yanhui, Liu, Jie, Zakir Ullah, Muhammad, Yin, Xiang, Jia, Weikuan
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Beijing International Journal of Agricultural and Biological Engineering (IJABE) 2022
Schlagworte:
Accuracy
Algorithms
Apples
Cameras
Classification
Deep learning
Efficiency
Feature extraction
Frame design
Fruits
Light
Machine learning
Object recognition
Orchards
Predictions
Robots
Storage requirements
ISSN:1934-6344, 1934-6352
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In the complex orchard environment, the efficient and accurate detection of object fruit is the basie requirement to realize the orchard yield measurement and automatic harvesting. Sometimes it is hard to differentiate between the object fruits and the background because of the similar color, and it is challenging due to the ambient light and camera angle by which the photos have been taken. These problems make it hard to detect green fruits in orchard environments. In this study, a two-stage dense to detection framework (D2D) was proposed to detect green fruits in orchard environments. The proposed model was based on multi-scale feature extraction of target fruit by using feature pyramid networks MobileNetV2 +FPN structure and generated region proposal of target fruit by using Region Proposal Network (RPN) structure. In the regression branch, the offset of each local feature was calculated, and the positive and negative samples of the region proposals were predicted by a binary mask prediction to reduce the interference of the background to the prediction box. In the classification branch, features were extracted from each sub-region of the region proposal, and features with distinguishing information were obtained through adaptive weighted pooling to achieve accurate classification. The new proposed model adopted an anchor-free frame design, which improves the generalization ability, makes the model more robust, and reduces the storage requirements. The experimental results of persimmon and green apple datasets show that the new model has the best detection performance, which can provide theoretical reference for other green object detection.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1934-6344
1934-6352
DOI:10.25165/j.ijabe.20221501.6943