A Deep learning method for accurate and fast identification of coral reef fishes in underwater images

Identifying and counting fish individuals on photos and videos is a crucial task to cost-effectively monitor marine biodiversity, yet it remains difficult and time-consuming. In this paper, we present a method to assist the identification of fish species on underwater images, and we compare our mode...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Ecological informatics Jg. 48; S. 238 - 244
Hauptverfasser: Villon, Sébastien, Mouillot, David, Chaumont, Marc, Darling, Emily S., Subsol, Gérard, Claverie, Thomas, Villéger, Sébastien
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier B.V 01.11.2018
Elsevier
Schlagworte:
Artificial Intelligence
Automated identification
biodiversity
Biodiversity and Ecology
Computer Science
Computer Vision and Pattern Recognition
Convolutional neural network
coral reefs
corals
Environmental Sciences
fish
humans
Image Processing
Machine Learning
Marine fishes
monitoring
Neural and Evolutionary Computing
protocols
species identification
Underwater pictures
Automated identification
Marine fishes
Underwater pictures
Convolutional neural network
Machine learning
Underwater images
ISSN:1574-9541
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Identifying and counting fish individuals on photos and videos is a crucial task to cost-effectively monitor marine biodiversity, yet it remains difficult and time-consuming. In this paper, we present a method to assist the identification of fish species on underwater images, and we compare our model performances to human ability in terms of speed and accuracy. We first tested the performance of a convolutional neural network (CNN) trained with different photographic databases while accounting for different post-processing decision rules to identify 20 fish species. Finally, we compared the performance of species identification of our best CNN model with that of humans on a test database of 1197 fish images representing nine species. The best CNN was the one trained with 900,000 images including (i) whole fish bodies, (ii) partial fish bodies and (iii) the environment (e.g. reef bottom or water). The rate of correct identification was 94.9%, greater than the rate of correct identification by humans (89.3%). The CNN was also able to identify fish individuals partially hidden behind corals or behind other fish and was more effective than humans to identify fish on smallest or blurry images while humans were better to identify fish individuals in unusual positions (e.g. twisted body). On average, each identification by our best CNN using a common hardware took 0.06 s. Deep Learning methods can thus perform efficient fish identification on underwater images and offer promises to build-up new video-based protocols for monitoring fish biodiversity cheaply and effectively. •Comparison between human experts and Deep Learning based method•Assessing the importance of post treatment with DL based methods•Importance of database adjustements•Real-life use cases for applied DL methods for fish identification
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1574-9541
DOI:10.1016/j.ecoinf.2018.09.007