Supplementary material from "Improve automatic detection of animal call sequences with temporal context"
Posted on 2021-07-01 - 08:17
Many animals rely on long-form communication, in the form of songs, for vital functions such as mate attraction and territorial defence. We explored the prospect of improving automatic recognition performance by using the temporal context inherent in song. The ability to accurately detect sequences of calls has implications for conservation and biological studies. We show that the performance of a convolutional neural network (CNN), designed to detect song notes (calls) in short-duration audio segments, can be improved by combining it with a recurrent network designed to process sequences of learned representations from the CNN on a longer time scale. The combined system of independently trained CNN and long short-term memory (LSTM) network models exploits the temporal patterns between song notes. We demonstrate the technique using recordings of fin whale (Balaenoptera physalus) songs, which comprise patterned sequences of characteristic notes. We evaluated several variants of the CNN + LSTM network. Relative to the baseline CNN model, the CNN + LSTM models reduced performance variance, offering 9–17% increase in area under the precision–recall curve and 9–18% increase in peak F1-scores. These results show that the inclusion of temporal information may offer a valuable pathway for improving the automatic recognition and transcription of wildlife recordings.
CITE THIS COLLECTION
DataCite
3 Biotech
3D Printing in Medicine
3D Research
3D-Printed Materials and Systems
4OR
AAPG Bulletin
AAPS Open
AAPS PharmSciTech
Abhandlungen aus dem Mathematischen Seminar der Universität Hamburg
ABI Technik (German)
Academic Medicine
Academic Pediatrics
Academic Psychiatry
Academic Questions
Academy of Management Discoveries
Academy of Management Journal
Academy of Management Learning and Education
Academy of Management Perspectives
Academy of Management Proceedings
Academy of Management Review
Madhusudhana, Shyam; Shiu, Yu; Klinck, Holger; Fleishman, Erica; Liu, Xiaobai; Nosal, Eva-Marie; et al. (2021). Supplementary material from "Improve automatic detection of animal call sequences with temporal context". The Royal Society. Collection. https://doi.org/10.6084/m9.figshare.c.5492899.v1
or
Select your citation style and then place your mouse over the citation text to select it.
SHARE
Usage metrics
Read the peer-reviewed publication
AUTHORS (11)
SM
Shyam Madhusudhana
YS
Yu Shiu
HK
Holger Klinck
EF
Erica Fleishman
XL
Xiaobai Liu
EN
Eva-Marie Nosal
TH
Tyler Helble
DC
Danielle Cholewiak
DG
Douglas Gillespie
AŠ
Ana Širović
MR
Marie A. Roch