2024 · 27 citations · 35 references
ComputingAnimal SciencesComputer ScienceAnimal BehaviorBehavioral EcologyComputer VisionAction RecognitionAnimal TrackingObject RecognitionScene ClassificationWildlife BehaviorAnimal Behaviour MonitoringAutomated Behavior Detection
We present a novel dataset for animal behavior recognition collected in-situ using video from drones flown over the Mpala Research Centre in Kenya. Videos from DJI Mavic 2S drones flown in January 2023 were acquired at 5.4K resolution in accordance with IACUC protocols, and processed to detect and track each animal in the frames. An image subregion centered on each animal was extracted and combined in sequence to form a “mini-scene”. Be-haviors were then manually labeled for each frame of each mini-scene by a team of annotators overseen by an expert behavioral ecologist. The resulting labeled mini-scenes form our resulting behavior dataset, consisting of more than 10 hours of annotated videos of reticulated gi-raffes, plains zebras, and Grevy's zebras, and encompassing seven types of animal behavior and an additional category for occlusions. Benchmark results for state-of-the-art behavioral recognition architectures show labeling accu-racy of 61.9% for macro-average (per class), and 86.7% for micro-average (per instance). Our dataset complements recent larger, more diverse animal behavior sets and smaller, more specialized ones by being collected in-situ and from drones, both important considerations for the future of an-imal behavior research. The dataset can be accessed at https://dirtmaxim.github.io/kabr.
35
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das et al. · 2017 · 21.6K citations
Simple online and realtime tracking
Alex Bewley, Zongyuan Ge, Lionel Ott et al. · 2016 · 3.9K citations · Full text
SlowFast Networks for Video Recognition
Christoph Feichtenhofer, Haoqi Fan, Jitendra Malik et al. · 2019 · 3.6K citations
The Kinetics Human Action Video Dataset
Will Kay, João Carreira, Karen Simonyan et al. · arXiv (Cornell University) · 2017 · 2.9K citations · Full text