WAVE: Edge-Device Cooperated Real-Time Object Detection for Open-Air Applications

Abstract

CNN based real-time object detection can facilitate various AI applications that need to understand the surroundings via camera, such as autonomous package delivery robots, augmented reality, and intelligent drone applications. Currently, due to the high computation cost of CNN, accurate real-time object detection is only possible when mobile devices can upload video frames to powerful edge servers through high-speed wireless networks like WiFi. However, for many open-air AI applications, the network conditions (such as cellular networks) are usually unfavorable, far from satisfying the network demands of state-of-the-art systems. In this paper, we focus on the challenges incurred by mobile communication networks and propose WAVEcontaining three novel techniques, which are <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Deep RoI Encoding</i> , <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Prioritized Parallel Offloading</i> and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Fine-grained Offloading Strategy</i> , to realize <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">real-time</i> , <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">robust</i> and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">low-cost</i> object detection for open-air AI applications. The experimental results show that under LTE networks, WAVE realizes high-accuracy real-time object detection and face recognition and significantly outperforms state-of-the-art systems.