EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time

TLDR

EVO is an event‑based visual odometry algorithm designed to track fast camera motions and recover a semidense 3‑D map. EVO combines image‑to‑model alignment tracking with a parallel event‑based 3‑D reconstruction algorithm. EVO tracks rapid camera motion, generates a semidense 3‑D map, runs in real time on a standard CPU, is robust to motion blur and high‑dynamic‑range lighting, can reconstruct intensity images from events, and enables SLAM in scenarios inaccessible to conventional cameras.

Abstract

We present EVO, an event-based visual odometry algorithm. Our algorithm successfully leverages the outstanding properties of event cameras to track fast camera motions while recovering a semidense three-dimensional (3-D) map of the environment. The implementation runs in real time on a standard CPU and outputs up to several hundred pose estimates per second. Due to the nature of event cameras, our algorithm is unaffected by motion blur and operates very well in challenging, high dynamic range conditions with strong illumination changes. To achieve this, we combine a novel, event-based tracking approach based on image-to-model alignment with a recent event-based 3-D reconstruction algorithm in a parallel fashion. Additionally, we show that the output of our pipeline can be used to reconstruct intensity images from the binary event stream, though our algorithm does not require such intensity information. We believe that this work makes significant progress in simultaneous localization and mapping by unlocking the potential of event cameras. This allows us to tackle challenging scenarios that are currently inaccessible to standard cameras.