2023 · 18 citations · 8 references
ComputingComputer EngineeringComputer ScienceComputer VisionMachine LearningSpacecraft DesignData CompressionDeep LearningDigital Image ProcessingHardware AccelerationImage CompressionPattern RecognitionAutoencodersComputer Vision AccelerationDeep Learning AccelerationDeep Learning AcceleratorsFew-shot LearningMachine Learning AccelerationModel CompressionReal-time Decision Making
Artificial intelligence onboard satellites has the potential to reduce data transmission requirements, enable real-time decision-making and collaboration within constellations. This study deploys a lightweight foundational model called RaVAEn on D-Orbit’s ION SCV004 satellite. RaVAEn is a variational auto-encoder (VAE) that generates compressed latent vectors from small image tiles, enabling several downstream tasks. In this work we demonstrate the reliable use of RaVAEn onboard a satellite, achieving an encoding time of 0.110s for tiles of a 4.8x4.8 km <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> area. In addition, we showcase fast few-shot training onboard a satellite using the latent representation of data. We compare the deployment of the model on the on-board CPU and on the available Myriad vision processing unit (VPU) accelerator. To our knowledge, this work shows for the first time the deployment of a multitask model onboard a CubeSat and the onboard training of a machine learning model.
8
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text
J. F. Bell, A. Godber, Sean McNair et al. · Earth and Space Science · 2017 · 174 citations · Full text
Natural Sciences, Mechatronics Engineering, Digital Imaging +14