On-Device Training of Deep Learning Models on Edge Microcontrollers

Abstract

Recent advancements in Artificial Intelligence (AI) together with the increase of device computational power catalyzed the widespread diffusion of Intelligent Cyber Physical Systems (ICPSs) as a novel solution to run smart applications where the inference is performed on the Micro Controller Unit (MCU). Unfortunately, the hardware constraints of these devices limit the tasks that can be accomplished, for this reason, most of the times hybrid Cloud/Edge approaches have been proposed to enable the offloading of those operations (e.g., the training of deep learning models) that would not fit the computation, memory, and energy requirements. However, when security, latency, and connection stability aspects are relevant, it is clear that the use of such an approach is no longer suitable. This becomes even more evident in those contexts where it is asked the detection of new data patterns that can emerge over time. Focusing our attention on the analysis of time series data, in this paper we propose a novel Echo State Network (ESN) model that enables the on-device training directly on the MCUs of the STM32 family. Starting from a custom layer implementation on Keras, we extended the functionalities of the X-CUBE-AI tool provided by STMicroelectronics to recognize this type of network and enable the automatic deployment on the smart boards. To test the proposed solution, we realized a testbed and conducted a set of experiments that demonstrate the feasibility of our MCU on-device training approach which reached a good level of precision, recall, and F1-score.