IEEE Robotics and Automation Letters · 2023 · 32 citations · 18 references
ComputingComputer ScienceRobotics EngineeringArtificial IntelligenceMachine LearningRoboticsDeep LearningNeural NetworksOptimal ControlPolicy LearningReinforcement LearningActor ModelActor NetworksDeep Reinforcement LearningEnergy ConsumptionHybrid ReinforcementPolicy GradientsReinforcement Learning For RoboticsSpiking Neural Network Models
The increasing demand for applications in competitive fields, such as assisted living and aerial robots, drives contemporary research into the development, implementation and integration of power-constrained solutions. Although, deep neural networks (DNNs) have achieved remarkable performances in many robotics applications, energy consumption remains a major limitation. The letter at hand proposes a hybrid variation of the well-established deep deterministic policy gradient (DDPG) reinforcement learning approach to train a 6 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$^{\circ }$</tex-math></inline-formula> of freedom robotic arm in the target-reach task available at: In particular, we introduce a spiking neural network (SNN) for the actor model and a DNN for the critic one, aiming to find an optimal set of actions for the robot. The deep critic network is employed only during training and discarded afterwards, allowing the deployment of the SNN in neuromorphic hardware for inference. The agent is supported by a combination of RGB and laser scan data exploited for collision avoidance and object detection. We compare the hybrid-DDPG model against a classic DDPG one, demonstrating the superiority of our approach.
18
Simple model of spiking neurons
Eugene M. Izhikevich · IEEE Transactions on Neural Networks · 2003 · 4.8K citations
Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks
Yujie Wu, Lei Deng, Guoqi Li et al. · Frontiers in Neuroscience · 2018 · 1.1K citations · Full text
Deep Learning in Neural Networks: An Overview
arXiv (Cornell University) · 2014 · 510 citations · Full text