Application of Reinforcement Learning to Deep Brain Stimulation in a Computational Model of Parkinson’s Disease

Abstract

Deep brain stimulation (DBS) has been proven to be an effective treatment to deal with the symptoms of Parkinson's disease (PD). Currently, the DBS is in an open-loop pattern with which the stimulation parameters remain constant regardless of fluctuations in the disease state, and adjustments of parameters rely mostly on trial and error of experienced clinicians. This could bring adverse effects to patients due to possible overstimulation. Thus closed-loop DBS of which stimulation parameters are automatically adjusted based on variations in the ongoing neurophysiological signals is desired. In this paper, we present a closed-loop DBS method based on reinforcement learning (RL) to regulate stimulation parameters based on a computational model. The network model consists of interconnected biophysically-based spiking neurons, and the PD state is described as distorted relay reliability of thalamus (TH). Results show that the RL-based closed-loop control strategy can effectively restore the distorted relay reliability of the TH but with less DBS energy expenditure.