International Journal of Production Research · 2023 · 39 citations · 41 references
ComputingIndustrial EngineeringManufacturing EngineeringArtificial IntelligenceMarkov Decision ProcessesSchedulingMulti-objective SchedulingProduction SchedulingReal-time SchedulingReinforcement LearningScheduling TheoryTask SchedulingDeep Reinforcement LearningHeuristic SchedulingIntelligent Manufacturing SystemsMarkov Decision Process SchedulingQ-learningReinforcement Learning For SchedulingSteelmakingTime-of-use Tariffs
This paper proposes a novel intelligent scheduling method based on deep reinforcement learning (DRL) to solve the multi-objective steelmaking-continuous casting (SCC) scheduling problem, under time-of-use (TOU) tariffs for the first time. The intelligent scheduling system architecture is designed, and a mathematical model is established to minimise the total sojourn time and electricity cost. To effectively reduce production costs by avoiding peak periods of electricity consumption, the ‘start time’ of the system is generated based on the Markov Decision Process (MDP), and heuristic scheduling rules related to power cost are used as the action space, with corresponding reward functions designed according to the characteristics of these two objectives. To satisfy the continuous casting which is a particular SCC constraint, a backward strategy is developed. Additionally, a branching duelling double deep Q-network (BD3QN) is adapted to guide action selection and avoid blind search in the iteration process, and then applied to real-time scheduling. Numerical experiments demonstrate that the proposed method outperforms comparison algorithms in terms of solution quality and CPU times by a large margin.
41
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
A study on energy efficiency improvement for machine tools
M. Mori, Makoto Fujishima, Yasuhiro Inamasu et al. · CIRP Annals · 2011 · 506 citations
Engineering, Manufacturing Engineering, Mechanical Engineering +14
Min Dai, Dunbing Tang, Adriana Giret et al. · Robotics and Computer-Integrated Manufacturing · 2013 · 464 citations · Full text
Management, Industrial Engineering, Manufacturing Engineering +11