Hybrid Discrete Differential Evolution and Deep Q-Network for Multimission Selective Maintenance

Abstract

The multimission selective maintenance problem (MSMP) for repairable systems has received increasing attention in recent years. The problem amounts to selecting a subset of feasible maintenance actions, in view of the resource limitations. For considering the realistic case of the imperfect maintenance, this article introduces a hybrid imperfect maintenance model, which is more realistic to evaluate the system reliability. The challenge of solving such kind of problems lies not only in the reliability estimation, but also in the solution method of the maintenance selection. Such decision-making problem can be effectively formulated using the Markov decision process, but it is difficult to apply current methods for solving the engineering systems with large action decision spaces. In order to solve this issue, this work puts forth a novel hybrid algorithm for the MSMP in a large multicomponent system. In the proposed method, a discrete differential evolution algorithm is developed for searching the optimal maintenance action in large-scale discrete action spaces and the deep Q-network method is utilized to approximate the effectiveness of maintenance actions and facilitate the agent training. The experiments, based on a large-scale coal transportation system, verify the effectiveness of the proposed method compared with LSDQN and differential evolution.