Automation in Construction · 2024 · 17 citations · 25 references
EngineeringAutonomous SystemsCivil EngineeringMachine LearningTunnel EngineeringTunneling EngineeringPolicy LearningReinforcement LearningReward DesignTunnel Boring Machine EngineeringTunnel Boring Machine OperationTunnel Excavation MethodsAgent LearningExcavationPredictive Maintenance For Tunnel Boring MachinesPredictive Maintenance StrategyReinforcementTunnel BoringTunnel Boring MachinesWear Simulation
Optimizing the cutter changing process for tunnel boring machines (TBMs) is crucial for minimizing maintenance costs and maximizing excavation efficiency. This paper introduces TunnRL-CC, a computational framework that utilizes reinforcement learning to autonomously determine cutter-changing strategies. TunnRL-CC's realistic simulation models cutter wear under varying rock conditions, including hard rock and blockyness. A reinforcement learning agent is trained to learn optimal cutter-changing policies based on a reward function that balances cutter conditions and operational costs. The agent demonstrates innovative decision-making, adapting to changing excavation conditions. TunnRL-CC's proposed methodology significantly differs from traditional cutter changing practices, which rely heavily on operator experience. Although TunnRL-CC has not been applied in practical projects, its theoretical basis and comprehensive computational experiments demonstrate its capability to significantly improve TBM cutter maintenance procedures. • A cutter wear simulation for hard rock tunnel boring machine advance was developed. • A predictive maintenance system for TBM cutters is implemented. • The system is reinforcement learning based and parameter optimization was done. • The learned cutter changing policy considers geotechnical and economic conditions.
25
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations