山东科学 ›› 2023, Vol. 36 ›› Issue (3): 108-114.doi: 10.3976/j.issn.1002-4026.2023.03.013

• 交通运输 • 上一篇    下一篇

基于强化学习的沥青路面长期性能养护决策方法

侯明业(), 王晓阳*(), 徐青杰, 杨博, 王笑风   

  1. 河南省交通规划设计研究院股份有限公司,河南 郑州 450000
  • 收稿日期:2022-08-13 出版日期:2023-06-20 发布日期:2023-06-07
  • 通信作者: * 王晓阳(1992—),男,硕士,工程师,研究方向为道路材料与信息化。E-mail: xywanghn@163.com
  • 作者简介:侯明业(1990—),男,硕士,工程师,研究方向为道路材料与信息化。E-mail: lkwy1234@qq.com
  • 基金资助:
    河南省交通运输厅科技项目(2021T2);河南省交通运输厅科技项目(2021T8);河南省交通运输厅科技项目(2021G3)

Long-term performance maintenance decisions for asphalt pavements based on reinforcement learning

HOU Mingye(), WANG Xiaoyang*(), XU Qingjie, YANG Bo, WANG Xiaofeng   

  1. Henan Communications Planning & Design Institute Co., Ltd., Zhengzhou 450000, China
  • Received:2022-08-13 Online:2023-06-20 Published:2023-06-07

摘要:

针对道路长期性能养护决策中庞大的数据分析问题,将深度确定性策略梯度(deep deterministic policy gradient, DDPG)强化学习模型引入到了养护决策分析中,将道路性能的提升及养护资金的有效利用作为机器学习的奖励目标,建立了一套科学有效的沥青路面长期性能养护决策方法,经过与DQN(deep Q-learning network)算法和Q-Learning算法进行对比,DDPG算法所需要的采样数据更少、收敛速度更快,表现更为优异,可有效提升道路服役性能的评估效率,对沥青路面多目标长期养护决策方案的制定起着重要的推动作用。

关键词: 交通工程, 沥青路面, 养护决策, 强化学习, 深度确定性策略梯度模型

Abstract:

To address the huge data analysis problem in the decision-making for long-term road performance maintenance, this paper introduces the deep deterministic policy gradient (DDPG) reinforcement learning model in the maintenance decision analysis. A set of scientific and effective decision-making methods for long-term performance maintenance of asphalt pavements has been established through machine learning. These methods can improve road performance and make effective use of maintenance funds. Compared with the deep Q-learning network and Q-Learning algorithms, the DDPG algorithm requires less sampling data, converges faster, performs better, and can effectively improve the evaluation efficiency of the road service performance. Therefore, the proposed model plays an important role in the development of multi-objective maintenance decision-making for asphalt pavements.

Key words: traffic engineering, asphalt pavement, maintenance decision, reinforcement learning, deep deterministic policy gradient model

中图分类号: 

  • U411