GUAN W, QU S, ZHANG X K, et al. Ship global path planning based on improved DQN algorithm[J]. Chinese Journal of Ship Research, 2025, 20(1): 107–114 (in both Chinese and English). DOI: 10.19693/j.issn.1673-3185.03866
Citation: GUAN W, QU S, ZHANG X K, et al. Ship global path planning based on improved DQN algorithm[J]. Chinese Journal of Ship Research, 2025, 20(1): 107–114 (in both Chinese and English). DOI: 10.19693/j.issn.1673-3185.03866

Ship global path planning based on improved DQN algorithm

  • Objective In order to improve the economy and safety of ship navigation path in actual sea environment, this paper proposes a ship global path planning method with an improved Deep Q-Network (DQN) algorithm.
    Method First, a prioritized experience replay (PER) mechanism is introduced to the DQN to give higher weights to important samples and improve learning efficiency. Next, its network structure is improved through a duel network and noise network, enabling it to evaluate the values of specific states and actions more accurately and generalization capabilities.
    Result An experiment is carried out in the marine environment near Manila, and the results show that compared with the A* algorithm and DQN algorithm, the improved algorithm reduces the path length by 1.9% and 1.0% respectively, and the number of turning points by 62.5% and 25% respectively.
    Conclusion It is verified that the improved DQN algorithm can plan the effective path more economically and rationally.
  • loading

Catalog

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return