An Applied Study of Improved Deep Q-Networks for Marine Path Planning

Pengcheng Li; Bingyang Liang; Qiang Ren; Yuanguo Zhou

doi:10.1109/CSRSWTC60855.2023.10427271

An Applied Study of Improved Deep Q-Networks for Marine Path Planning

Pengcheng Li
, Bingyang Liang
, Qiang Ren
, Yuanguo Zhou^*

^*此作品的通讯作者

电子信息工程学院

Xi'an University of Science and Technology

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

This study tackles challenges in maritime path planning, a key concern in industries like shipping and offshore oil, by introducing an enhanced Deep Q-Network (DQN) that incorporates Navigational Priority (NP) and Priority Experience Replay (PER). Utilizing a Gym-based simulation, the enhanced DQN outperforms traditional and baseline methods in both path optimization and computational efficiency, validating the use of Priority Experience Replay and suggesting new avenues for addressing complex problems.

源语言	英语
主期刊名	Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023
出版商	Institute of Electrical and Electronics Engineers Inc.
ISBN（电子版）	9798350358971
DOI	https://doi.org/10.1109/CSRSWTC60855.2023.10427271
出版状态	已出版 - 2023
活动	2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023 - Guilin, 中国期限: 10 11月 2023 → 13 11月 2023

出版系列

姓名	Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023

会议

会议	2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023
国家/地区	中国
市	Guilin
时期	10/11/23 → 13/11/23

联合国可持续发展目标

此成果有助于实现下列可持续发展目标：

可持续发展目标 14 水下生物

访问文件

10.1109/CSRSWTC60855.2023.10427271

其它文件与链接

链接到 Scopus 的出版物

引用此

Li, P., Liang, B., Ren, Q., & Zhou, Y. (2023). An Applied Study of Improved Deep Q-Networks for Marine Path Planning. 在 Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023 (Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CSRSWTC60855.2023.10427271

Li, Pengcheng ; Liang, Bingyang ; Ren, Qiang 等. / An Applied Study of Improved Deep Q-Networks for Marine Path Planning. Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023. Institute of Electrical and Electronics Engineers Inc., 2023. (Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023).

@inproceedings{dc3df62583084fefa79fc1f79343db85,

title = "An Applied Study of Improved Deep Q-Networks for Marine Path Planning",

abstract = "This study tackles challenges in maritime path planning, a key concern in industries like shipping and offshore oil, by introducing an enhanced Deep Q-Network (DQN) that incorporates Navigational Priority (NP) and Priority Experience Replay (PER). Utilizing a Gym-based simulation, the enhanced DQN outperforms traditional and baseline methods in both path optimization and computational efficiency, validating the use of Priority Experience Replay and suggesting new avenues for addressing complex problems.",

keywords = "Improved deep Q-network, Maritime simulation environment, Navigational Priority, Obstacle avoidance mechanism",

author = "Pengcheng Li and Bingyang Liang and Qiang Ren and Yuanguo Zhou",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023 ; Conference date: 10-11-2023 Through 13-11-2023",

year = "2023",

doi = "10.1109/CSRSWTC60855.2023.10427271",

language = "英语",

series = "Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023",

address = "美国",

}

Li, P, Liang, B, Ren, Q & Zhou, Y 2023, An Applied Study of Improved Deep Q-Networks for Marine Path Planning. 在 Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023. Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023, Institute of Electrical and Electronics Engineers Inc., 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023, Guilin, 中国, 10/11/23. https://doi.org/10.1109/CSRSWTC60855.2023.10427271

An Applied Study of Improved Deep Q-Networks for Marine Path Planning. / Li, Pengcheng; Liang, Bingyang; Ren, Qiang 等.
Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023. Institute of Electrical and Electronics Engineers Inc., 2023. (Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023).

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

TY - GEN

T1 - An Applied Study of Improved Deep Q-Networks for Marine Path Planning

AU - Li, Pengcheng

AU - Liang, Bingyang

AU - Ren, Qiang

AU - Zhou, Yuanguo

PY - 2023

Y1 - 2023

N2 - This study tackles challenges in maritime path planning, a key concern in industries like shipping and offshore oil, by introducing an enhanced Deep Q-Network (DQN) that incorporates Navigational Priority (NP) and Priority Experience Replay (PER). Utilizing a Gym-based simulation, the enhanced DQN outperforms traditional and baseline methods in both path optimization and computational efficiency, validating the use of Priority Experience Replay and suggesting new avenues for addressing complex problems.

AB - This study tackles challenges in maritime path planning, a key concern in industries like shipping and offshore oil, by introducing an enhanced Deep Q-Network (DQN) that incorporates Navigational Priority (NP) and Priority Experience Replay (PER). Utilizing a Gym-based simulation, the enhanced DQN outperforms traditional and baseline methods in both path optimization and computational efficiency, validating the use of Priority Experience Replay and suggesting new avenues for addressing complex problems.

KW - Improved deep Q-network

KW - Maritime simulation environment

KW - Navigational Priority

KW - Obstacle avoidance mechanism

UR - https://www.scopus.com/pages/publications/85186511729

U2 - 10.1109/CSRSWTC60855.2023.10427271

DO - 10.1109/CSRSWTC60855.2023.10427271

M3 - 会议稿件

AN - SCOPUS:85186511729

T3 - Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023

BT - Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023

Y2 - 10 November 2023 through 13 November 2023

ER -

Li P, Liang B, Ren Q, Zhou Y. An Applied Study of Improved Deep Q-Networks for Marine Path Planning. 在 Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023. Institute of Electrical and Electronics Engineers Inc. 2023. (Proceedings - 2023 Cross Strait Radio Science and Wireless Technology Conference, CSRSWTC 2023). doi: 10.1109/CSRSWTC60855.2023.10427271

An Applied Study of Improved Deep Q-Networks for Marine Path Planning

摘要

出版系列

会议

联合国可持续发展目标

访问文件

其它文件与链接

指纹

引用此