TY - JOUR
T1 - Learning to Guide
T2 - Guidance Law Based on Deep Meta-Learning and Model Predictive Path Integral Control
AU - Liang, Chen
AU - Wang, Weihong
AU - Liu, Zhenghua
AU - Lai, Chao
AU - Zhou, Benchun
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2019
Y1 - 2019
N2 - In this paper, we present a novel guidance scheme based on model-based deep reinforcement learning (RL) technique. With model-based deep RL method, a deep neural network is trained as a predictive model of guidance dynamics which is incorporated into a model predictive path integral (MPPI) control framework. However, the traditional MPPI framework assumes the actual environment similar to the training dataset for the deep neural network which is impractical in practice with different maneuvering of the target, other perturbations, and actuator failures. To address this problem, our method utilizes meta-learning technique to make the deep neural dynamics model adapt to such changes online. With this approach, we can alleviate the performance deterioration of standard MPPI control caused by the difference between the actual environment and training data. Then, a novel guidance law for a varying velocity interceptor intercepting maneuvering target with desired terminal impact angle under actuator failure is constructed based on the aforementioned techniques. The simulation and experiment results under different cases show the effectiveness and robustness of the proposed guidance law in achieving successful interceptions of maneuvering target.
AB - In this paper, we present a novel guidance scheme based on model-based deep reinforcement learning (RL) technique. With model-based deep RL method, a deep neural network is trained as a predictive model of guidance dynamics which is incorporated into a model predictive path integral (MPPI) control framework. However, the traditional MPPI framework assumes the actual environment similar to the training dataset for the deep neural network which is impractical in practice with different maneuvering of the target, other perturbations, and actuator failures. To address this problem, our method utilizes meta-learning technique to make the deep neural dynamics model adapt to such changes online. With this approach, we can alleviate the performance deterioration of standard MPPI control caused by the difference between the actual environment and training data. Then, a novel guidance law for a varying velocity interceptor intercepting maneuvering target with desired terminal impact angle under actuator failure is constructed based on the aforementioned techniques. The simulation and experiment results under different cases show the effectiveness and robustness of the proposed guidance law in achieving successful interceptions of maneuvering target.
KW - Deep reinforcement learning
KW - Impact angle constraint
KW - Meta-learning
KW - Missile guidance
KW - Model predictive control
UR - https://www.scopus.com/pages/publications/85065077154
U2 - 10.1109/ACCESS.2019.2909579
DO - 10.1109/ACCESS.2019.2909579
M3 - 文章
AN - SCOPUS:85065077154
SN - 2169-3536
VL - 7
SP - 47353
EP - 47365
JO - IEEE Access
JF - IEEE Access
M1 - 8682051
ER -