A guidance method for coplanar orbital interception based on reinforcement learning

• 作者: ZENG Xin ZHU Yanwei YANG Leping ZHANG Chengming
• 来源期刊: 系统工程与电子技术（英文版）
• 年，卷（期）: 2021,（4）
• 所属期刊栏目: CONTROL THEORY AND APPLICATION
• 页码范围: 927-938
• 页数: 12页
• 语种: 英文
• DOI: 10.23919/JSEE.2021.000079

摘要

This paper investigates the guidance method based on reinforcement learning (RL) for the coplanar orbital intercep-tion in a continuous low-thrust scenario. The problem is formu-lated into a Markov decision process (MDP) model, then a well-designed RL algorithm, experience based deep deterministic policy gradient (EBDDPG), is proposed to solve it. By taking the advantage of prior information generated through the optimal control model, the proposed algorithm not only resolves the con-vergence problem of the common RL algorithm, but also suc-cessfully trains an efficient deep neural network (DNN) controller for the chaser spacecraft to generate the control sequence. Nu-merical simulation results show that the proposed algorithm is feasible and the trained DNN controller significantly improves the efficiency over traditional optimization methods by roughly two orders of magnitude.