TY - GEN
T1 - Waypoint-Based generalized ZEM/ZEV feedback guidance for planetary landing via a reinforcement learning approach
AU - Furfaro, Roberto
AU - Linares, Richard
N1 - Publisher Copyright:
© 2017 Univelt Inc. All rights reserved.
PY - 2017
Y1 - 2017
N2 - Precision landing on large planetary bodies is a critical technology for future human and robotic exploration of the solar system. Indeed, over the past decade, landing systems for robotic Mars missions have been developed with the specific goal of deploying robotic agents (e.g. rovers, landers) on the Martian surface. In this paper, we proposed a novel algorithm that can generate powered, closedloop trajectories to enforce flight constraints (e.g. no crashing on slope surfaces) while ensuring precision landing. More specifically, we propose a waypointbased ZEM/ZEV algorithm that employs a dynamic programming approach via Value Iteration to determine the best location of the waypoints for a set of constrained landing over large planetary bodies (e.g. Moon and Mars). Here, the Reinforcement Learning (RL) framework is employed to integrate ZEM/ZEV with a waypoint selection policy as function of the current state of the spacecraft during the powered descent phase (i.e. position and velocity). Here, a set of openloop, constrained, fuel-efficient trajectories are numerically computed using pseudo-spectral methods. A set of states from the open-loop optimal trajectories are stored as candidate waypoints. The latter are employed by the ZEM/ZEV algorithm as intermediate targets to steer the spacecraft toward the final target point on the planetary surface. The problem is cast as a Markov Decision Process (MDP) and the resulting dynamics programming problem is solved via generalized policy evaluation to select the next best intermediate target point as function of the previous one. The behavior of the integrated guidance algorithm is evaluated in Mars powered landing scenarios that involve demanding requirements both in landing location and flight path. Both constraints satisfaction and fuel efficiency are analyzed to show the effectiveness of the proposed approach.
AB - Precision landing on large planetary bodies is a critical technology for future human and robotic exploration of the solar system. Indeed, over the past decade, landing systems for robotic Mars missions have been developed with the specific goal of deploying robotic agents (e.g. rovers, landers) on the Martian surface. In this paper, we proposed a novel algorithm that can generate powered, closedloop trajectories to enforce flight constraints (e.g. no crashing on slope surfaces) while ensuring precision landing. More specifically, we propose a waypointbased ZEM/ZEV algorithm that employs a dynamic programming approach via Value Iteration to determine the best location of the waypoints for a set of constrained landing over large planetary bodies (e.g. Moon and Mars). Here, the Reinforcement Learning (RL) framework is employed to integrate ZEM/ZEV with a waypoint selection policy as function of the current state of the spacecraft during the powered descent phase (i.e. position and velocity). Here, a set of openloop, constrained, fuel-efficient trajectories are numerically computed using pseudo-spectral methods. A set of states from the open-loop optimal trajectories are stored as candidate waypoints. The latter are employed by the ZEM/ZEV algorithm as intermediate targets to steer the spacecraft toward the final target point on the planetary surface. The problem is cast as a Markov Decision Process (MDP) and the resulting dynamics programming problem is solved via generalized policy evaluation to select the next best intermediate target point as function of the previous one. The behavior of the integrated guidance algorithm is evaluated in Mars powered landing scenarios that involve demanding requirements both in landing location and flight path. Both constraints satisfaction and fuel efficiency are analyzed to show the effectiveness of the proposed approach.
UR - http://www.scopus.com/inward/record.url?scp=85046338662&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85046338662&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85046338662
SN - 9780877036432
T3 - Advances in the Astronautical Sciences
SP - 401
EP - 416
BT - Dynamics and Control of Space Systems, DyCoSS 2017
A2 - Razoumny, Yury N.
A2 - Contant, Jean-Michel
A2 - Guerman, Anna D.
A2 - Graziani, Filippo
PB - Univelt Inc.
T2 - 3rd International Academy of Astronautics Conference on Dynamics and Control of Space Systems, DyCoSS 2017
Y2 - 30 May 2017 through 1 June 2017
ER -