Autonomous collision avoidance as a markov decision process

Hossein Rastgoftar; Xiangyu Ni; Ella M. Atkins

doi:10.1115/DSCC2016-9790

Autonomous collision avoidance as a markov decision process

Hossein Rastgoftar, Xiangyu Ni, Ella M. Atkins

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, we apply a Markov Decision Process (MDP) to assure collision avoidance and specify optimal paths for evolution of an agent with nonlinear dynamics. We consider evolution of an autonomous wheeled robot in a motion field where a malicious agent has stochastic transitions over the field. By knowing the history of malicious agent transition as well as initial and goal destinations of the autonomous robot, the optimal path is obtained using the Bellman equation. We propose a novel finite time controller that assures reachability of desired waypoints along the optimal path, where the optimal path is obtained without deriving the Hamiltonian.

Original language	English (US)
Title of host publication	Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control
Publisher	American Society of Mechanical Engineers
ISBN (Electronic)	9780791850701
DOIs	https://doi.org/10.1115/DSCC2016-9790
State	Published - 2016
Externally published	Yes
Event	ASME 2016 Dynamic Systems and Control Conference, DSCC 2016 - Minneapolis, United States Duration: Oct 12 2016 → Oct 14 2016

Publication series

Name	ASME 2016 Dynamic Systems and Control Conference, DSCC 2016
Volume	2

Conference

Conference	ASME 2016 Dynamic Systems and Control Conference, DSCC 2016
Country/Territory	United States
City	Minneapolis
Period	10/12/16 → 10/14/16

ASJC Scopus subject areas

Control and Systems Engineering
Industrial and Manufacturing Engineering
Mechanical Engineering

Access to Document

10.1115/DSCC2016-9790

Cite this

Rastgoftar, H., Ni, X., & Atkins, E. M. (2016). Autonomous collision avoidance as a markov decision process. In Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control (ASME 2016 Dynamic Systems and Control Conference, DSCC 2016; Vol. 2). American Society of Mechanical Engineers. https://doi.org/10.1115/DSCC2016-9790

Autonomous collision avoidance as a markov decision process. / Rastgoftar, Hossein; Ni, Xiangyu; Atkins, Ella M.
Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control. American Society of Mechanical Engineers, 2016. (ASME 2016 Dynamic Systems and Control Conference, DSCC 2016; Vol. 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Rastgoftar, H, Ni, X & Atkins, EM 2016, Autonomous collision avoidance as a markov decision process. in Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control. ASME 2016 Dynamic Systems and Control Conference, DSCC 2016, vol. 2, American Society of Mechanical Engineers, ASME 2016 Dynamic Systems and Control Conference, DSCC 2016, Minneapolis, United States, 10/12/16. https://doi.org/10.1115/DSCC2016-9790

Rastgoftar H, Ni X, Atkins EM. Autonomous collision avoidance as a markov decision process. In Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control. American Society of Mechanical Engineers. 2016. (ASME 2016 Dynamic Systems and Control Conference, DSCC 2016). doi: 10.1115/DSCC2016-9790

Rastgoftar, Hossein ; Ni, Xiangyu ; Atkins, Ella M. / Autonomous collision avoidance as a markov decision process. Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control. American Society of Mechanical Engineers, 2016. (ASME 2016 Dynamic Systems and Control Conference, DSCC 2016).

@inproceedings{13c72944d3a14096a153bda7efcb3f30,

title = "Autonomous collision avoidance as a markov decision process",

abstract = "In this paper, we apply a Markov Decision Process (MDP) to assure collision avoidance and specify optimal paths for evolution of an agent with nonlinear dynamics. We consider evolution of an autonomous wheeled robot in a motion field where a malicious agent has stochastic transitions over the field. By knowing the history of malicious agent transition as well as initial and goal destinations of the autonomous robot, the optimal path is obtained using the Bellman equation. We propose a novel finite time controller that assures reachability of desired waypoints along the optimal path, where the optimal path is obtained without deriving the Hamiltonian.",

author = "Hossein Rastgoftar and Xiangyu Ni and Atkins, {Ella M.}",

note = "Publisher Copyright: Copyright {\textcopyright} 2016 by ASME.; ASME 2016 Dynamic Systems and Control Conference, DSCC 2016 ; Conference date: 12-10-2016 Through 14-10-2016",

year = "2016",

doi = "10.1115/DSCC2016-9790",

language = "English (US)",

series = "ASME 2016 Dynamic Systems and Control Conference, DSCC 2016",

publisher = "American Society of Mechanical Engineers",

booktitle = "Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control",

}

TY - GEN

T1 - Autonomous collision avoidance as a markov decision process

AU - Rastgoftar, Hossein

AU - Ni, Xiangyu

AU - Atkins, Ella M.

PY - 2016

Y1 - 2016

N2 - In this paper, we apply a Markov Decision Process (MDP) to assure collision avoidance and specify optimal paths for evolution of an agent with nonlinear dynamics. We consider evolution of an autonomous wheeled robot in a motion field where a malicious agent has stochastic transitions over the field. By knowing the history of malicious agent transition as well as initial and goal destinations of the autonomous robot, the optimal path is obtained using the Bellman equation. We propose a novel finite time controller that assures reachability of desired waypoints along the optimal path, where the optimal path is obtained without deriving the Hamiltonian.

AB - In this paper, we apply a Markov Decision Process (MDP) to assure collision avoidance and specify optimal paths for evolution of an agent with nonlinear dynamics. We consider evolution of an autonomous wheeled robot in a motion field where a malicious agent has stochastic transitions over the field. By knowing the history of malicious agent transition as well as initial and goal destinations of the autonomous robot, the optimal path is obtained using the Bellman equation. We propose a novel finite time controller that assures reachability of desired waypoints along the optimal path, where the optimal path is obtained without deriving the Hamiltonian.

UR - http://www.scopus.com/inward/record.url?scp=85015699133&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015699133&partnerID=8YFLogxK

U2 - 10.1115/DSCC2016-9790

DO - 10.1115/DSCC2016-9790

M3 - Conference contribution

AN - SCOPUS:85015699133

T3 - ASME 2016 Dynamic Systems and Control Conference, DSCC 2016

BT - Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control

PB - American Society of Mechanical Engineers

T2 - ASME 2016 Dynamic Systems and Control Conference, DSCC 2016

Y2 - 12 October 2016 through 14 October 2016

ER -

Autonomous collision avoidance as a markov decision process

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this