Human-in-the-loop agent-based simulation for improved autonomous surveillance using unmanned vehicles

Sara Minaeian, Yifei Yuan, Jian Liu, Young Jun Son

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations


The goal of this work is to propose a hardware-in-the-loop, human-in-the-loop agent-based simulation which incorporates the human crowd characteristics and behaviors captured by computer vision techniques, for an effective crowd control using unmanned vehicles (UVs). Three major functions needed in our autonomous surveillance system include: 1) detection, 2) modeling, and 3) tracking. The proposed simulation communicates with the crowd detection module in the UVs' onboard computer in real-time, developing plans for a number of simulated crowd-individuals based on the parameters extracted from real crowds. Next, the social-force-based crowd modeling is used in the simulation to interpolate waypoints for moving the simulated individuals to their planned destinations. Finally, these waypoints are sent to the tracking module for a more realistic prediction of crowd's future location for the UVs' path planning purposes. Preliminary results reveal significant improvements in performance measures for this human-inthe-loop simulation, which demonstrate the effectiveness of the proposed methodology.

Original languageEnglish (US)
Title of host publication2015 Winter Simulation Conference, WSC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages2
ISBN (Electronic)9781467397438
StatePublished - Feb 16 2016
EventWinter Simulation Conference, WSC 2015 - Huntington Beach, United States
Duration: Dec 6 2015Dec 9 2015

Publication series

NameProceedings - Winter Simulation Conference
ISSN (Print)0891-7736


OtherWinter Simulation Conference, WSC 2015
Country/TerritoryUnited States
CityHuntington Beach

ASJC Scopus subject areas

  • Software
  • Modeling and Simulation
  • Computer Science Applications


Dive into the research topics of 'Human-in-the-loop agent-based simulation for improved autonomous surveillance using unmanned vehicles'. Together they form a unique fingerprint.

Cite this