TY - JOUR
T1 - Effective and Efficient Detection of Moving Targets from a UAV's Camera
AU - Minaeian, Sara
AU - Liu, Jian
AU - Son, Young Jun
N1 - Funding Information:
Manuscript received February 28, 2017; revised August 11, 2017, October 1, 2017, and November 18, 2017; accepted December 2, 2017. Date of publication January 5, 2018; date of current version February 1, 2018. This work was supported by the Air Force Office of Scientific Research [a part of Dynamic Data-Driven Application Systems (DDDAS) projects] under Grant FA9550-17-1-0075. The Associate Editor for this paper was Q. Wang. (Corresponding author: Young-Jun Son.) The authors are with the Systems and Industrial Engineering Department, The University of Arizona, Tucson, AZ 85721 USA (e-mail: minaeian@email.arizona.edu; jianliu@sie.arizona.edu; son@sie.arizona.edu).
Publisher Copyright:
© 2000-2011 IEEE.
PY - 2018/2
Y1 - 2018/2
N2 - Accurate and fast detection of the moving targets from a moving camera are an important yet challenging problem, especially when the computational resources are limited. In this paper, we propose an effective, efficient, and robust method to accurately detect and segment multiple independently moving foreground targets from a video sequence taken by a monocular moving camera [e.g., onboard an unmanned aerial vehicle (UAV)]. Our proposed method advances the existing methods in a number of ways, where: 1) camera motion is estimated through tracking background keypoints using pyramidal Lucas-Kanade at every detection interval, for efficiency; 2) foreground segmentation is applied by integrating a local motion history function with spatio-Temporal differencing over a sliding window for detecting multiple moving targets, while the perspective homography is used at image registration for effectiveness; and 3) the detection interval is adjusted dynamically based on a rule-of-Thumb technique and considering camera setup parameters for robustness. The proposed method has been tested on a variety of scenarios using a UAV camera, as well as publically available data sets. Based on the reported results and through comparison with the existing methods, the accuracy of the proposed method in detecting multiple moving targets as well as its capability for real-Time implementation has been successfully demonstrated. Our method is also robustly applicable to ground-level cameras for the ITS applications, as confirmed by the experimental results. More specifically, the proposed method shows promising performance compared with the literature in terms of quantitative metrics, while the run-Time measures are significantly improved for real-Time implementation.
AB - Accurate and fast detection of the moving targets from a moving camera are an important yet challenging problem, especially when the computational resources are limited. In this paper, we propose an effective, efficient, and robust method to accurately detect and segment multiple independently moving foreground targets from a video sequence taken by a monocular moving camera [e.g., onboard an unmanned aerial vehicle (UAV)]. Our proposed method advances the existing methods in a number of ways, where: 1) camera motion is estimated through tracking background keypoints using pyramidal Lucas-Kanade at every detection interval, for efficiency; 2) foreground segmentation is applied by integrating a local motion history function with spatio-Temporal differencing over a sliding window for detecting multiple moving targets, while the perspective homography is used at image registration for effectiveness; and 3) the detection interval is adjusted dynamically based on a rule-of-Thumb technique and considering camera setup parameters for robustness. The proposed method has been tested on a variety of scenarios using a UAV camera, as well as publically available data sets. Based on the reported results and through comparison with the existing methods, the accuracy of the proposed method in detecting multiple moving targets as well as its capability for real-Time implementation has been successfully demonstrated. Our method is also robustly applicable to ground-level cameras for the ITS applications, as confirmed by the experimental results. More specifically, the proposed method shows promising performance compared with the literature in terms of quantitative metrics, while the run-Time measures are significantly improved for real-Time implementation.
KW - Effectiveness
KW - image motion analysis
KW - object detection
KW - robustness
KW - unmanned aerial vehicles
UR - http://www.scopus.com/inward/record.url?scp=85041170518&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85041170518&partnerID=8YFLogxK
U2 - 10.1109/TITS.2017.2782790
DO - 10.1109/TITS.2017.2782790
M3 - Article
AN - SCOPUS:85041170518
SN - 1524-9050
VL - 19
SP - 497
EP - 506
JO - IEEE Transactions on Intelligent Transportation Systems
JF - IEEE Transactions on Intelligent Transportation Systems
IS - 2
M1 - 8248663
ER -