Paper
21 October 2015 Experimental application of simulation tools for evaluating UAV video change detection
Günter Saur, Jan Bartelsen
Author Affiliations +
Proceedings Volume 9653, Target and Background Signatures; 96530P (2015) https://doi.org/10.1117/12.2197348
Event: SPIE Security + Defence, 2015, Toulouse, France
Abstract
Change detection is one of the most important tasks when unmanned aerial vehicles (UAV) are used for video reconnaissance and surveillance. In this paper, we address changes on short time scale, i.e. the observations are taken within time distances of a few hours. Each observation is a short video sequence corresponding to the near-nadir overflight of the UAV above the interesting area and the relevant changes are e.g. recently added or removed objects. The change detection algorithm has to distinguish between relevant and non-relevant changes. Examples for non-relevant changes are versatile objects like trees and compression or transmission artifacts. To enable the usage of an automatic change detection within an interactive workflow of an UAV video exploitation system, an evaluation and assessment procedure has to be performed. Large video data sets which contain many relevant objects with varying scene background and altering influence parameters (e.g. image quality, sensor and flight parameters) including image metadata and ground truth data are necessary for a comprehensive evaluation. Since the acquisition of real video data is limited by cost and time constraints, from our point of view, the generation of synthetic data by simulation tools has to be considered. In this paper the processing chain of Saur et al. (2014) [1] and the interactive workflow for video change detection is described. We have selected the commercial simulation environment Virtual Battle Space 3 (VBS3) to generate synthetic data. For an experimental setup, an example scenario “road monitoring” has been defined and several video clips have been produced with varying flight and sensor parameters and varying objects in the scene. Image registration and change mask extraction, both components of the processing chain, are applied to corresponding frames of different video clips. For the selected examples, the images could be registered, the modelled changes could be extracted and the artifacts of the image rendering considered as noise (slight differences of heading angles, disparity of vegetation, 3D parallax) could be suppressed. We conclude that these image data could be considered to be realistic enough to serve as evaluation data for the selected processing components. Future work will extend the evaluation to other influence parameters and may include the human operator for mission planning and sensor control.
© (2015) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Günter Saur and Jan Bartelsen "Experimental application of simulation tools for evaluating UAV video change detection", Proc. SPIE 9653, Target and Background Signatures, 96530P (21 October 2015); https://doi.org/10.1117/12.2197348
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Video

Sensors

Video surveillance

Roads

Unmanned aerial vehicles

Image registration

Image sensors

RELATED CONTENT

Diffusion and NCC combined image registration
Proceedings of SPIE (May 16 2013)
Short-term change detection for UAV video
Proceedings of SPIE (November 08 2012)
Multimedia traffic monitoring system
Proceedings of SPIE (October 11 2000)

Back to Top