This will count as one of your downloads.
You will have access to both the presentation and article (if available).
In this study, we develop an object detector for 15 vehicle classes, containing similar appearing types, such as multiple battle tanks and howitzers. We show that combining few real data samples with a large amount of simulated data (12,000 images) leads to a significant improvement in comparison with using one of these sources individually. Adding just two samples per class improves the mAP to 55.9 [±2.6], compared to 33.8 [±0.7] when only simulated data is used. Further improvements are achieved by adding more real samples and using Grounding DINO, a foundation model pretrained on vast amounts of data (mAP = 90.1 [±0.5]). In addition, we investigate the effect of simulation variation, which we find is important even when more real samples are available.
In our current research, we propose a ‘maritime detection framework 2.0’, in which multi-platform sensors are combined with detection algorithms. In this paper, we present a comparison of detection algorithms for EO sensors within our developed framework and quantify the performance of this framework on representative data.
Automatic detection can be performed within the proposed framework in three ways: 1) using existing detectors, such as detectors based on movement or local intensities; 2) using a newly developed detector based on saliency on the scene level; and 3) using a state-of-the-art deep learning method. After detection, false alarms are suppressed using consecutive tracking approaches. The performance of these detection methods is compared by evaluating the detection probability versus the false alarm rate for realistic multi-sensor data.
New types of maritime targets require new target detection strategies. Combining new detection strategies with existing tracking technologies shows potential increase in detection performance of the complete framework.
In this paper we show results of this processing chain for sea scenarios using our TNO turbulence mitigation method. Ship data is processed using the algorithm proposed above and the results are analyzed by both human observation and by image analysis. The improvement of the imagery is qualitatively shown by examining details which cannot be seen without processing and can be seen with processing. Quantitatively, the improvement is related to the energy per spatial frequency in the original and processed images and the signal to noise improvement. This provides a model for the improvement of the results, and is related to the improvement of the classification and identification range. The results show that with this novel approach the classification and identification range of ships is improved.
Trackers make errors, for example, due to inaccuracies in detection, or motion that is not modeled correctly. Instead of improving this tracking using the limited information available from a single measurement, we propose a method where tracks are merged at a later stage, using information over a small interval. This merging is based on spatiotemporal matching. To limit incorrect connections, unlikely connections are identified and excluded. For this we propose two different approaches: spatiotemporal cost functions are used to exclude connections with unlikely motion and appearance cost functions are used to exclude connecting tracks of dissimilar objects. Next to this, spatiotemporal cost functions are also used to select tracks for merging. For the appearance filtering we investigated different descriptive features and developed a method for indicating similarity between tracks. This method handles variations in features due to noisy detections and changes in appearance.
We tested this method on real data with nine different targets. It is shown that track merging results in a significant reduction in number of tracks per ship. With our method we significantly reduce incorrect track merges that would occur using naïve merging functions.
View contact details
No SPIE Account? Create one
