A cognitive camera system for increasing face recognition performance in backlit conditions

Gökhan Koray Gültekin; Mustafa Ergül; Aycan Doğa Hakyemez; Afşar Saranlı; Aydın Alatan; İhsan Emre Üstün

doi:10.1117/12.2638909

28 October 2022 A cognitive camera system for increasing face recognition performance in backlit conditions

Gökhan Koray Gültekin, Mustafa Ergül, Aycan Doğa Hakyemez, Afşar Saranlı, Aydın Alatan, İhsan Emre Üstün

Proceedings Volume 12275, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies VI; 122750C (2022) https://doi.org/10.1117/12.2638909
Event: SPIE Security + Defence, 2022, Berlin, Germany

Abstract

One of the most difficult challenges in counter-terrorism, crime fighting and surveillance mission is to accurately identify people from an image/video footage to catch shortlisted terrorists and criminals. For this purpose, imaging devices used in video surveillance systems are being improved in many aspects such as spatial resolution, frame rate, dynamic range, spectral characteristics in order to achieve better imaging performance for both monitoring and automatic detection/recognition tasks. These development efforts aim to improve the basic imaging characteristics of the device, such as the average amount of brightness/darkness of the video footage, irrespective of high-level semantic elements/knowledge such as presence and locations of monitored objects/individuals in the scene monitored by the camera. Nevertheless, strong local/global illumination variations in harsh environments result in high dynamic range in the scene and thus over-/underexposed regions in video frames. In this study, a cognitive imaging system prototype that will allow higher face recognition performance by taking into account the locations of automatically detected human faces in the scene and the local illumination conditions/dynamic range values is proposed with a developed/produced smart camera. This is achieved by developing a smart Auto-Exposure (AE) algorithm which use only the region of interest (ROI) to compute/measure the brightness of the video frame. The current ROI is selected by intelligently and sequentially traversing among the detected faces to effectively handle whole faces in the scene. The experimental results show that the proposed ”cognitive” camera can achieve a dramatic increase in accuracy performance over the normal camera in the face recognition task.

Citation Download Citation

Gökhan Koray Gültekin, Mustafa Ergül, Aycan Doğa Hakyemez, Afşar Saranlı, Aydın Alatan, and İhsan Emre Üstün "A cognitive camera system for increasing face recognition performance in backlit conditions", Proc. SPIE 12275, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies VI, 122750C (28 October 2022); https://doi.org/10.1117/12.2638909

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Imaging systems

Facial recognition systems

Automatic exposure

Detection and tracking algorithms

Light sources and illumination

Video

Show All Keywords

Keywords/Phrases

Search In:

Publication Years