Deep neural networks for single-pixel compressive video reconstruction

Antonio Lorente Mur; Bruno Montcel; Françoise Peyrin; Nicolas Ducros

doi:10.1117/12.2553326

15 April 2020 Deep neural networks for single-pixel compressive video reconstruction

Antonio Lorente Mur, Bruno Montcel, Françoise Peyrin, Nicolas Ducros

Proceedings Volume 11351, Unconventional Optical Imaging II; 113510S (2020) https://doi.org/10.1117/12.2553326
Event: SPIE Photonics Europe, 2020, Online Only

Abstract

Single-pixel imaging is a paradigm that enables the capture of an image from a single point detector using a spatial light modulator. This approach is particularly interesting for optical set-ups where pixelated arrays of detectors are either too expensive or too cumbersome (e.g., multispectral, infrared imaging). It acquires the inner product between the image of the scene and a set of user-defined patterns that are sequentially uploaded onto the spatial light modulator. Compressed data acquisition reduces the acquisition time, although it leads to an ill-posed reconstruction problem, which is very challenging for real-time applications. Recently, neural networks have emerged as competitive alternatives to traditional reconstruction methods. Neural networks are parametric models that are trained by exploiting large datasets. Their noniterative nature allows for fast reconstructions, which opens the door to real-time image reconstruction from compressed acquisition. In this study, we evaluate the different networks for static and dynamic imaging. In particular, we introduce a recurrent neural network that is designed to exploit the spatiotemporal redundancy in videos via a memory state. We validate our algorithms on simulated data from the UCF-101 dataset, with a resolution of 128x128 pixels and a compression ratio of 98%. We also show experimentally that we can resolve small spectral differences in the spectrum of human skin measured in vivo.

Conference Presentation

Citation Download Citation

Antonio Lorente Mur, Bruno Montcel, Françoise Peyrin, and Nicolas Ducros "Deep neural networks for single-pixel compressive video reconstruction", Proc. SPIE 11351, Unconventional Optical Imaging II, 113510S (15 April 2020); https://doi.org/10.1117/12.2553326

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available