Single-pixel imaging with TCAO and untrained neural network

Jinyi Deng; Shuang Yu; Wenqing Hong; Xiaojun Li; Haoteng Yin

doi:10.1117/12.3048060

13 December 2024 Single-pixel imaging with TCAO and untrained neural network

Jinyi Deng, Shuang Yu, Wenqing Hong, Xiaojun Li, Haoteng Yin

Proceedings Volume 13501, AOPC 2024: Computational Imaging Technology; 135010G (2024) https://doi.org/10.1117/12.3048060
Event: Applied Optics and Photonics China 2024 (AOPC2024), 2024, Beijing, China

Abstract

Single-pixel imaging (SPI) is a rapidly evolving computational imaging technique that reconstructs scenes by correlating modulation patterns with measurements captured by a single-pixel detector. Recent advances suggest that integrating model-driven deep learning can significantly enhance the reconstruction quality and robustness of SPI. However, current model-driven SPI methods often rely on ghost imaging (DGI) with random speckles as network input, requiring deeper reconstruction networks to extract effective features, which increases the computational cost. Additionally, random speckles can cause important image details to be obscured by noise at lower sampling rates, making it challenging for the network to produce satisfactory reconstructions. To overcome these limitations, we propose a model-driven SPI method that utilizes an optimized sorting of the Hadamard matrix, termed Total Change Ascending Order (TCAO), as the modulation mask, coupled with an untrained convolutional neural network (CNN) for reconstruction. TCAO is designed to more effectively extract information from scenes at lower sampling rates. The core innovation is integrating deep learning principles across the entire imaging process, assigning more feature extraction tasks to the modulation stage. We refer to this approach as Deep Learning-Based Single-Pixel Imaging with Efficient Sampling (DLES). Simulation results show that DLES allows the network to focus on enhancing reconstruction performance, yielding superior results at lower and even extremely low sampling rates. This method provides a novel approach to simplifying model-driven neural networks while improving the efficiency and quality of single-pixel imaging.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Jinyi Deng, Shuang Yu, Wenqing Hong, Xiaojun Li, and Haoteng Yin "Single-pixel imaging with TCAO and untrained neural network", Proc. SPIE 13501, AOPC 2024: Computational Imaging Technology, 135010G (13 December 2024); https://doi.org/10.1117/12.3048060

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Matrices

Modulation

Image restoration

Sampling rates

Feature extraction

Neural networks

Deep learning

Show All Keywords

Keywords/Phrases

Search In:

Publication Years