Depth-NLOS: surface detail reconstruction from depth information in non-line-of-sight imaging

Kang Meng; Fengchang Miao; Hao Liu

doi:10.1117/12.3047204

13 December 2024 Depth-NLOS: surface detail reconstruction from depth information in non-line-of-sight imaging

Kang Meng, Fengchang Miao, Hao Liu

Proceedings Volume 13501, AOPC 2024: Computational Imaging Technology; 1350109 (2024) https://doi.org/10.1117/12.3047204
Event: Applied Optics and Photonics China 2024 (AOPC2024), 2024, Beijing, China

Abstract

Non-Line-of-Sight Imaging (NLOS Imaging) is an advanced technique designed to capture images of scenes that are not directly visible to the camera. This method leverages transient sensors to collect time-resolved signals, enabling the reconstruction of hidden scenes. Traditional NLOS imaging techniques rely solely on surface normals rather than depth information to represent implicit surfaces. This limitation results in less accurate refinement of the surface features of reconstructed objects. To address this issue, our research introduces a novel neural implicit learning approach that incorporates depth information for optimization. By integrating depth data, we achieve more precise surface reconstruction in NLOS environments. The process involves extracting depth information through the fusion of albedo plots obtained from different perspectives, which are generated by transient images and optical flow. This combined data enhances the accuracy and quality of the reconstructed images. Additionally, we introduce a depth loss component to facilitate smoother reconstruction of object surfaces while simultaneously constraining the Signed Distance Function (SDF) regression. This dual approach ensures that the reconstructed surfaces are both smooth and accurately defined. Our method has been rigorously tested on both synthetic and real datasets, and the experimental results demonstrate its superiority over existing techniques. Our approach consistently delivers high-quality reconstructions of hidden objects in various scenarios, outperforming current methods in terms of precision and detail.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Kang Meng, Fengchang Miao, and Hao Liu "Depth-NLOS: surface detail reconstruction from depth information in non-line-of-sight imaging", Proc. SPIE 13501, AOPC 2024: Computational Imaging Technology, 1350109 (13 December 2024); https://doi.org/10.1117/12.3047204

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Non line of sight propagation

Image restoration

Optical flow

Cameras

Single photon avalanche diodes

Reflection

Relays

Show All Keywords

Keywords/Phrases

Search In:

Publication Years