Structured illumination microscopy with uncertainty quantification

Xiaoqin Zhu; Xuyang Chang; Rifa Zhao; Ze Wu; Shuai Wang; Qiang Jiao; Liheng Bian

doi:10.1117/12.2644122

4 January 2023 Structured illumination microscopy with uncertainty quantification

Xiaoqin Zhu, Xuyang Chang, Rifa Zhao, Ze Wu, Shuai Wang, Qiang Jiao, Liheng Bian

Proceedings Volume 12317, Optoelectronic Imaging and Multimedia Technology IX; 1231706 (2023) https://doi.org/10.1117/12.2644122
Event: SPIE/COS Photonics Asia, 2022, Online Only

Abstract

Deep learning shows great potential for super-resolution microscopy, offering biological structures visualization with unprecedented details and high flexibility. An effective pathway toward this goal is structured illumination microscopy (SIM) augmented by deep learning because of its ability to double the resolution beyond the light diffraction limit in real-time. Although the deep-learning-based SIM technique works effectively, it is generally a black box that is difficult to explain the latent principle. Thus, the generated super-resolution biological structures contain unconvinced information for clinical diagnosis. This limitation impedes its further applications in safety-critical fields like medical imaging. In this paper, we report a reliable deep-learning-based SIM technique with uncertainty maps. These uncertainty maps characterize imperfections in various disturbances, such as measurement noise, model error, incomplete training data, and out-of-distribution testing data. Specifically, we employ a Bayesian convolutional neural network to quantify uncertainty and explore its application in SIM. The backbone of the reported neural network is the combination of U-net and Res-net with three low-resolution images from different structured illumination angles as inputs. The outputs are high-resolution images with double resolution beyond the numerical aperture and the pixel-wise confidence intervals quantification of reconstruction images. A series of simulations and experiments validate that the reported uncertainty quantification framework offers reliable uncertainty maps and high-fidelity super resolution images. Our work may promote practical applications of deep-learning-based super-resolution microscopy.

Conference Presentation

Citation Download Citation

Xiaoqin Zhu, Xuyang Chang, Rifa Zhao, Ze Wu, Shuai Wang, Qiang Jiao, and Liheng Bian "Structured illumination microscopy with uncertainty quantification", Proc. SPIE 12317, Optoelectronic Imaging and Multimedia Technology IX, 1231706 (4 January 2023); https://doi.org/10.1117/12.2644122

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available