|
1.IntroductionPhase-contrast imaging techniques play a pivotal role in advancing optical microscopic imaging as they are essential for biological samples that do not contain large quantities of natural pigments; thus, making them phase objects rather than amplitude objects.1 Staining and labeling techniques using fluorescent and other exogenous dyes have been adopted in several studies to obtain high-contrast images.2,3 However, these methods often require manipulation and interruption of the cell, resulting in destruction of the normal structure of the cell. Phase microscopy is an alternative technique that can be used to obtain higher contrast from phase objects using only optical means. This technique has become an important tool in many research fields, including biomedicine, material science, chemistry, and crystallography.4–6 Based on applied techniques, phase microscopy devices can be broadly divided into two categories. The first category is based on the Zernike phase contrast and differential intensity contrast (DIC) used to achieve a qualitative observation of the phase object. The second category is based on digital holographic microscopy (DHM) and the transport-of-intensity equation (TIE) used to achieve a quantitative phase measurement. Although the first category works with incoherent illumination and thus is convenient for most studies, the image obtained is not a direct phase distribution of the light field observed, hence it is not suitable for quantitative analysis. Further, this kind of microscope is critically dependent on the quality of its optical components.7–9 The second category of phase microscopes can provide quantitative information on the phase distribution of the transmitted or reflected light field. In DHM, the use of a reference beam makes the device complex and very sensitive to environmental disturbances. Speckle noise inevitably appears in most experiments because of the highly coherent illumination.10 TIE-based microscopy is much simpler than DHM in setup and can use incoherent illumination to measure the wave front.11 However, like DHM, TIE essentially measures the product of the illumination and the transmission function of the sample, thus the illumination errors cannot be excluded from the generated image. These limitations demand a kind of quantitative phase microscopy with a simple structure that is highly robust with regard to environmental disturbances. This type of microscopy would be beneficial in many interesting research applications. Ptychography-based microscopy is a recently developed technique that can achieve a highly accurate quantitative phase measurement using a very simple setup and has been adopted in some important biological studies.12–16 The most important advantage of ptychography is that the generated image is free from the illumination errors and aberrations of the illumination optics, which is not the case for other phase microscopes. However, in conventional ptychography, the sample is scanned via a mechanical translation stage to acquire the large amount of data that are necessary to achieve a high-quality reconstruction and large field of view (FOV). This process substantially slows down data acquisition. Thus, this form of ptychography is not suitable for imaging dynamic samples, such as fresh living cells or tissues (for example, early stage embryos of zebra fish). Fourier ptychographic microscopy (FPM) has been proposed to provide a wide FOV and high-resolution image of the sample, and this type of microscopy is implemented in the Fourier frequency domain, unlike real-space ptychography.17–23 Compared with FPM, the ptychography-based microscope has a much simpler structure, is easier to implement, and is compatible with most commercial microscopes, so it can provide a more flexible solution for phase-contrast microscopic imaging. However, a microscope based on mechanical scanning ptychography requires a time-consuming data acquisition process and substantial computation to obtain a high-quality reconstruction with position correction. Thus, any further improvements that can speedup data acquisition would make ptychography more relevant and applicable to address the current challenges of phase microscopy. In this paper, a moving pattern displayed on the spatial light modulator (SLM) was used to form a fast-changing illumination on the sample to scan the illumination beam over the sample while the detector could record diffraction patterns. Formulas similar to those used in conventional ptychography were used to reconstruct the modulus and phase distributions of the sample, the transmission function of the SLM, and the incident light field simultaneously. To verify the feasibility of the proposed method, a series of experiments and detailed numerical simulations were carried out, and results showed that the SLM was successfully integrated into a commercial transmission wide-field microscope to form a practical ptychography-based phase microscope that can achieve high-quality quantitative phase imaging. Compared with other phase-contrast microscopy, such as DIC and DHM, the proposed method has a simple structure, highly coherent noise immunity, and lower quality requirement for the optics. In addition, this method removes defects in the illumination beam from the reconstructed image. Because the data acquisition time is fundamentally decreased in this method, it can be used in applications that require measuring living cells or other biological samples, where high imaging speed is always preferred and a large FOV is not necessary. Although a large FOV is always welcome, it is not required in many studies. For example, in several cases, such as observing fresh cultured cells, a high-resolution and fast imaging speed are expected and required, rather than a large FOV. The proposed technique successfully reduced the data acquisition time to 2.8 s, and this time can be further reduced with a charge-coupled device (CCD) camera with random access memory (RAM). These improvements could make the system capable of measuring large numbers of samples in the regime of visible light microscopy. More importantly, this method does not change the original structure of the microscope, other than replacing the halogen lamp with a laser diode and placing an SLM in front of the sample, which makes it easy to transform any commercial light microscope into a phase microscope. 2.Description of the AlgorithmIn theory, the illumination on the SLM can be ideally regarded as a planar beam, and the transmission function of the SLM with moving patterns can be regarded as a known function. Then the imaging can be achieved with the common ptychography algorithm. However, in practice, these approximations seriously degrade the resolution and image quality because of some unexpected practical factors. To make the suggested method more practical, the sample, the moving pattern on the SLM, and the laser beam incident on the SLM all can be reconstructed simultaneously. This is convenient because distortion, optical aberrations, and inaccurate knowledge of the transmission function of the SLM no longer need to be considered. Figure 1 shows the schematic of the proposed method. A laser beam with a complex amplitude is incident on the SLM, and a preloaded picture on the SLM is moved in the and directions to form a series of complex transmission functions , where indicates the coordinate in the SLM plane and corresponds to position of the moved picture. The sample with a transmission function is located at a distance of behind the SLM, and a CCD camera is placed at a distance from the sample to record a set of diffraction pattern intensities when the picture is displayed at different positions on the SLM, where and are the coordinates of the sample and CCD plane, respectively. The iterative reconstruction begins with a random initial guess for the transmission function of the object, a uniform guess for the incident beam on the SLM, and a random initial guess of the transmission function of the SLM, where stands for the iteration number. The diffraction patterns are addressed by a sequence ( ranges from 1 to ). The reconstruction then iterates as follows:
Once the transmission function of the SLM and the illumination field are calibrated, and can be treated as known parameters for sample measurement. Hence, these two parameters do not need to be updated and only Eqs. (1)–(6) are used to retrieve the distribution of the sample. 3.Simulation ResultsA numerical simulation was performed with the proposed algorithm to check its feasibility. A parallel laser beam with a wavelength of 632.8 nm was passed through a pinhole of 1.1 mm in diameter, which was used to control the size of the incident light beam on the SLM. The picture to be loaded on the SLM had the phase model shown in Fig. 2(a), which was normalized to a range from 0 to and had a size of 5.5 mm. The red square in Fig. 2(a) marks the region confining the illumination area on the SLM. The SLM used in the simulation had a pixel size of . To simulate data acquisition, the picture was shifted in the and directions on the SLM with a step size of 0.275 mm to generate the shifted illuminations on the object. The test object is shown in Fig. 2, where Fig. 2(e) shows the modulus and Fig. 2(f) shows the phase. Diffraction patterns of 100 frames exiting from the object were recorded at different picture positions on the SLM for reconstruction purposes. The distance between the SLM and the pinhole was maintained at 20 mm, and the distances between the SLM and the object and the object and the CCD were maintained at 200 and 50 mm, respectively. The CCD used in the simulation had with a pixel size of . With the algorithm described above, the object function was iteratively reconstructed using 100 frames of the diffraction patterns recorded. The reconstructed modulus and phase images are shown in Figs. 2(g) and 2(h). No noticeable difference was found when comparing them with the original images as shown in Figs. 2(e) and 2(f). The transmission distribution of the SLM could also be obtained as shown in Fig. 2(b), and the amplitude and phase of the incident beam on the SLM were reconstructed as shown in Figs. 2(c) and 2(d). 4.ExperimentThe feasibility of the suggested method was also checked experimentally by integrating an SLM into a commercial optical microscope. As shown in Fig. 3, the main part of the system was an MI12 transmission wide-field microscope, and the light source was replaced by a He–Ne laser with a wavelength of 632.8 nm. An SLM loaded with a pattern was placed 35 mm in front of the sample. A nearly plane wave with a diameter of , together with the moving pattern on the SLM, generated a transverse scanning illumination on the sample. During data acquisition, the picture displayed in the SLM was shifted in the and directions to 100 different positions with a step size of 0.2368 mm, and the diffraction patterns were recorded at each position using a CCD camera (AVT Pike 421B). The CCD camera was attached to the camera port of a standard microscope by an extension tube and was placed 40 mm away from the imaging plane. The SLM used in this experiment was an electrically addressed SLM (Type GCI-77, China Daheng Optics), which had a fill factor of 68%. With a pixel size of , the diffraction angle of the first order of diffraction was . Because the distance between the SLM and the object was 35 mm and the diameter of the diffraction beam was , only the zeroth-order beam was used for imaging. All the other diffracted beams were far beyond the FOV of the objective lens and have no influence on the experimental results. A slice of pumpkin stem was used as the sample, and a objective lens with numerical aperture (NA) of 0.25 was used. The reconstructed amplitude and phase of the sample shown in Figs. 4(a) and 4(b), respectively, were generated by 100 iterative computations, and the reconstruction results were very clear. In addition, both the complex amplitude of the transmission distribution of the SLM and the incident beam on the SLM were obtained by the proposed method, as shown in Figs. 4(c)–4(f). Remarkably, the reconstructed results of the SLM show some amplitude modulation around the edges of the circles. The SLM adopted in this experiment works as a pure phase modulator when all technical requirements on both the wavelength and the polarization of the illuminating light are strictly met. However, in practice, the cross talk between the phase retardation and the energy absorption always takes place because of some unexpected factors. The transmission function of SLM and the complex distribution of the incident laser beam can be premeasured; thus, both of them can be regarded as known parameters. The complex amplitude of the sample can be reconstructed by using a lower number of diffraction patterns in comparison with standard PIE, and diffraction patterns are generally enough to obtain satisfying results with the proposed method. Figures 5(a) and 5(b) show the measurement results of a slice of corn seed with prior knowledge of the SLM and incident beam. Both the resolution and FOV of this microscopy system were determined by the objective lens, which was used to collect the diffractive data. For a objective lens with an NA of 0.25, the theoretical resolution is defined as , which is the smallest periodicity that can be distinguished. For the imaging system demonstrated here, the theoretical resolution was calculated to be . The achieved resolution of the ptychography-based microscope integrated with an SLM was also checked by measuring a US Air Force (USAF) 1951 resolution target, and the amplitude distribution obtained is shown in Fig. 5(c). In this imaging system, instead of the image of the sample, the magnified diffraction patterns were recorded by the CCD camera. The distance between the diffraction plane of the sample and the objective lens can be a little shorter than the standard working distance of the objective lens.26 Accordingly, the resolution achieved is about (the sixth element of group 8), which is a little higher than the theoretical value of . In addition, the reconstruction process converged very quickly according to the error curve shown in Fig. 5(d). In the experiment described above, it took to acquire all of the diffraction patterns. The overall acquisition speed of the experiment was mainly determined by the response time of the SLM, the data collection time of the CCD, and the data storage time of the computer. In the experiment mentioned above, the response time for a single picture displayed on the SLM at 632.8 nm was , and the frame rate of the CCD camera was 27.8 fps when the exposure time was 6 ms. So, for 25 diffraction patterns, the response time of the SLM was , the data collection time of the CCD was , and the data storage took 1.5 s. Because most of the time was spent on the data transfer from the CCD to the computer, the data acquisition time of our experiment could be further reduced by using a CCD with RAM. For the ptychography experiment using mechanical scanning, the data acquisition process involved scanning translation stages, the data collection time of the CCD, and the data storage time of the computer. The most time-consuming process was scanning, which involved acceleration, constant velocity movement, and deceleration. For most of the mechanical translation stages, the running speed was , and the acceleration was , which resulted in the time required for the mechanical stage to finish one step of scanning to be longer than 1 s. The response time of the SLM was usually much shorter than 30 ms. Thus, the SLM was at least 30 times faster than the mechanical scanning stage, which is definitely an advantage. In addition, when Galvo mirrors are used for ptychography, the response time can be comparable with that of an SLM in most cases, thus making the overall performance of Galvo mirrors no faster than an SLM. Moreover, the positioning error of the ptychography based on SLM is negligible when compared with that of Galvo mirrors. 5.ConclusionAlthough the proposed method of using an SLM to achieve ptychography is not practical in x-ray imaging, this method has several applications in the optical regime. It can not only be used to reform optical microscopes but also to measure dynamic physical phenomena, for example, the thermal recovery process of a crystal used in a high-power laser system or the deformation of a large optical element induced by its heavy weight. The method of ptychography has already been used to measure the thermal distortion in high-power laser glass elements.27 However, the data acquisition speed of conventional ptychography cannot meet the temporal precision requirements of the thermal recovery process. Thus, the proposed method with a much faster acquisition speed is definitely an advantage in such cases. Mechanical scanning of the sample relative to the illumination beam in conventional ptychographic techniques was replaced by displaying a moving picture on the SLM. This resulted in discovery of a robust solution to two major concerns in conventional ptychography—the long data acquisition time and position errors—that limit the scope of imaging in many applications. The acquisition time needed to collect 25 diffraction patterns using an SLM is , which is much faster than conventional ptychography based on mechanical scanning. The proposed method is highly beneficial in situations where the sample or the working environment cannot be kept stable for a sufficiently long time. This method has been successfully implemented in a commercial light microscope to achieve phase microscopy. The developed microscope has a simple structure, is insensitive to environmental disturbances, and can obtain speckle-free quantitative phase images, which would make it easy to adopt compared with other phase-contrast microscopy techniques. AcknowledgmentsThe authors like to thank Chinese Academy of Sciences (CAS) for the financial support of this project as part of the Hundred-Talent Program (Grant No. 902012312D1100101). This work is also supported by CAS under Grant No. 29201431151100301. ReferencesS. Bradbury and P. J. Evennett, Contrast Techniques in Light Microscopy, Bios Scientific Publishers, Oxford, United Kingdom
(1996). Google Scholar
M. Heilemann et al.,
“Photoswitches: key molecules for subdiffraction-resolution fluorescence imaging and molecular quantification,”
Laser Photonics Rev., 3 180
–202
(2009). http://dx.doi.org/10.1002/lpor.v3:1/2 Google Scholar
G. Koopman et al.,
“Annexin V for flow cytometric detection of phosphatidylserine expression on B cells undergoing apoptosis,”
Blood, 84 1415
–1420
(1994). http://dx.doi.org/10.1049/el:20046050 BLOOAW 0006-4971 Google Scholar
G. E. Sommargren and B. J. Thompson,
“Linear phase microscopy,”
Appl. Opt., 12 2130
–2138
(1973). http://dx.doi.org/10.1364/AO.12.002130 APOPAI 0003-6935 Google Scholar
P. Torok and F. J. Kao, Optical Imaging and Microscopy, Springer-Verlag, Germany
(2003). Google Scholar
A. Barty et al.,
“Quantitative optical phase microscopy,”
Opt. Lett., 23 817
–819
(1998). http://dx.doi.org/10.1364/OL.23.000817 OPLEDP 0146-9592 Google Scholar
J. B. Pawley, Handbook of Biological Confocal Microscopy, Plenum, New York
(1995). Google Scholar
G. Popescu et al.,
“Fourier phase microscopy for investigation of biological structures and dynamics,”
Opt. Lett., 29 2503
–2505
(2004). http://dx.doi.org/10.1364/OL.29.002503 OPLEDP 0146-9592 Google Scholar
C. G. Rylander et al.,
“Quantitative phase-contrast imaging of cells with phase-sensitive optical coherence microscopy,”
Opt. Lett., 29 1509
–15011
(2004). http://dx.doi.org/10.1364/OL.29.001509 OPLEDP 0146-9592 Google Scholar
P. Marquet et al.,
“Digital holographic microscopy: a noninvasive contrast imaging technique allowing quantitative visualization of living cells with subwavelength axial accuracy,”
Opt. Lett., 30 468
–470
(2005). http://dx.doi.org/10.1364/OL.30.000468 OPLEDP 0146-9592 Google Scholar
S. S. Kou et al.,
“Transport-of-intensity approach to differential interference contrast (TI-DIC) microscopy for quantitative phase imaging,”
Opt. Lett., 35 447
–449
(2010). http://dx.doi.org/10.1364/OL.35.000447 OPLEDP 0146-9592 Google Scholar
A. M. Maiden, J. M. Rodenburg and M. J. Humphry,
“Optical ptychography: a practical implementation with useful resolution,”
Opt. Lett., 35 2585
(2010). http://dx.doi.org/10.1364/OL.35.002585 OPLEDP 0146-9592 Google Scholar
A. M. Maiden et al.,
“Superresolution imaging via ptychography,”
J. Opt. Soc. Am. A, 28 604
(2011). http://dx.doi.org/10.1364/JOSAA.28.000604 JOAOD6 0740-3232 Google Scholar
A. M. Maiden, M. J. Humphry and J. M. Rodenburg,
“Ptychographic transmission microscopy in three dimensions using a multi-slice approach,”
J. Opt. Soc. Am. A, 29 1606
(2010). http://dx.doi.org/10.1364/JOSAA.29.001606 JOAOD6 0740-3232 Google Scholar
T. M. Godden et al.,
“Ptychographic microscope for three-dimensional imaging,”
Opt. Express, 22 12513
(2014). http://dx.doi.org/10.1364/OE.22.012513 OPEXFF 1094-4087 Google Scholar
J. Marrison et al.,
“Ptychography-a label free, high-contrast imaging technique for live cells using quantitative phase information,”
Sci. Rep., 3 2369
(2013). http://dx.doi.org/10.1038/srep02369 Google Scholar
L. Bian et al.,
“Fourier ptychographic reconstruction using Poisson maximum likelihood and truncated Wirtinger gradient,”
Sci. Rep., 6 27384
(2016). http://dx.doi.org/10.1038/srep27384 Google Scholar
X Ou et al.,
“Quantitative phase imaging via Fourier ptychographic microscopy,”
Opt. Lett., 38 4845
(2013). http://dx.doi.org/10.1364/OL.38.004845 OPLEDP 0146-9592 Google Scholar
L. H. Yeh et al.,
“Experimental robustness of Fourier ptychography phase retrieval algorithms,”
Opt. Express, 23 33214
(2015). http://dx.doi.org/10.1364/OE.23.033214 OPEXFF 1094-4087 Google Scholar
X. Ou, G. Zheng and C. Yang,
“Embedded pupil function recovery for Fourier ptychographic microscopy,”
Opt. Express, 22 4960
(2014). http://dx.doi.org/10.1364/OE.22.004960 OPEXFF 1094-4087 Google Scholar
K. Guo, S. Dong and G. Zheng,
“Fourier ptychography for brightfield, phase, darkfield, reflective, multi-slice, and fluorescence imaging,”
IEEE J. Sel. Top. Quantum Electron., 22 6802712
(2016). http://dx.doi.org/10.1109/JSTQE.2015.2504514 IJSQEN 1077-260X Google Scholar
L. Tian et al.,
“Computational illumination for high-speed in vitro Fourier ptychographic microscopy,”
Optica, 2 904
(2015). http://dx.doi.org/10.1364/OPTICA.2.000904 Google Scholar
L. Tian et al.,
“Multiplexed coded illumination for Fourier Ptychography with an LED array microscope,”
Biomed. Opt. Express, 5 2376
(2014). http://dx.doi.org/10.1364/BOE.5.002376 BOEICL 2156-7085 Google Scholar
R. W. Gerchberg,
“A practical algorithm for the determination of phase from image and diffraction plane pictures,”
Optik, 35 237
–246
(1972). OTIKAJ 0030-4026 Google Scholar
J. Fienup,
“Phase retrieval algorithms: a comparison,”
Appl. Opt., 21 2758
–2769
(1982). http://dx.doi.org/10.1364/AO.21.002758 APOPAI 0003-6935 Google Scholar
T. M. Godden et al.,
“Ptychographic microscope for three-dimensional imaging,”
Opt. Express, 22 12513
–12523
(2014). http://dx.doi.org/10.1364/OE.22.012513 OPEXFF 1094-4087 Google Scholar
H. Wang et al.,
“Measurement of thermal distortion in high power laser glass elements using ptychography,”
Laser Phys. Lett., 12 025005
(2015). http://dx.doi.org/10.1088/1612-2011/12/2/025005 1612-2011 Google Scholar
Biography |