Regulatory Strategy for AI/ML-based Software As a Medical Device ,
Clinical Reader Study Design ,
Breast Imaging Evaluation ,
Model Observer Design ,
Real World Data ,
Real World Evidence
KEYWORDS: Digital breast tomosynthesis, Breast, 3D modeling, Breast cancer, Signal detection, X-rays, Image quality, Signal to noise ratio, 3D image processing, Lab on a chip, Tumors, Magnetic resonance imaging
Multifocal and multicentric breast cancer (MFMC), i.e., the presence of two or more tumor foci within the same breast, has an immense clinical impact on treatment planning and survival outcomes. Detecting multiple breast tumors is challenging as MFMC breast cancer is relatively uncommon, and human observers do not know the number or locations of tumors a priori. Digital breast tomosynthesis (DBT), in which an x-ray beam sweeps over a limited angular range across the breast, has the potential to improve the detection of multiple tumors.1, 2 However, prior efforts to optimize DBT image quality only considered unifocal breast cancers (e.g.,3-9), so the recommended geometries may not necessarily yield images that are informative for the task of detecting MFMC. Hence, the goal of this study is to employ a 3D multi-lesion (ml) channelized-Hotelling observer (CHO) to identify optimal DBT acquisition geometries for MFMC. Digital breast phantoms and simulated DBT scanners of different geometries (e.g., wide or narrow arc scans, different number of projections in each scan) were used to generate image data for the simulation study. Multiple 3D synthetic lesions were inserted into different breast regions to simulate MF cases and MC cases. 3D partial least squares (PLS) channels, and 3D Laguerre-Gauss (LG) channels were estimated to capture discriminant information and correlations among signals in locally varying anatomical backgrounds, enabling the model observer to make both image-level and location-specific detection decisions. The 3D ml-CHO with PLS channels outperformed that with LG channels in this study. The simulated MC cases and MC cases were not equally difficult for the ml-CHO to detect across the different simulated DBT geometries considered in this analysis. Also, the results suggest that the optimal design of DBT may vary as the task of clinical interest changes, e.g., a geometry that is better for finding at least one lesion may be worse for counting the number of lesions.
KEYWORDS: Tumor growth modeling, Performance modeling, Image analysis, Medical imaging, Image quality, Lab on a chip, Signal to noise ratio, Mammography, Neptunium
As psychophysical studies are resource-intensive to conduct, model observers are commonly used to assess and optimize medical imaging quality. Existing model observers were typically designed to detect at most one signal. However, in clinical practice, there may be multiple abnormalities in a single image set (e.g., multifocal and multicentric breast cancers (MMBC)), which can impact treatment planning. Prevalence of signals can be different across anatomical regions, and human observers do not know the number or location of signals a priori. As new imaging techniques have the potential to improve multiple-signal detection (e.g., digital breast tomosynthesis may be more effective for diagnosis of MMBC than planar mammography), image quality assessment approaches addressing such tasks are needed. In this study, we present a model-observer mechanism to detect multiple signals in the same image dataset. To handle the high dimensionality of images, a novel implementation of partial least squares (PLS) was developed to estimate different sets of efficient channels directly from the images. Without any prior knowledge of the background or the signals, the PLS channels capture interactions between signals and the background which provide discriminant image information. Corresponding linear decision templates are employed to generate both image-level and location-specific scores on the presence of signals. Our preliminary results show that the model observer using PLS channels, compared to our first attempts with Laguerre-Gauss channels, can achieve high performance with a reasonably small number of channels, and the optimal design of the model observer may vary as the tasks of clinical interest change.
KEYWORDS: Digital breast tomosynthesis, Breast cancer, Image quality, Signal detection, Signal attenuation, 3D modeling, Breast, Data modeling, Reconstruction algorithms, Sensors, Thallium
Digital breast tomosynthesis (DBT) is an emerging imaging modality for improved breast cancer detection and diagnosis [1-5]. Numerous efforts have been made to find quantitative metrics associated with mammographic image quality assessment, such as the exponent β of anatomical noise power spectrum, glandularity, contrast noise ratio, etc. [6-8]. In addition, with the use of Fourier-domain detectability for a task-based assessment of DBT, a stationarity assumption on reconstructed image statistics was often made [9-11], resulting in the use of multiple regions-of-interest (ROIs) from different locations in order to increase sample size. While all these metrics provide some information on mammographic image characteristics and signal detection, the relationship between these metrics and detectability in DBT evaluation has not been fully understood. In this work, we investigated spatial-domain detectability trends and levels as a function of the number of slices Ns at three different ROI locations on the same image slice, where background statistics differ in terms of the aforementioned metrics. Detectabilities for the three ROI locations were calculated using multi-slice channelized Hotelling observers with 2D/3D Laguerre-Gauss channels. Our simulation results show that detectability levels and trends as a function of Ns vary across these three ROI locations. They also show that the exponent β, mean glandularity, and mean attenuation coefficient vary across the three ROI locations but they do not necessarily predict the ranking of detectability levels and trends across these ROI locations.
As anatomical noise is often a dominating factor affecting signal detection in medical imaging, we investigate the effects of anatomical backgrounds on signal detection in volumetric cone beam CT images. Signal detection performances are compared between transverse and longitudinal planes with either uniform or anatomical backgrounds. Sphere objects with diameters of 1mm, 5mm, 8mm, and 11mm are used as the signals. Three-dimensional (3D) anatomical backgrounds are generated using an anatomical noise power spectrum, 1/fβ, with β=3, equivalent to mammographic background [1]. The mean voxel value of the 3D anatomical backgrounds is used as an attenuation coefficient of the uniform background. Noisy projection data are acquired by the forward projection of the uniform and anatomical 3D backgrounds with/without sphere lesions and by the addition of quantum noise. Then, images are reconstructed by an FDK algorithm [2]. For each signal size, signal detection performances in transverse and longitudinal planes are measured by calculating the task SNR of a channelized Hotelling observer with Laguerre-Gauss channels. In the uniform background case, transverse planes yield higher task SNR values for all sphere diameters but 1mm. In the anatomical background case, longitudinal planes yield higher task SNR values for all signal diameters. The results indicate that it is beneficial to use longitudinal planes to detect spherical signals in anatomical backgrounds.
To facilitate rigorous virtual clinical trials using model observers for breast imaging optimization and evaluation, we
demonstrated a method of defining statistical models, based on 177 sets of breast CT patient data, in order to generate
tens of thousands of unique digital breast phantoms.
In order to separate anatomical texture from variation in breast shape, each training set of breast phantoms were
deformed to a consistent atlas compressed geometry. Principal component analysis (PCA) was then performed on the
shape-matched breast CT volumes to capture the variation of patient breast textures. PCA decomposes the training set of
N breast CT volumes into an N-1-dimensional space of eigenvectors, which we call eigenbreasts. By summing weighted
combinations of eigenbreasts, a large ensemble of different breast phantoms can be newly created.
Different training sets can be used in eigenbreast analysis for designing basis models to target sub-populations defined
by breast characteristics, such as size or density. In this work, we plan to generate ensembles of 30,000 new phantoms
based on glandularity for an upcoming virtual trial of lesion detectability in digital breast tomosynthesis.
Our method extends our series of digital and physical breast phantoms based on human subject anatomy, providing the
capability to generate new, unique ensembles consisting of tens of thousands or more virtual subjects. This work
represents an important step towards conducting future virtual trials for tasks-based assessment of breast imaging, where
it is vital to have a large ensemble of realistic phantoms for statistical power as well as clinical relevance.
KEYWORDS: Digital breast tomosynthesis, 3D modeling, Neptunium, Scanning probe lithography, Data modeling, Signal detection, Breast, Performance modeling, Statistical modeling, Binary data
A task-based assessment of image quality1 for digital breast tomosynthesis (DBT) can be done in either the projected or reconstructed data space. As the choice of observer models and feature selection methods can vary depending on the type of task and data statistics, we previously investigated the performance of two channelized- Hotelling observer models in conjunction with 2D Laguerre-Gauss (LG) and two implementations of partial least squares (PLS) channels along with that of the Hotelling observer in binary detection tasks involving DBT projections.2, 3 The difference in these observers lies in how the spatial correlation in DBT angular projections is incorporated in the observer’s strategy to perform the given task. In the current work, we extend our method to the reconstructed data space of DBT. We investigate how various model observers including the aforementioned compare for performing the binary detection of a spherical signal embedded in structured breast phantoms with the use of DBT slices reconstructed via filtered back projection. We explore how well the model observers incorporate the spatial correlation between different numbers of reconstructed DBT slices while varying the number of projections. For this, relatively small and large scan angles (24° and 96°) are used for comparison. Our results indicate that 1) given a particular scan angle, the number of projections needed to achieve the best performance for each observer is similar across all observer/channel combinations, i.e., Np = 25 for scan angle 96° and Np = 13 for scan angle 24°, and 2) given these sufficient numbers of projections, the number of slices for each observer to achieve the best performance differs depending on the channel/observer types, which is more pronounced in the narrow scan angle case.
KEYWORDS: Digital breast tomosynthesis, Scanning probe lithography, Data modeling, Neptunium, 3D modeling, Nanolithography, Binary data, Signal detection, Tolerancing, Performance modeling
Digital breast tomosynthesis (DBT) has shown promise for improving the detection of breast cancer, but it has not yet been fully optimized due to a large space of system parameters to explore. A task-based statistical approach1 is a rigorous method for evaluating and optimizing this promising imaging technique with the use of optimal observers such as the Hotelling observer (HO). However, the high data dimensionality found in DBT has been the bottleneck for the use of a task-based approach in DBT evaluation. To reduce data dimensionality while extracting salient information for performing a given task, efficient channels have to be used for the HO. In the past few years, 2D Laguerre-Gauss (LG) channels, which are a complete basis for stationary backgrounds and rotationally symmetric signals, have been utilized for DBT evaluation2, 3 . But since background and signal statistics from DBT data are neither stationary nor rotationally symmetric, LG channels may not be efficient in providing reliable performance trends as a function of system parameters. Recently, partial least squares (PLS) has been shown to generate efficient channels for the Hotelling observer in detection tasks involving random backgrounds and signals.4 In this study, we investigate the use of PLS as a method for extracting salient information from DBT in order to better evaluate such systems.
Software breast phantoms have been developed for use in evaluation of novel breast imaging systems. Software
phantoms are flexible allowing the simulation of wide variations in breast anatomy, and provide ground truth for the
simulated tissue structures. Different levels of phantom realism are required depending on the intended application.
Realistic simulation of dense (fibroglandular) tissue is of particular importance; the properties of dense tissue – breast
percent density and the spatial distribution – have been related to the risk of breast cancer. In this work, we have
compared two methods for simulation of dense tissue distribution in a software breast phantom previously developed at
the University of Pennsylvania. The methods compared are: (1) the previously used Gaussian distribution centered at
the phantom nipple point, and (2) the proposed combination of two Beta functions, one modeling the dense tissue
distribution along the chest wall-to-nipple direction, and the other modeling the radial distribution in each coronal
section of the phantom. Dense tissue distributions obtained using these methods have been compared with distributions
reported in the literature estimated from the analysis of breast CT images. Qualitatively, the two methods produced
rather similar dense tissue distributions. The simulation based upon the use of Beta functions provides more control
over the simulated distributions through the selection of the various Beta function parameters. Both methods showed
good agreement to the clinical data, suggesting both provide a high level of realism.
KEYWORDS: Convolution, Breast, Monte Carlo methods, X-rays, Sensors, Digital breast tomosynthesis, X-ray detectors, Quantum electronics, Computer simulations, Chest
For a rigorous x-ray imaging system optimization and evaluation, the need for exploring a large space of many
different system parameters is immense. However, due to the high dimensionality of the problem, it is often
infeasible to evaluate many system parameters in a laboratory setting. Therefore, it is useful to utilize computer
simulation tools and analytical methods to narrow down to a much smaller space of system parameters and
then validate the chosen optimal parameters by laboratory measurements. One great advantage of using the
simulation and analytical methods is that the impact of various sources of variability on the system's diagnostic
performance can be studied separately and collectively. Previously, we have demonstrated how to separate and
analyze noise sources using covariance decomposition in a task-based approach to the assessment of digital breast
tomosynthesis (DBT) systems in the absence of x-ray scatter and detector blur.1, 2 In this work, we analytically
extend the previous work to include x-ray scatter and detector blur. With use of computer simulation, we also
investigate the use of the convolution method for approximating the scatter images of structured phantoms
in comparison to those computed via Monte Carlo. The extended method is comprehensive and can be used
both for exploring a large parameter space in simulation and for validating optimal parameters, chosen from a
simulation study, with laboratory measurements.
Optimization of digital breast tomosynthesis (DBT) has been investigated in the medical imaging field for the
last several years as DBT has the potential for improved detection of breast cancer. However, a systematic
method for choosing the angular range and number of projections of DBT has yet to be developed. Singular
system analysis of a linear imaging system1 gives knowledge of how much information about the object being
imaged is transferred through the given system, or equivalently how much information about the object is lost
through the system. These components of the object to be imaged, which are fully transferrable and nontransferrable
through the imaging system in the absence of noise, are respectively called measurable and null components of the object. In this work, given a projection angle, a ray tracing algorithm is used to linearly approximate the nonlinear x-ray imaging process in the 3D object and hence producing a matrix representing for
the imaging process. For a DBT system using a combination of different projection angles, the imaging matrices
corresponding to the projection angles are combined to form a DBT system matrix, to which the singular system
analysis is applied in order to produce singular vectors of the given DBT design. The singular vectors of the DBT
system are then used to estimate the null and measurable components of the object and to identify the angular
projections of the DBT system that transfer maximum information regarding the object to be imaged. This
method facilitates the ability to choose effective projection angles and maximizing information tranfer regarding
the object by the system.
KEYWORDS: Signal to noise ratio, Sensors, Imaging systems, Modulation transfer functions, Interference (communication), Quantum electronics, Signal detection, X-ray detectors, Digital x-ray imaging, Arteries
For task specific evaluation of imaging systems it is necessary to obtain detailed descriptions of their noise and
deterministic properties. In the past we have developed an experimental and theoretical methodology to estimate
the deterministic detector response of a digital x-ray imaging system, also known as the H matrix. In this paper
we have developed the experimental methodology for the evaluation of the quantum and electronic noise of
digital radiographic detectors using the covariance matrix K. Using the H matrix we calculated the transfer
of a simulated coronary artery constriction through an imaging system's detector, and with the covariance
matrix we calculated the detectability (or Signal-to-Noise Ratio) and the detection probability. The eigenvalues
and eigenvectors of the covariance matrix were presented and the electronic and quantum noise were analyzed.
We found that the exposure at which the electronic noise equals the quantum noise at 90 kVp was 0.2 μR. We
compared the ideal Hotelling observer with the Fourier definition of the SNR for a toroidal stenosis on a cylindrical
vessel. Because of the shift-invariance and cyclo-stationarity assumptions, the Fourier SNR overestimates the
performance of imaging systems. This methodology can be used for task specific evaluation and optimization of
a digital x-ray imaging system.
Digital breast tomosynthesis (DBT) shows potential for improving breast cancer detection. However, this technique
has not yet been fully characterized with consideration of the various uncertainties in the imaging chain and
optimized with respect to system acquisition parameters. To obtain maximum diagnostic information in DBT,
system optimization needs to be performed across a range of patients and acquisition parameters to quantify their
impact on tumor detection performance. In addition, a balance must be achieved between x-ray dose and image
quality to minimize risk to the patient while maximizing the system's detection performance. To date, researchers
have applied a task-based approach to the optimization of DBT with use of mathematical observers for tasks in
the signal-known-exactly background-known-exactly (SKE/BKE) and signal-known-exactly background-known statistically
(SKE/BKS) paradigms1-3. However, previous observer models provided insufficient treatment of the
spatial correlations between multi-angle DBT projections, so we incorporated this correlation information into
the modeling methodology. We developed a computational approach that includes three-dimensional variable
background phantoms for incorporating background variability, accurate ray-tracing and Poisson distributions
for generating noise-free and noisy projections of the phantoms, and a channelized-Hotelling observer4 (CHO) for
estimating performance in DBT. We demonstrated our method for a DBT acquisition geometry and calculated
the performance of the CHO with Laguerre-Gauss channels as a function of the angular span of the system.
Preliminary results indicate that the implementation of a CHO model that incorporates correlations between
multi-angle projections gives different performance predictions than a CHO model that ignores multi-angle correlations.
With improvement of the observer design, we anticipate more accurate investigations into the impact
of multi-angle correlations and background variability on the performance of DBT.
We define image quality by how accurately an observer, human or otherwise, can perform a given task, such
as determining to which class an image belongs. For detection tasks, the Bayesian ideal observer is the best
observer, in that it sets an upper bound for observer performance, summarized by the area under the receiver
operating characteristic curve. However, the use of this observer is frequently infeasible because of unknown
image statistics, whose estimation is computationally costly. As a result, a channelized ideal observer (CIO) was
investigated to reduce the dimensionality of the data, yet approximate the performance of the ideal observer.
Previously investigated channels include Laguerre Gauss (LG) channels and channels via the singular value
decomposition of the given linear system (SVD). Though both types are highly efficient for the ideal observer,
they nevertheless have the weakness that they may not be as efficient for general detection tasks involving
complex/realistic images; the former is particular to the signal and background shape, and the latter is particular
to the system operator. In this work, we attempt to develop channels that can be applied to a system with
any signal and background type and without knowledge of any characteristics of the system. The method used
is a partial least squares algorithm (PLS), in which channels are chosen to maximize the squared covariance
between images and their classes. Preliminary results show that the CIO with PLS channels outperforms one
with either the LG or SVD channels and very closely approximates ideal-observer performance.
KEYWORDS: Imaging systems, X-rays, X-ray imaging, 3D image processing, Signal to noise ratio, Breast imaging, Mammography, Signal detection, Breast, Optical spheres
For the last few years, development and optimization of three-dimensional (3D) x-ray breast imaging systems,
such as breast tomosynthesis and computed tomography, has drawn much attention from the medical imaging
community, either academia or industry. However, the trade offs between patient safety and the efficacy of the
devices have yet to be investigated with use of objective performance metrics. Moreover, as the 3D imaging
systems give depth information that was not available in planar mammography, standard mammography quality
assurance and control (QA/QC) phantoms used for measuring system performance are not appropriate since they
do not account for background variability and clinically relevant tasks. Therefore, it is critical to develop QA/QC
methods that incorporate background variability with use of a task-based statistical assessment methodology.1
In this work, we develop a physical phantom that simulates variable backgrounds using spheres of different
sizes and densities, and present an evaluation method based on statistical decision theory,2 in particular, with
use of the ideal linear observer, for evaluating planar and 3D x-ray breast imaging systems. We demonstrate
our method for a mammography system and compare the variable phantom case to that of a phantom of the
same dimensions filled with water. Preliminary results show that measuring the system's detection performance
without consideration of background variability may lead to misrepresentation of system performance.
KEYWORDS: Signal to noise ratio, Sensors, Imaging systems, Mammography, Signal detection, Polymethylmethacrylate, X-rays, X-ray detectors, Interference (communication), Laser range finders
A common method for evaluating projection mammography is Contrast-Detail (CD) curves derived from the CD
phantom for Mammography (CDMAM). The CD curves are derived either by human observers, or by automated
readings. Both methods have drawbacks which limit their reliability. The human based reading is significantly
affected by reader variability, reduced precision and bias. On the other hand, the automated methods suffer from
limited statistics. The purpose of this paper is to develop a simple and reliable methodology for the evaluation
of mammographic imaging systems using the Signal Known Exactly/Background Known Exactly (SKE/BKE)
detection task for signals relevant to mammography. In this paper, we used the spatial definition of the ideal,
linear (Hotelling) observer to calculate the task-specific SNR for mammography and discussed the results. The
noise covariance matrix as well as the detector response H matrix of the imaging system were estimated and
used to calculate the SNRSKEBKE for the simulated discs of the CDMAM. The SNR as a function of exposure,
disc diameter and thickness were calculated.
The Bayesian ideal observer sets an upper bound for diagnostic performance of an imaging system in binary
detection tasks. Thus, this observer should be used for image quality assessment whenever possible. However, it
is difficult to compute ideal-observer performance because the probability density functions of the data, required
for the observer, are often unknown in tasks involving complex backgrounds. Furthermore, the dimension of
the integrals that need to be calculated for the observer is huge. To attempt to reduce the dimensionality
of the problem, and yet still approximate ideal-observer performance, a channelized-ideal observer (CIO) with
Laguerre-Gauss channels was previously investigated for detecting a Gaussian signal at a known location in
non-Gaussian lumpy images. While the CIO with Laguerre-Gauss channels had, in some cases, approximated
ideal-observer performance, there was still a gap between the mean performance of the ideal observer and the
CIO. Moreover, it is not clear how to choose efficient channels for the ideal observer. In the current work, we
investigate the use of singular vectors of a linear imaging system as efficient channels for the ideal observer in
the same tasks. Singular value decomposition of the imaging system is performed to obtain its singular vectors.
Singular vectors most relevant to the signal and background images are chosen as candidate channels. Results
indicate that the singular vectors are not only more efficient than Laguerre-Gauss channels, but are also highly
efficient for the ideal observer. The results further demonstrate that singular vectors strongly associated with
the signal-only image are the most efficient channels.
KEYWORDS: Monte Carlo methods, Imaging systems, Statistical analysis, Binary data, Signal detection, Medical imaging, Interference (communication), Error analysis, Diagnostics, Receivers
The Bayesian ideal observer is optimal among all observers and sets an upper bound for observer performance in
binary detection tasks. This observer provides a quantitative measure of diagnostic performance of an imaging
system, summarized by the area under the receiver operating characteristic curve (AUC), and thus should
be used for image quality assessment whenever possible. However, computation of ideal-observer performance
is difficult because this observer requires the full description of the statistical properties of the signal-absent
and signal-present data, which are often unknown in tasks involving complex backgrounds. Furthermore, the
dimension of the integrals that need to be calculated for the observer is huge. To estimate ideal-observer
performance in detection tasks with non-Gaussian lumpy backgrounds, Kupinski et al. developed a Markovchain
Monte Carlo (MCMC) method, but this method has a disadvantage of long computation times. In
an attempt to reduce the computation load and still approximate ideal-observer performance, Park et al.
investigated a channelized-ideal observer (CIO) in similar tasks and found that the CIO with singular vectors of
the imaging system approximated the performance of the ideal observer. But, in that work, an extension of the
Kupinski MCMC was used for calculating the performance of the CIO and it did not reduce the computational
burden. In the current work, we propose a new MCMC method, which we call a CIO-MCMC, to speed up
the computation of the CIO. We use singular vectors of the imaging system as efficient channels for the ideal
observer. Our results show that the CIO-MCMC has the potential to speed up the computation of ideal observer
performance with a large number of channels.
Previously, a non-prewhitening matched filter (NPWMF) incorporating a model for the contrast sensitivity of the
human visual system was introduced for modeling human performance in detection tasks with different viewing
angles and white-noise backgrounds by Badano et al. But NPWMF observers do not perform well detection
tasks involving complex backgrounds since they do not account for random backgrounds. A channelized-Hotelling
observer (CHO) using difference-of-Gaussians (DOG) channels has been shown to track human performance well
in detection tasks using lumpy backgrounds. In this work, a CHO with DOG channels, incorporating the model
of the human contrast sensitivity, was developed similarly. We call this new observer a contrast-sensitive CHO
(CS-CHO). The Barten model was the basis of our human contrast sensitivity model. A scalar was multiplied
to the Barten model and varied to control the thresholding effect of the contrast sensitivity on luminance-valued
images and hence the performance-prediction ability of the CS-CHO. The performance of the CS-CHO was
compared to the average human performance from the psychophysical study by Park et al., where the task
was to detect a known Gaussian signal in non-Gaussian distributed lumpy backgrounds. Six different signal-intensity
values were used in this study. We chose the free parameter of our model to match the mean human
performance in the detection experiment at the strongest signal intensity. Then we compared the model to the
human at five different signal-intensity values in order to see if the performance of the CS-CHO matched human
performance. Our results indicate that the CS-CHO with the chosen scalar for the contrast sensitivity predicts
human performance closely as a function of signal intensity.
KEYWORDS: LCDs, Medical imaging, Signal detection, Computed tomography, Image quality, 3D volumetric displays, Contrast sensitivity, Performance modeling, Time metrology, Medical imaging applications
Active-matrix liquid crystal displays (LCDs) are becoming widely used in medical imaging applications. With
the increasing volume of CT images to be interpreted per day, the ability of showing a fast sequence of images
in stack mode is preferable for a medical display. Slow temporal response of LCD display can compromise the
image quality/fidelity when the images are browsed in a fast sequence. In this paper, we report on the effect
of the LCD response time at different image browsing speeds based on the performance of a contrast-sensitive
channelized-Hotelling observer. A correlated stack of simulated cluster lumpy background images with a signal
present in some of the images was used. The effect of different browsing speeds is calculated with LCD temporal
response measurements established in our previous work. The image set is then analyzed by the model observer,
which has been shown to predict human detection performance in non-Gaussian lumpy backgrounds. This allows
us to quantify the effect of slow temporal response of medical liquid crystal displays on the performance of the
anthropomorphic observer. Slow temporal response of the display device greatly affects the lesion contrast and
observer performance. This methodology, after validation with human observers, could be used to set limits for
the rendering speed of large volumetric image datasets (from CT, MR, or tomosynthesis) read in stack-mode.
A psychophysical study to measure human efficiency relative to the ideal observer for detecting a Gaussian signal at a known location in a non-Gaussian distributed lumpy background was conducted previously by the author. The study found that human efficiency was less than 2.2% while the ideal observer achieved 0.95 in terms of the area under the receiver operating characteristic curve. In this work, a psychophysical study was conducted with a number of changes that substantially improve upon the previous study design. First, a DICOM-calibrated monitor was used in this study for human-observer performance measurements, whereas an uncalibrated LCD monitor was used in the prior study. Second, two scaling methods to display image values were employed to see how scaling affects human performance for the same task. Third, a random order of image pairs was chosen for each observer to reduce any correlations in human performance that is likely caused by the fixed ordering of the image pairs in the prior study. Human efficiency relative to the ideal observer was found to be less than 3.8$% at the same performance level of the ideal observer as above. Our variance analysis indicates that neither scaling nor display made a significant difference in human performance on the tasks in the two studies. That is, we cannot say that either of these factors caused low human efficiency in these studies. Therefore, we conclude that using highly non-Gaussian distributed lumpy backgrounds in the tasks may have been the major source of low human efficiency.
KEYWORDS: Signal detection, Monte Carlo methods, Medical imaging, Image quality, Imaging systems, Computer simulations, Statistical analysis, Signal to noise ratio, Quality measurement, Image classification
The Bayesian ideal observer gives a measure for image quality since it uses all available statistical information for a given image data. A channelized-ideal observer (CIO), which reduces the dimensionality of integrals that need to be calculated for the ideal observer, has been introduced in the past. The goal of the CIO is to approximate the performance of the ideal observer in certain detection tasks. In this work, a CIO using Laguerre-Gauss (LG) channels is employed for detecting a rotationally symmetric Gaussian signal at a known location in the non-Gaussian distributed lumpy background. The mean number of lumps in the lumpy background is varied to see the impact of image statistics on the performance of this CIO and a channelized-Hotelling observer (CHO) using the same channels. The width parameter of LG channels is also varied to see its impact on observer performance. A Markov-chain Monte Carlo (MCMC) method is employed to determine the performance of the CIO using large numbers of LG channels. Simulation results show that the CIO is a better observer than the CHO for the task. The results also indicate that the performance of the CIO approaches that of the ideal observer as the mean number of lumps in the lumpy background decreases. This implies that LG channels may be efficient for the CIO to approximate the performance of the ideal observer in tasks using non-Gaussian distributed lumpy backgrounds.
Digital clinical imaging systems designed for radiography or cone-beam computed-tomography are highly shift-variant.
The x-ray cone angle of such systems varies between 0° and 15°, resulting in large variations of the focal spot projection
across the image field. Additionally, the variable x-ray beam incidence across the detector field creates a location-dependent
asymmetric detector response function. In this paper we propose a practical method for the measurement of
the angle of incidence dependent two-dimensional presampled detector response function. We also present a method for
the measurement of the source radiance at the center of the detector, and provide a geometric transformation for
reprojecting given any location in object space. The measurement procedure involves standard, readily available tools
such as a focal-spot/pinhole camera, and an edge. Using the measured data and a model based on smooth functions
derived from Monte Carlo simulations we obtain the location-dependent detector response function. In this paper we
ignore scatter, therefore the resulting location dependent system response is a function of the focal spot and detector
response. The system matrix, a representation of the full deterministic point response of the system for all positions in
object space, can then be calculated. The eigenvalues and eigenvectors of the system matrix are generated and
interpreted.
KEYWORDS: Signal detection, Imaging systems, Image processing, Statistical analysis, Systems modeling, Signal to noise ratio, Monte Carlo methods, Image quality, Medical imaging, Mathematical modeling
Efficiencies of the human observer and channelized-Hotelling observers (CHOs) relative to the ideal observer for signal-detection tasks are discussed. A CHO using Laguerre-Gauss channels, which we call an efficient CHO (eCHO), and a CHO adding a scanning scheme to the eCHO to include signal-location uncertainty, which we call a scanning eCHO (seCHO), are considered. Both signal-known-exactly (SKE) tasks and signal-known-statistically (SKS) tasks are
considered. Signal location is uncertain for the SKS tasks, and lumpy backgrounds are used for background uncertainty in both the tasks. Markov-chain Monte Carlo methods are employed to determine ideal-observer performance on the detection tasks. Psychophysical studies are conducted to compute human-observer performance on the same tasks. A maximum-likelihood estimation method is employed to fit smooth psychometric curves with observer performance measurements. Efficiency is computed as the squared ratio of the detectabilities of the observer of interest to a standard observer. Depending on image statistics, the ideal observer or the Hotelling observer is used as the standard observer. The results show that the eCHO performs poorly in detecting signals with location uncertainty and the seCHO performs
only slightly better while the ideal observer outperforms the human observer and CHOs for both the tasks. Human efficiencies are approximately less than 2.5% and 41%, respectively, for the SKE and SKS tasks, where the gray levels of the lumpy background are non-Gaussian distributed. These results also imply that human observers are not affected by signal-location uncertainty as much as the ideal
observer. However, for the SKE tasks using Gaussian-distributed lumpy backgrounds, the human efficiency ranges between 28% and 42%. Three different simplified pinhole imaging systems are simulated and the humans and the model observers rank the systems in the same order for both the tasks.
For a signal-detection task, the Bayesian ideal observer is
optimal among all observers because it incorporates all the
statistical information of the raw data from an imaging system.
The ideal observer test statistic, the likelihood ratio, is
difficult to compute when uncertainties are present in backgrounds
and signals. In this work, we propose a new approximation
technique to estimate the likelihood ratio. This technique is a
dimensionality-reduction scheme we will call the channelized-ideal
observer (CIO). We can reduce the high-dimensional integrals of
the ideal observer to the low-dimensional integrals of the CIO by
applying a set of channels to the data. Lumpy backgrounds and
circularly symmetric Gaussian signals are used for simulations
studies. Laguerre-Gaussian (LG) channels have been shown to be
useful for approximating ideal linear observers with these
backgrounds and signals. For this reason, we choose to use LG
channels for our data. The concept of efficient channels is
introduced to closely approximate ideal-observer performance with
the CIO for signal-known-exactly (SKE) detection tasks.
Preliminary results using one to three LG channels show that the
performance of the CIO is better than the channelized-Hotelling
observer for the SKE detection tasks.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.