Proposal and validation of a method to construct confidence intervals for clinical outcomes around FROC curves for mammography CAD systems

Hans Bornefalk

doi:10.1117/12.593735

29 April 2005 Proposal and validation of a method to construct confidence intervals for clinical outcomes around FROC curves for mammography CAD systems

Hans Bornefalk

Author Affiliations +

Proceedings Volume 5747, Medical Imaging 2005: Image Processing; (2005) https://doi.org/10.1117/12.593735
Event: Medical Imaging, 2005, San Diego, California, United States

Abstract

This paper introduces a method for constructing confidence intervals for possible clinical outcomes around the FROC curve of a mammography CAD system. Given the architecture of a CAD classifying machine, there is one and only one system threshold that will yield a desired sensitivity on a certain population. The limited training sample size leads to a sampling error and an uncertainty in determining the optimal system threshold. This leads to an uncertainty in the operating point in the direction along the FROC curve which can be captured by a Bayesian approach where the distribution of possible thresholds is estimated. This uncertainty contributes to a large and spread-out confidence interval which is important to consider when one is intending to make comparisons between CAD algorithms trained on different data sets. The method is validated using a Monte Carlo method designed to capture the effect of correctly determining the system threshold.

Citation Download Citation

Hans Bornefalk "Proposal and validation of a method to construct confidence intervals for clinical outcomes around FROC curves for mammography CAD systems", Proc. SPIE 5747, Medical Imaging 2005: Image Processing, (29 April 2005); https://doi.org/10.1117/12.593735

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available