TY - JOUR

T1 - Risk analysis, ideal observers, and receiver operating characteristic curves for tasks that combine detection and estimation

AU - Clarkson, Eric

N1 - Funding Information:
This material was based upon work supported by the National Institutes of Health under R01-EB000803 and P41-EB002035 and by the Department of Homeland Security under Contract No. HSHQDC-14-C-BOOIO.
Publisher Copyright:
© 2019 Society of Photo-Optical Instrumentation Engineers (SPIE).

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Previously published work on joint estimation/detection tasks has focused on the area under the estimation receiver operating characteristic (EROC) curve as a figure of merit (FOM) for these tasks in imaging. Another FOM for these joint tasks is the Bayesian risk, where a cost is assigned to all detection outcomes and to the estimation errors, and then averaged over all sources of randomness in the object ensemble and the imaging system. Important elements of the cost function, which are not included in standard EROC analysis, are that the cost for a false positive depends on the estimate produced for the parameter vector, and the cost for a false negative depends on the true value of the parameter vector. The ideal observer in this setting, which minimizes the risk, is derived for two applications. In the first application, a parameter vector is estimated only in the case of a signal present classification. For the second application, parameter vectors are estimated for either classification, and these vectors may have different dimensions. In both applications, a risk-based estimation receiver operating characteristic curve is defined and an expression for the area under this curve is given. It is also shown that, for some observers, this area may be estimated from a two alternative forced choice test. Finally, if the classifier is optimized for a given estimator, then it is shown that the slope of the risk-based estimation receiver operating characteristic curve at each point is the negative of the ratio of the prior probabilities for the two classes.

AB - Previously published work on joint estimation/detection tasks has focused on the area under the estimation receiver operating characteristic (EROC) curve as a figure of merit (FOM) for these tasks in imaging. Another FOM for these joint tasks is the Bayesian risk, where a cost is assigned to all detection outcomes and to the estimation errors, and then averaged over all sources of randomness in the object ensemble and the imaging system. Important elements of the cost function, which are not included in standard EROC analysis, are that the cost for a false positive depends on the estimate produced for the parameter vector, and the cost for a false negative depends on the true value of the parameter vector. The ideal observer in this setting, which minimizes the risk, is derived for two applications. In the first application, a parameter vector is estimated only in the case of a signal present classification. For the second application, parameter vectors are estimated for either classification, and these vectors may have different dimensions. In both applications, a risk-based estimation receiver operating characteristic curve is defined and an expression for the area under this curve is given. It is also shown that, for some observers, this area may be estimated from a two alternative forced choice test. Finally, if the classifier is optimized for a given estimator, then it is shown that the slope of the risk-based estimation receiver operating characteristic curve at each point is the negative of the ratio of the prior probabilities for the two classes.

KW - Bayesian ideal observers

KW - estimation receiver operating characteristic curves

KW - image quality assessment

KW - probabilistic and statistical methods

KW - quantification and estimation

KW - receiver operating characteristic analysis

UR - http://www.scopus.com/inward/record.url?scp=85062628608&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062628608&partnerID=8YFLogxK

U2 - 10.1117/1.JMI.6.1.015502

DO - 10.1117/1.JMI.6.1.015502

M3 - Article

AN - SCOPUS:85062628608

SN - 2329-4302

VL - 6

JO - Journal of Medical Imaging

JF - Journal of Medical Imaging

IS - 1

M1 - 015502

ER -