C E Metz

Summary

Affiliation: University of Chicago
Country: USA

Publications

  1. ncbi request reprint Statistical comparison of two ROC-curve estimates obtained from partially-paired datasets
    C E Metz
    Department of Radiology, The University of Chicago Medical Center, Illinois 60637 1470, USA
    Med Decis Making 18:110-21. 1998
  2. ncbi request reprint Receiver operating characteristic analysis: a tool for the quantitative evaluation of observer performance and imaging systems
    Charles E Metz
    Department of Radiology, University of Chicago, Chicago, IL 60637, USA
    J Am Coll Radiol 3:413-22. 2006
  3. doi request reprint ROC analysis in medical imaging: a tutorial review of the literature
    Charles E Metz
    Radiology and Medical Physics, The University of Chicago, Chicago, IL, USA
    Radiol Phys Technol 1:2-12. 2008
  4. ncbi request reprint Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data
    C E Metz
    Department of Radiology, University of Chicago Medical Center, IL 60637 1470, USA
    Stat Med 17:1033-53. 1998
  5. ncbi request reprint An ROC comparison of four methods of combining information from multiple images of the same patient
    Bei Liu
    Kurt Rossmann Laboratories for Radiologic Image Research, Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
    Med Phys 31:2552-63. 2004
  6. ncbi request reprint Three-class ROC analysis--a decision theoretic approach under the ideal observer framework
    Xin He
    Department of Radiology, Johns Hopkins School of Medicine, Baltimore, MD 21287, USA
    IEEE Trans Med Imaging 25:571-81. 2006
  7. ncbi request reprint Comparison of independent double readings and computer-aided diagnosis (CAD) for the diagnosis of breast calcifications
    Yulei Jiang
    Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637
    Acad Radiol 13:84-94. 2006
  8. pmc Reliable and computationally efficient maximum-likelihood estimation of "proper" binormal ROC curves
    Lorenzo L Pesce
    Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637 1470, USA
    Acad Radiol 14:814-29. 2007
  9. ncbi request reprint Restrictions on the three-class ideal observer's decision boundary lines
    Darrin C Edwards
    Department of Radiology, The University of Chicago, 5841 S Maryland Ave, Chicago, IL 60637, USA
    IEEE Trans Med Imaging 24:1566-73. 2005
  10. ncbi request reprint A quadratic model for combining quantitative diagnostic assessments from radiologist and computer in computer-aided diagnosis
    Yulei Jiang
    Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
    Acad Radiol 13:140-51. 2006

Detail Information

Publications35

  1. ncbi request reprint Statistical comparison of two ROC-curve estimates obtained from partially-paired datasets
    C E Metz
    Department of Radiology, The University of Chicago Medical Center, Illinois 60637 1470, USA
    Med Decis Making 18:110-21. 1998
    ..The type I error rates of the new algorithm's statistical test for differences in Az estimates were excellent for datasets typically encountered in practice, but diverged from alpha for datasets arising from some extreme situations...
  2. ncbi request reprint Receiver operating characteristic analysis: a tool for the quantitative evaluation of observer performance and imaging systems
    Charles E Metz
    Department of Radiology, University of Chicago, Chicago, IL 60637, USA
    J Am Coll Radiol 3:413-22. 2006
    ..Receiver operating characteristic methodology has reached a level of maturity at which it can be recommended broadly as the approach of choice for radiologic imaging system comparisons...
  3. doi request reprint ROC analysis in medical imaging: a tutorial review of the literature
    Charles E Metz
    Radiology and Medical Physics, The University of Chicago, Chicago, IL, USA
    Radiol Phys Technol 1:2-12. 2008
    ..Finally, generalized forms of ROC analysis that require lesion localization or allow more than two states of truth are surveyed briefly...
  4. ncbi request reprint Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data
    C E Metz
    Department of Radiology, University of Chicago Medical Center, IL 60637 1470, USA
    Stat Med 17:1033-53. 1998
    ..Simulation studies indicate that both algorithms produce reliable estimates of the binormal ROC curve parameters a and b, the ROC-area index Az, and the standard errors of those estimates...
  5. ncbi request reprint An ROC comparison of four methods of combining information from multiple images of the same patient
    Bei Liu
    Kurt Rossmann Laboratories for Radiologic Image Research, Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
    Med Phys 31:2552-63. 2004
    ..These results can be used as a guide in attempting to increase the efficacy of CAD when multiple images are available from the same patient...
  6. ncbi request reprint Three-class ROC analysis--a decision theoretic approach under the ideal observer framework
    Xin He
    Department of Radiology, Johns Hopkins School of Medicine, Baltimore, MD 21287, USA
    IEEE Trans Med Imaging 25:571-81. 2006
    ..The volume under the three-class surface (VUS) serves as a figure-of-merit to evaluate different data acquisition systems or image processing and reconstruction methods when the assumed utility constraints are relevant...
  7. ncbi request reprint Comparison of independent double readings and computer-aided diagnosis (CAD) for the diagnosis of breast calcifications
    Yulei Jiang
    Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637
    Acad Radiol 13:84-94. 2006
    ..The aim of the study is to compare independent double readings by radiologists and computer-aided diagnosis (CAD) in diagnostic interpretation of mammographic calcifications...
  8. pmc Reliable and computationally efficient maximum-likelihood estimation of "proper" binormal ROC curves
    Lorenzo L Pesce
    Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637 1470, USA
    Acad Radiol 14:814-29. 2007
    ..Therefore, we created an entirely new algorithm to implement the PBM...
  9. ncbi request reprint Restrictions on the three-class ideal observer's decision boundary lines
    Darrin C Edwards
    Department of Radiology, The University of Chicago, 5841 S Maryland Ave, Chicago, IL 60637, USA
    IEEE Trans Med Imaging 24:1566-73. 2005
    ..As a result, we show that the relationship between the decision criteria and the misclassification probabilities is not one-to-one, as it is for the two-class ideal observer...
  10. ncbi request reprint A quadratic model for combining quantitative diagnostic assessments from radiologist and computer in computer-aided diagnosis
    Yulei Jiang
    Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
    Acad Radiol 13:140-51. 2006
    ....
  11. ncbi request reprint Breast cancer detection rate: designing imaging trials to demonstrate improvements
    Yulei Jiang
    Department of Radiology, University of Chicago, 5841 S Maryland Ave, MC2026, Chicago, IL 60637, USA
    Radiology 243:360-7. 2007
    ..To estimate the extent of variability in screening mammography cancer detection rates and its effect on a hypothetical clinical trial of a new screening modality used to measure changes in cancer detection rate...
  12. ncbi request reprint Optimization of restricted ROC surfaces in three-class classification tasks
    Darrin C Edwards
    Department of Radiology, University of Chicago, Chicago, IL 60637, USA
    IEEE Trans Med Imaging 26:1345-56. 2007
    ....
  13. ncbi request reprint Lung cancers missed on chest radiographs: results obtained with a commercial computer-aided detection program
    Feng Li
    Kurt Rossmann Laboratories for Radiologic Image Research, Department of Radiology, MC 2026, University of Chicago, 5841 S Maryland Ave, Chicago, IL 60637, USA
    Radiology 246:273-80. 2008
    ....
  14. doi request reprint Potential effect of different radiologist reporting methods on studies showing benefit of CAD
    Karla Horsch
    University of Chicago, Department of Radiology, 5841 South Maryland Avenue, Chicago, IL 60637, USA
    Acad Radiol 15:139-52. 2008
    ..To investigate the effect of different reporting methods and performance measures on the assessment of the benefit of computer-aided diagnosis (CAD) in characterizing malignant and benign breast lesions on mammography and sonography...
  15. pmc Prevalence scaling: applications to an intelligent workstation for the diagnosis of breast cancer
    Karla Horsch
    Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
    Acad Radiol 15:1446-57. 2008
    ....
  16. ncbi request reprint Effect of correlation on combining diagnostic information from two images of the same patient
    Bei Liu
    Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
    Med Phys 32:3329-38. 2005
    ..These theoretical results are illustrated with analysis of a mammography study...
  17. ncbi request reprint Robustness of computerized lesion detection and classification scheme across different breast US platforms
    Karen Drukker
    Department of Radiology MC2026, University of Chicago, 5841 S Maryland Ave, Chicago, IL 60637, USA
    Radiology 237:834-40. 2005
    ..To evaluate the performance of a computerized detection and diagnosis method with breast ultrasonographic (US) images obtained with US equipment from two different manufacturers...
  18. ncbi request reprint Computerized analysis of digitized mammograms of BRCA1 and BRCA2 gene mutation carriers
    Zhimin Huo
    Department of Radiology, University of Chicago, 5841 S Maryland Ave, Chicago, IL 60637, USA
    Radiology 225:519-26. 2002
    ..To evaluate, by using computer image analysis, the mammographic density patterns of women with germ-line mutations in BRCA1 and BRCA2 genes in comparison with those of women at low risk of developing breast cancer...
  19. ncbi request reprint The hypervolume under the ROC hypersurface of "near-guessing" and "near-perfect" observers in N-class classification tasks
    Darrin C Edwards
    Department of Radiology, The University of Chicago, 5841 So Maryland Avenue, Chicago, IL 60637, USA
    IEEE Trans Med Imaging 24:293-9. 2005
    ..This suggests that hypervolume may not be a useful performance metric in N-class classification tasks for N > 2, despite the utility of the area under the ROC curve for two-class tasks...
  20. pmc Ideal observers and optimal ROC hypersurfaces in N-class classification
    Darrin C Edwards
    Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
    IEEE Trans Med Imaging 23:891-5. 2004
    ....
  21. ncbi request reprint Maximum likelihood fitting of FROC curves under an initial-detection-and-candidate-analysis model
    Darrin C Edwards
    Kurt Rossmann Laboratories for Radiologic Image Research, Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
    Med Phys 29:2861-70. 2002
    ..Although developed primarily with computer vision schemes in mind, we hope that the methodology presented here will prove worthy of further study in other applications as well...
  22. ncbi request reprint Estimating three-class ideal observer decision variables for computerized detection and classification of mammographic mass lesions
    Darrin C Edwards
    Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
    Med Phys 31:81-90. 2004
    ....
  23. ncbi request reprint Short-scan SPECT imaging with non-uniform attenuation and 3D distance-dependent spatial resolution
    Xiaochuan Pan
    Department of Radiology, University of Chicago, 5841 S Maryland Avenue, Chicago, IL 60637, USA
    Phys Med Biol 47:2811-33. 2002
    ..We conduct computer simulation studies, and the results from these studies corroborate the observations obtained based upon the heuristic potato peeler perspective...
  24. ncbi request reprint Computer-aided diagnosis in chest radiography: results of large-scale observer tests at the 1996-2001 RSNA scientific assemblies
    Hiroyuki Abe
    Kurt Rossmann Laboratories for Radiologic Image Research, Department of Radiology, MC 2026, University of Chicago, 5841 S Maryland Ave, Chicago, IL 60637, USA
    Radiographics 23:255-65. 2003
    ..This result provides additional evidence that CAD has the potential to improve the performance of radiologists in their decision-making process in interpreting chest radiographs...
  25. ncbi request reprint Breast cancer: effectiveness of computer-aided diagnosis observer study with independent database of mammograms
    Zhimin Huo
    Department of Radiology, University of Chicago, 5841 S Maryland Ave, MC2026, Chicago, IL 60637, USA
    Radiology 224:560-8. 2002
    ..To evaluate the effectiveness of a computerized classification method as an aid to radiologists reviewing clinical mammograms for which the diagnoses were unknown to both the radiologists and the computer...
  26. pmc Experimental design and data analysis in receiver operating characteristic studies: lessons learned from reports in radiology from 1997 to 2006
    Junji Shiraishi
    Kurt Rossmann Laboratories for Radiologic Image Research, Department of Radiology, University of Chicago, Chicago, IL, USA
    Radiology 253:822-30. 2009
    ....
  27. ncbi request reprint Computer-aided diagnosis of pulmonary nodules: results of a large-scale observer test
    H MacMahon
    Department of Radiology, University of Chicago, IL 60637, USA
    Radiology 213:723-6. 1999
    ..To determine the effect of computer-aided diagnosis (CAD) on the accuracy of pulmonary nodule detection...
  28. ncbi request reprint Ideal observer approximation using Bayesian classification neural networks
    M A Kupinski
    Department of Radiology, University of Chicago, IL 60637, USA
    IEEE Trans Med Imaging 20:886-99. 2001
    ..However, the minimum number of hidden units required to best model the optimal mapping function varies with the complexity of the data...
  29. pmc On the convexity of ROC curves estimated from radiological test results
    Lorenzo L Pesce
    Department of Radiology, The University of Chicago Medical Center, IL 60637 1470, USA
    Acad Radiol 17:960-968.e4. 2010
    ..This article aims to identify the practical implications of nonconvex ROC curves and the conditions that can lead to empirical or fitted ROC curves that are not convex...
  30. ncbi request reprint Assessment of medical imaging and computer-assist systems: lessons from recent experience
    Robert F Wagner
    Office of Science and Technology, Center for Devices and Radiological Health, Food and Drug Administraton, Rockville, MD 20857, USA
    Acad Radiol 9:1264-77. 2002
    ..General principles of study design are reviewed, and important contemporary clinical trials are used as examples...
  31. ncbi request reprint Assessment of medical imaging systems and computer aids: a tutorial review
    Robert F Wagner
    Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration, Rockville, MD 20850, USA
    Acad Radiol 14:723-48. 2007
    ..Many practical issues related to study design and resulting statistical power are included, together with recent developments and availability of analytical software...
  32. pmc Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis
    Stephen L Hillis
    Center for Research in the Implementation of Innovative Strategies in Practice CRIISP, Iowa City VA Medical Center 152, Iowa City, IA, USA
    Acad Radiol 15:647-61. 2008
    ..Recently, solutions to these problems have been presented in three papers. Our purpose is to summarize and provide an overview of these recent developments...
  33. ncbi request reprint Thoughts on the ZOM/BWC controversy
    Charles E Metz
    Acad Radiol 10:1178-9; author reply 1179-80. 2003
  34. ncbi request reprint Assessment methodologies and statistical issues for computer-aided diagnosis of lung nodules in computed tomography: contemporary research topics relevant to the lung image database consortium
    Lori E Dodd
    Biometrics Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, 6130 Executive Blvd, MSC 7434, Bethesda, MD 20892, USA
    Acad Radiol 11:462-75. 2004
    ..We review methods for performance assessment and discuss issues of defining "truth" as well as the complications that arise when truth information is not available. We also discuss issues about sizing and populating a database...
  35. ncbi request reprint Computer-aided screening mammography
    Robert M Nishikawa
    N Engl J Med 357:84; author reply 85. 2007