Skip to main navigation Skip to search Skip to main content

AmbientCycleGAN for Establishing Interpretable Stochastic Object Models Based on Mathematical Phantoms and Medical Imaging Measurements

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Medical imaging systems that are designed for producing diagnostically informative images should be objectively assessed via task-based measures of image quality (IQ). Ideally, computation of task-based measures of IQ needs to account for all sources of randomness in the measurement data, including the variability in the ensemble of objects to be imaged. To address this need, stochastic object models (SOMs) that can generate an ensemble of synthesized objects or phantoms can be employed. Various mathematical SOMs or phantoms were developed that can interpretably synthesize objects, such as lumpy object models and parameterized torso phantoms. However, such SOMs that are purely mathematically defined may not be able to comprehensively capture realistic object variations. To establish realistic SOMs, it is desirable to use experimental data. An augmented generative adversarial network (GAN), AmbientGAN, was recently proposed for establishing SOMs from medical imaging measurements. However, it remains unclear to which extent the AmbientGAN-produced objects can be interpretably controlled. This work introduces a novel approach called AmbientCycleGAN that translates mathematical SOMs to realistic SOMs by use of noisy measurement data. Numerical studies that consider clustered lumpy background (CLB) models and real mammograms are conducted. It is demonstrated that our proposed method can stably establish SOMs based on mathematical models and noisy measurement data. Moreover, the ability of the proposed AmbientCycleGAN to interpretably control image features in the synthesized objects is investigated.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2024
Subtitle of host publicationImage Perception, Observer Performance, and Technology Assessment
EditorsClaudia R. Mello-Thoms, Claudia R. Mello-Thoms, Yan Chen
PublisherSPIE
ISBN (Electronic)9781510671621
DOIs
StatePublished - 2024
Externally publishedYes
EventMedical Imaging 2024: Image Perception, Observer Performance, and Technology Assessment - San Diego, United States
Duration: Feb 20 2024 → Feb 22 2024

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume12929
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2024: Image Perception, Observer Performance, and Technology Assessment
Country/TerritoryUnited States
CitySan Diego
Period2/20/24 → 2/22/24

Keywords

  • AmbientCycleGAN
  • Interpretable Object Control
  • Stochastic Object Model
  • Unpaired Image-to-Image Translation

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'AmbientCycleGAN for Establishing Interpretable Stochastic Object Models Based on Mathematical Phantoms and Medical Imaging Measurements'. Together they form a unique fingerprint.

Cite this