English

Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction

Computer Vision and Pattern Recognition 2025-01-29 v3 Machine Learning

Abstract

Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored challenge. Using a diffusion model on an out-of-distribution dataset, realistic reconstructions can be generated, but with hallucinating image features that are uniquely present in the training dataset. To address this discrepancy during train-test time and improve reconstruction accuracy, we introduce a novel sampling framework called Steerable Conditional Diffusion. Specifically, this framework adapts the diffusion model, concurrently with image reconstruction, based solely on the information provided by the available measurement. Utilising our proposed method, we achieve substantial enhancements in out-of-distribution performance across diverse imaging modalities, advancing the robust deployment of denoising diffusion models in real-world applications.

Keywords

Cite

@article{arxiv.2308.14409,
  title  = {Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction},
  author = {Riccardo Barbano and Alexander Denker and Hyungjin Chung and Tae Hoon Roh and Simon Arridge and Peter Maass and Bangti Jin and Jong Chul Ye},
  journal= {arXiv preprint arXiv:2308.14409},
  year   = {2025}
}