English
Related papers

Related papers: Diffusion assisted image reconstruction in optoaco…

200 papers

State-of-the-art diffusion models can generate highly realistic images based on various conditioning like text, segmentation, and depth. However, an essential aspect often overlooked is the specific camera geometry used during image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Andrey Voynov , Amir Hertz , Moab Arar , Shlomi Fruchter , Daniel Cohen-Or

Text-to-image diffusion models have demonstrated an impressive ability to produce high-quality outputs. However, they often struggle to accurately follow fine-grained spatial information in an input text. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ran Galun , Sagie Benaim

We investigate the construction of gradient-guided conditional diffusion models for reconstructing private images, focusing on the adversarial interplay between differential privacy noise and the denoising capabilities of diffusion models.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Tao Huang , Jiayang Meng , Hong Chen , Guolong Zheng , Xu Yang , Xun Yi , Hua Wang

Diffusion models have been demonstrated as powerful deep learning tools for image generation in CT reconstruction and restoration. Recently, diffusion posterior sampling, where a score-based diffusion prior is combined with a likelihood…

Medical Physics · Physics 2024-09-02 Shudong Li , Xiao Jiang , Matthew Tivnan , Grace J. Gang , Yuan Shen , J. Webster Stayman

We consider the imaging problem of the reconstruction of a three-dimensional object via optical diffraction tomography under the assumptions of the Born approximation. Our focus lies in the situation that a rigid object performs an…

Numerical Analysis · Mathematics 2024-07-11 Robert Beinert , Michael Quellmalz

Acoustic-resolution optoacoustic microscopy (AR-OAM) retrieves anatomical and functional contrast from living tissues at depths not reachable with optical microscopy. The imaging performance of AR-OAM has been advanced with image…

Diffusion models has underpinned much recent advances of dataset augmentation in various computer vision tasks. However, when involving generating multi-object images as real scenarios, most existing methods either rely entirely on text…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haoyu Wang , Lei Zhang , Wei Wei , Chen Ding , Yanning Zhang

Diffusion bridge models establish probabilistic paths between arbitrary paired distributions and exhibit great potential for universal image restoration. Most existing methods merely treat them as simple variants of stochastic interpolants,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Hebaixu Wang , Jing Zhang , Haoyang Chen , Haonan Guo , Di Wang , Jiayi Ma , Bo Du

The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diffusion models have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ruofan Liang , Zan Gojcic , Merlin Nimier-David , David Acuna , Nandita Vijaykumar , Sanja Fidler , Zian Wang

We propose a simple but effective training-free approach tailored to diffusion-based image-to-image translation. Our approach revises the original noise prediction network of a pretrained diffusion model by introducing a noise correction…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Junsung Lee , Minsoo Kang , Bohyung Han

In this paper, we propose an approach combining diffusion models and inverse problems for the reconstruction of circumstellar disk images. Our method builds upon the Rhapsodie framework for polarimetric imaging, substituting its classical…

Instrumentation and Methods for Astrophysics · Physics 2025-10-17 Quentin Villegas , Laurence Denneulin , Simon Prunet , André Ferrari , Nelly Pustelnik , Éric Thiébaut , Julian Tachella , Maud Langlois

In optical tomography a physical body is illuminated with near-infrared light and the resulting outward photon flux is measured at the object boundary. The goal is to reconstruct internal optical properties of the body, such as absorption…

Numerical Analysis · Mathematics 2016-01-20 Antti Hannukainen , Lauri Harhanen , Nuutti Hyvönen , Helle Majander

Diffusion models have shown exceptional scaling properties in the image synthesis domain, and initial attempts have shown similar benefits for applying diffusion to unconditional text synthesis. Denoising diffusion models attempt to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-17 Matthew Baas , Kevin Eloff , Herman Kamper

Anatomically guided PET reconstruction using MRI information has been shown to have the potential to improve PET image quality. However, these improvements are limited to PET scans with paired MRI information. In this work we employed a…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Weijie Gan , Huidong Xie , Carl von Gall , Günther Platsch , Michael T. Jurkiewicz , Andrea Andrade , Udunna C. Anazodo , Ulugbek S. Kamilov , Hongyu An , Jorge Cabello

Recent developments in application of deep learning models to acoustic Full Waveform Inversion (FWI) are marked by the use of diffusion models as prior distributions for Bayesian-like inference procedures. The advantage of these methods is…

Machine Learning · Computer Science 2025-06-19 A. S. Stankevich , I. B. Petrov

We present a conditional diffusion model for electromagnetic inverse design that generates structured media geometries directly from target differential scattering cross-section profiles, bypassing expensive iterative optimization. Our 1D…

Machine Learning · Computer Science 2025-11-10 Mikhail Tsukerman , Konstantin Grotov , Pavel Ginzburg

The attenuation of ultrasound waves in photoacoustic and thermoacoustic imaging presents an important drawback in the applicability of these modalities. This issue has been addressed previously in the applied and theoretical literature, and…

Analysis of PDEs · Mathematics 2021-09-15 Benjamin Palacios

This paper introduces an audio-visual speech enhancement system that leverages score-based generative models, also known as diffusion models, conditioned on visual information. In particular, we exploit audio-visual embeddings obtained from…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-05 Julius Richter , Simone Frintrop , Timo Gerkmann

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Matt C. Bendel , Saurav K. Shastri , Rizwan Ahmad , Philip Schniter