English
Related papers

Related papers: MedEdit: Counterfactual Diffusion-based Image Edit…

200 papers

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jay Whang , Mauricio Delbracio , Hossein Talebi , Chitwan Saharia , Alexandros G. Dimakis , Peyman Milanfar

Diffusion MRI (dMRI) is an important neuroimaging technique with high acquisition costs. Deep learning approaches have been used to enhance dMRI and predict diffusion biomarkers through undersampled dMRI. To generate more comprehensive raw…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Juanhua Zhang , Ruodan Yan , Alessandro Perelli , Xi Chen , Chao Li

Diffusion models are capable of generating impressive images conditioned on text descriptions, and extensions of these models allow users to edit images at a relatively coarse scale. However, the ability to precisely edit the layout,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Daniel Geng , Andrew Owens

Text-to-image generative models have achieved remarkable breakthroughs in recent years. However, their application in medical image generation still faces significant challenges, including small dataset sizes, and scarcity of medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Changlu Guo , Anders Nymark Christensen , Morten Rieger Hannemose

Score-based diffusion models provide a powerful way to model images using the gradient of the data distribution. Leveraging the learned score function as a prior, here we introduce a way to sample data from a conditional distribution given…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Hyungjin Chung , Jong Chul Ye

Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyuan Sun , Mingxiao Li , Marie-Francine Moens

Electrical impedance tomography (EIT) is a non-invasive imaging technique, capable of reconstructing images of the electrical conductivity of tissues and materials. It is popular in diverse application areas, from medical imaging to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Shuaikai Shi , Ruiyuan Kang , Panos Liatsis

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Anatomically guided PET reconstruction using MRI information has been shown to have the potential to improve PET image quality. However, these improvements are limited to PET scans with paired MRI information. In this work we employed a…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Weijie Gan , Huidong Xie , Carl von Gall , Günther Platsch , Michael T. Jurkiewicz , Andrea Andrade , Udunna C. Anazodo , Ulugbek S. Kamilov , Hongyu An , Jorge Cabello

Diffusion models have achieved remarkable success in image generation and editing tasks. Inversion within these models aims to recover the latent noise representation for a real or generated image, enabling reconstruction, editing, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zixiang Li , Haoyu Wang , Wei Wang , Chuangchuang Tan , Yunchao Wei , Yao Zhao

We present DiffPortrait3D, a conditional diffusion model that is capable of synthesizing 3D-consistent photo-realistic novel views from as few as a single in-the-wild portrait. Specifically, given a single RGB input, we aim to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuming Gu , You Xie , Hongyi Xu , Guoxian Song , Yichun Shi , Di Chang , Jing Yang , Linjie Luo

Accurate quantification in positron emission tomography (PET) is essential for accurate diagnostic results and effective treatment tracking. A major issue encountered in PET imaging is attenuation. Attenuation refers to the diminution of…

Ultrasound is a widely accessible and cost-effective medical imaging tool commonly used for prenatal evaluation of the fetal brain. However, it has limitations, particularly in the third trimester, where the complexity of the fetal brain…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Naomi Silverstein , Efrat Leibowitz , Ron Beloosesky , Haim Azhari

We propose an image synthesis mechanism for multi-sequence prostate MR images conditioned on text, to control lesion presence and sequence, as well as to generate paired bi-parametric images conditioned on images e.g. for generating…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Shaheer U. Saeed , Tom Syer , Wen Yan , Qianye Yang , Mark Emberton , Shonit Punwani , Matthew J. Clarkson , Dean C. Barratt , Yipeng Hu

Recent advances in deep learning have shown that learning robust feature representations is critical for the success of many computer vision tasks, including medical image segmentation. In particular, both transformer and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 David Li , Anvar Kurmukov , Mikhail Goncharov , Roman Sokolov , Mikhail Belyaev

Diffusion Handles is a novel approach to enabling 3D object edits on diffusion images. We accomplish these edits using existing pre-trained diffusion models, and 2D image depth estimation, without any fine-tuning or 3D object retrieval. The…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Karran Pandey , Paul Guerrero , Matheus Gadelha , Yannick Hold-Geoffroy , Karan Singh , Niloy Mitra

Image diffusion has recently shown remarkable performance in image synthesis and implicitly as an image prior. Such a prior has been used with conditioning to solve the inpainting problem, but only supporting binary user-based conditioning.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Majed El Helou

Text-to-image generative models have made remarkable advancements in generating high-quality images. However, generated images often contain undesirable artifacts or other errors due to model limitations. Existing techniques to fine-tune…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Peyman Gholami , Robert Xiao

Radiation hazards associated with standard-dose positron emission tomography (SPET) images remain a concern, whereas the quality of low-dose PET (LPET) images fails to meet clinical requirements. Therefore, there is great interest in…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Jiaqi Cui , Xinyi Zeng , Pinxian Zeng , Bo Liu , Xi Wu , Jiliu Zhou , Yan Wang

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka