English
Related papers

Related papers: DDFM: Denoising Diffusion Model for Multi-Modality…

200 papers

Multimodal medical image fusion (MMIF) extracts the most meaningful information from multiple source images, enabling a more comprehensive and accurate diagnosis. Achieving high-quality fusion results requires a careful balance of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Dan He , Weisheng Li , Guofen Wang , Yuping Huang , Shiqiang Liu

Image fusion is famous as an alternative solution to generate one high-quality image from multiple images in addition to image restoration from a single degraded image. The essence of image fusion is to integrate complementary information…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Pengwei Liang , Junjun Jiang , Qing Ma , Xianming Liu , Jiayi Ma

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Denoising diffusion probabilistic models (DDPMs) are a recent family of generative models that achieve state-of-the-art results. In order to obtain class-conditional generation, it was suggested to guide the diffusion process by gradients…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Bahjat Kawar , Roy Ganz , Michael Elad

In clinical practice, tri-modal medical image fusion, compared to the existing dual-modal technique, can provide a more comprehensive view of the lesions, aiding physicians in evaluating the disease's shape, location, and biological…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yushen Xu , Xiaosong Li , Yuchan Jie , Haishu Tan

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

In this paper, conditional denoising diffusion probabilistic models (DDPMs) are proposed to enhance the data transmission and reconstruction over wireless channels. The underlying mechanism of DDPM is to decompose the data generation…

Information Theory · Computer Science 2024-11-21 Mehdi Letafati , Samad Ali , Matti Latva-aho

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

Image synthesis under multi-modal priors is a useful and challenging task that has received increasing attention in recent years. A major challenge in using generative models to accomplish this task is the lack of paired data containing all…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Nithin Gopalakrishnan Nair , Wele Gedara Chaminda Bandara , Vishal M Patel

Image dehazing is quite challenging in dense-haze scenarios, where quite less original information remains in the hazy image. Though previous methods have made marvelous progress, they still suffer from information loss in content and color…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hu Yu , Jie Huang , Kaiwen Zheng , Feng Zhao

Multi-modal image fusion aims to integrate complementary information from multiple source images to produce high-quality fused images with enriched content. Although existing approaches based on state space model have achieved satisfied…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yiming Sun , Zifan Ye , Qinghua Hu , Pengfei Zhu

Multi-focus image fusion aims to generate an all-in-focus image from a sequence of partially focused input images. Existing fusion algorithms generally assume that, for every spatial location in the scene, there is at least one input image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Xinzhe Xie , Buyu Guo , Bolin Li , Shuangyan He , Yanzhen Gu , Qingyan Jiang , Peiliang Li

Deep generative models are key-enabling technology to computer vision, text generation, and large language models. Denoising diffusion probabilistic models (DDPMs) have recently gained much attention due to their ability to generate diverse…

Quantum Physics · Physics 2026-02-02 Bingzhi Zhang , Peng Xu , Xiaohui Chen , Quntao Zhuang

Infrared and visible image fusion aims to utilize the complementary information from two modalities to generate fused images with prominent targets and rich texture details. Most existing algorithms only perform pixel-level or feature-level…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Kun Hu , Qingle Zhang , Maoxun Yuan , Yitian Zhang

Denoising diffusion probabilistic models (DDPMs) have achieved unprecedented success in computer vision. However, they remain underutilized in medical imaging, a field crucial for disease diagnosis and treatment planning. This is primarily…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Hongxu Jiang , Muhammad Imran , Teng Zhang , Yuyin Zhou , Muxuan Liang , Kuang Gong , Wei Shao

Multi-Focus Image Fusion (MFIF) is a promising image enhancement technique to obtain all-in-focus images meeting visual needs and it is a precondition of other computer vision tasks. One of the research trends of MFIF is to avoid the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yicheng Wang , Shuang Xu , Junmin Liu , Zixiang Zhao , Chunxia Zhang , Jiangshe Zhang

The pose-guided person image generation task requires synthesizing photorealistic images of humans in arbitrary poses. The existing approaches use generative adversarial networks that do not necessarily maintain realistic textures or need…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ankan Kumar Bhunia , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

We present a masked-guided approach for a denoising diffusion probabilistic model (DDPM) trained to generate and inpaint realistic radio galaxy images. The inpainting capability is particularly relevant for reconstructing incomplete…

Astrophysics of Galaxies · Physics 2026-05-26 Rémi Poitevineau , Emma Tolley , Verlon Etsebeth

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

Diffusion models have recently exhibited remarkable abilities to synthesize striking image samples since the introduction of denoising diffusion probabilistic models (DDPMs). Their key idea is to disrupt images into noise through a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zijian Zhang , Zhou Zhao , Jun Yu , Qi Tian