中文
相关论文

相关论文: DDFM: Denoising Diffusion Model for Multi-Modality…

200 篇论文

Image denoising is a fundamental problem in computational photography, where achieving high perception with low distortion is highly demanding. Current methods either struggle with perceptual quality or suffer from significant distortion.…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Tong Li , Hansen Feng , Lizhi Wang , Zhiwei Xiong , Hua Huang

Diffusion probabilistic models (DPMs) have become a popular approach to conditional generation, due to their promising results and support for cross-modal synthesis. A key desideratum in conditional synthesis is to achieve high…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Ye Zhu , Yu Wu , Kyle Olszewski , Jian Ren , Sergey Tulyakov , Yan Yan

This study explores the generation of synthesized fingerprint images using Denoising Diffusion Probabilistic Models (DDPMs). The significant obstacles in collecting real biometric data, such as privacy concerns and the demand for diverse…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Freddie Grabovski , Lior Yasur , Yaniv Hacmon , Lior Nisimov , Stav Nimrod

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Tao Luo , Weihua Xu

Multi-modal magnetic resonance imaging (MRI) provides rich, complementary information for analyzing diseases. However, the practical challenges of acquiring multiple MRI modalities, such as cost, scan time, and safety considerations, often…

图像与视频处理 · 电气工程与系统科学 2024-09-16 Zhaohu Xing , Sicheng Yang , Sixiang Chen , Tian Ye , Yijun Yang , Jing Qin , Lei Zhu

Existing fusion methods are tailored for high-quality images but struggle with degraded images captured under harsh circumstances, thus limiting the practical potential of image fusion. This work presents a \textbf{D}egradation and…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Linfeng Tang , Chunyu Li , Guoqing Wang , Yixuan Yuan , Jiayi Ma

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been…

图像与视频处理 · 电气工程与系统科学 2022-06-28 Boah Kim , Jong Chul Ye

Generative adversarial networks (GANs) are frequently utilized in astronomy to construct an emulator of numerical simulations. Nevertheless, training GANs can prove to be a precarious task, as they are prone to instability and often lead to…

天体物理仪器与方法 · 物理学 2023-11-14 Xiaosheng Zhao , Yuan-Sen Ting , Kangning Diao , Yi Mao

Balancing content fidelity and artistic style is a pivotal challenge in image generation. While traditional style transfer methods and modern Denoising Diffusion Probabilistic Models (DDPMs) strive to achieve this balance, they often…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Nadav Z. Cohen , Oron Nir , Ariel Shamir

We present a novel generative approach based on Denoising Diffusion Models (DDMs), which produces high-quality image samples along with their losslessly compressed bit-stream representations. This is obtained by replacing the standard…

图像与视频处理 · 电气工程与系统科学 2025-07-29 Guy Ohayon , Hila Manor , Tomer Michaeli , Michael Elad

Color plays an important role in human visual perception, reflecting the spectrum of objects. However, the existing infrared and visible image fusion methods rarely explore how to handle multi-spectral/channel data directly and achieve high…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Jun Yue , Leyuan Fang , Shaobo Xia , Yue Deng , Jiayi Ma

Image fusion typically employs non-invertible neural networks to merge multiple source images into a single fused image. However, for clinical experts, solely relying on fused images may be insufficient for making diagnostic decisions, as…

图像与视频处理 · 电气工程与系统科学 2024-06-11 Nishant Kumar , Ziyan Tao , Jaikirat Singh , Yang Li , Peiwen Sun , Binghui Zhao , Stefan Gumhold

Image fusion aims to combine complementary information from multiple source images to generate more comprehensive scene representations. Existing methods primarily rely on the stacking and design of network architectures to enhance the…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Linli Ma , Suzhen Lin , Jianchao Zeng , Zanxia Jin , Yanbo Wang , Fengyuan Li , Yubing Luo

Current multispectral object detection methods often retain extraneous background or noise during feature fusion, limiting perceptual performance. To address this, we propose an innovative feature fusion framework based on cross-modal…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Jifeng Shen , Haibo Zhan , Xin Zuo , Heng Fan , Xiaohui Yuan , Jun Li , Wankou Yang

Novel-view synthesis through diffusion models has demonstrated remarkable potential for generating diverse and high-quality images. Yet, the independent process of image generation in these prevailing methods leads to challenges in…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Xianghui Yang , Yan Zuo , Sameera Ramasinghe , Loris Bazzani , Gil Avraham , Anton van den Hengel

Denoising diffusion probabilistic models (DDPMs) (Ho et al. 2020) have shown impressive results on image and waveform generation in continuous state spaces. Here, we introduce Discrete Denoising Diffusion Probabilistic Models (D3PMs),…

机器学习 · 计算机科学 2023-02-23 Jacob Austin , Daniel D. Johnson , Jonathan Ho , Daniel Tarlow , Rianne van den Berg

Audio-driven simultaneous gesture generation is vital for human-computer communication, AI games, and film production. While previous research has shown promise, there are still limitations. Methods based on VAEs are accompanied by issues…

声音 · 计算机科学 2024-11-04 Yongkang Cheng , Mingjiang Liang , Shaoli Huang , Gaoge Han , Jifeng Ning , Wei Liu

Diffusion models have emerged as a prominent technique in generative modeling with neural networks, making their mark in tasks like text-to-image translation and super-resolution. In this tutorial, we provide a comprehensive guide to build…

图像与视频处理 · 电气工程与系统科学 2025-01-24 Harshith Bachimanchi , Giovanni Volpe

Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a…

图像与视频处理 · 电气工程与系统科学 2022-09-15 Kuang Gong , Keith A. Johnson , Georges El Fakhri , Quanzheng Li , Tinsu Pan

We propose residual denoising diffusion models (RDDM), a novel dual diffusion process that decouples the traditional single denoising diffusion process into residual diffusion and noise diffusion. This dual diffusion framework expands the…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Jiawei Liu , Qiang Wang , Huijie Fan , Yinong Wang , Yandong Tang , Liangqiong Qu