中文
相关论文

相关论文: Unite and Conquer: Plug & Play Multi-Modal Synthes…

200 篇论文

Diffusion models have emerged as a leading technique for generating images due to their ability to create high-resolution and realistic images. Despite their strong performance, diffusion models still struggle in managing image collections…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Hailong Yang , Te Zhang , Kup-sze Choi , Zhaohong Deng

Denoising Diffusion Probabilistic Models (DDPMs) represent a contemporary class of generative models with exceptional qualities in both synthesis and maximizing the data likelihood. These models work by traversing a forward Markov Chain…

机器学习 · 计算机科学 2024-09-16 Hang Li , Wei Jin , Geri Skenderi , Harry Shomer , Wenzhuo Tang , Wenqi Fan , Jiliang Tang

Material reconstruction from a photograph is a key component of 3D content creation democratization. We propose to formulate this ill-posed problem as a controlled synthesis one, leveraging the recent progress in generative deep networks.…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Giuseppe Vecchio , Rosalie Martin , Arthur Roullier , Adrien Kaiser , Romain Rouffet , Valentin Deschaintre , Tamy Boubekeur

Generative adversarial networks (GANs) are frequently utilized in astronomy to construct an emulator of numerical simulations. Nevertheless, training GANs can prove to be a precarious task, as they are prone to instability and often lead to…

天体物理仪器与方法 · 物理学 2023-11-14 Xiaosheng Zhao , Yuan-Sen Ting , Kangning Diao , Yi Mao

Discrete diffusion models have recently shown significant progress in modeling complex data, such as natural languages and DNA sequences. However, unlike diffusion models for continuous data, which can generate high-quality samples in just…

机器学习 · 计算机科学 2025-03-20 Anji Liu , Oliver Broadrick , Mathias Niepert , Guy Van den Broeck

Diffusion models have demonstrated exceptional performances in various fields of generative modeling, but suffer from slow sampling speed due to their iterative nature. While this issue is being addressed in continuous domains, discrete…

机器学习 · 计算机科学 2025-05-12 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

With the rise of diffusion models, audio-video generation has been revolutionized. However, most existing methods rely on separate modules for each modality, with limited exploration of unified generative architectures. In addition, many…

多媒体 · 计算机科学 2025-07-08 Lei Zhao , Linfeng Feng , Dongxu Ge , Rujin Chen , Fangqiu Yi , Chi Zhang , Xiao-Lei Zhang , Xuelong Li

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

机器学习 · 计算机科学 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

Generative modeling of 3D LiDAR data is an emerging task with promising applications for autonomous mobile robots, such as scalable simulation, scene manipulation, and sparse-to-dense completion of LiDAR point clouds. While existing…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Kazuto Nakashima , Ryo Kurazume

We propose a novel and unified method, measurement-conditioned denoising diffusion probabilistic model (MC-DDPM), for under-sampled medical image reconstruction based on DDPM. Different from previous works, MC-DDPM is defined in measurement…

图像与视频处理 · 电气工程与系统科学 2022-03-09 Yutong Xie , Quanzheng Li

In controllable generation tasks, flexibly manipulating the generated images to attain a desired appearance or structure based on a single input image cue remains a critical and longstanding challenge. Achieving this requires the effective…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Xi Wang , Yichen Peng , Heng Fang , Yilin Wang , Haoran Xie , Xi Yang , Chuntao Li

In this paper, conditional denoising diffusion probabilistic models (DDPMs) are proposed to enhance the data transmission and reconstruction over wireless channels. The underlying mechanism of DDPM is to decompose the data generation…

信息论 · 计算机科学 2024-11-21 Mehdi Letafati , Samad Ali , Matti Latva-aho

Generative diffusion models trained on large-scale datasets have achieved remarkable progress in image synthesis. In favor of their ability to supplement missing details and generate aesthetically pleasing contents, recent works have…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Junhao Cheng , Wei-Ting Chen , Xi Lu , Ming-Hsuan Yang

Diffusion Purification, purifying noised images with diffusion models, has been widely used for enhancing certified robustness via randomized smoothing. However, existing frameworks often grapple with the balance between efficiency and…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Yiquan Li , Zhongzhu Chen , Kun Jin , Jiongxiao Wang , Bo Li , Chaowei Xiao

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Diffusion probabilistic model (DPM) recently becomes one of the hottest topic in computer vision. Its image generation application such as Imagen, Latent Diffusion Models and Stable Diffusion have shown impressive generation capabilities,…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Junde Wu , Rao Fu , Huihui Fang , Yu Zhang , Yehui Yang , Haoyi Xiong , Huiying Liu , Yanwu Xu

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

Predictive models trained on imbalanced data tend to produce biased results. This problem is exacerbated when there is not just one output label, but a set of them. This is the case for multilabel learning (MLL) algorithms used to classify…

Photon-counting computed tomography (PCCT) has emerged as a promising imaging technique, enabling spectral imaging and material decomposition (MD). However, images typically suffer from a low signal-to-noise ratio (SNR) due to constraints…

Diffusion models have emerged as a popular family of deep generative models (DGMs). In the literature, it has been claimed that one class of diffusion models -- denoising diffusion probabilistic models (DDPMs) -- demonstrate superior image…

图像与视频处理 · 电气工程与系统科学 2023-09-20 Rucha Deshpande , Muzaffer Özbey , Hua Li , Mark A. Anastasio , Frank J. Brooks