English
Related papers

Related papers: HAODiff: Human-Aware One-Step Diffusion via Dual-P…

200 papers

Prompt tuning has emerged as a lightweight strategy for adapting foundation models to downstream tasks, particularly for resource-constrained systems. As pre-trained prompts become valuable assets, combining multiple source prompts offers a…

Computation and Language · Computer Science 2025-10-16 Enming Zhang , Liwen Cao , Yanru Wu , Zijie Zhao , Yang Li

Diffusion models have shown promising results in speech enhancement, using a task-adapted diffusion process for the conditional generation of clean speech given a noisy mixture. However, at test time, the neural network used for score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Bunlong Lay , Jean-Marie Lemercier , Julius Richter , Timo Gerkmann

Diffusion policies are a powerful paradigm for robotic control, but fine-tuning them with human preferences is fundamentally challenged by the multi-step structure of the denoising process. To overcome this, we introduce a Unified Markov…

Robotics · Computer Science 2026-02-03 Amitesh Vatsa , Zhixian Xie , Wanxin Jin

Deep image restoration models aim to learn a mapping from degraded image space to natural image space. However, they face several critical challenges: removing degradation, generating realistic details, and ensuring pixel-level consistency.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xinqi Lin , Fanghua Yu , Jinfan Hu , Zhiyuan You , Wu Shi , Jimmy S. Ren , Jinjin Gu , Chao Dong

All-in-one image restoration (AIR) aims to address diverse degradations within a unified model by leveraging informative degradation conditions to guide the restoration process. However, existing methods often rely on implicitly learned…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jiawei Wu , Zhifei Yang , Zhe Wang , Zhi Jin

Denoising diffusion models (DDM) have gained recent traction in medical image translation given improved training stability over adversarial models. DDMs learn a multi-step denoising transformation to progressively map random Gaussian-noise…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Fuat Arslan , Bilal Kabas , Onat Dalmaz , Muzaffer Ozbey , Tolga Çukur

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Diffusion Probabilistic Models (DPMs) have recently been employed for image deblurring, formulated as an image-conditioned generation process that maps Gaussian noise to the high-quality image, conditioned on the blurry input.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Mengwei Ren , Mauricio Delbracio , Hossein Talebi , Guido Gerig , Peyman Milanfar

We propose HDiffTG, a novel 3D Human Pose Estimation (3DHPE) method that integrates Transformer, Graph Convolutional Network (GCN), and diffusion model into a unified framework. HDiffTG leverages the strengths of these techniques to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Yajie Fu , Chaorui Huang , Junwei Li , Hui Kong , Yibin Tian , Huakang Li , Zhiyuan Zhang

Creating novel images by fusing visual cues from multiple sources is a fundamental yet underexplored problem in image-to-image generation, with broad applications in artistic creation, virtual reality and visual media. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zeren Xiong , Yue Yu , Zedong Zhang , Shuo Chen , Jian Yang , Jun Li

Diffusion probabilistic models (DPMs) have achieved impressive success in visual generation. While, they suffer from slow inference speed due to iterative sampling. Employing fewer sampling steps is an intuitive solution, but this will also…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Hu Yu , Hao Luo , Fan Wang , Feng Zhao

Classifier-Free Guidance (CFG) is a widely used technique for improving conditional diffusion models by linearly combining the outputs of conditional and unconditional denoisers. While CFG enhances visual quality and improves alignment with…

Machine Learning · Computer Science 2025-05-28 Badr Moufad , Yazid Janati , Alain Durmus , Ahmed Ghorbel , Eric Moulines , Jimmy Olsson

Although there have been significant advancements in image compression techniques, such as standard and learned codecs, these methods still suffer from severe quality degradation at extremely low bits per pixel. While recent diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Chanung Park , Joo Chan Lee , Jong Hwan Ko

We propose the Binary Diffusion Probabilistic Model (BDPM), a generative framework specifically designed for data representations in binary form. Conventional denoising diffusion probabilistic models (DDPMs) assume continuous inputs, use…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Vitaliy Kinakh , Slava Voloshynovskiy

Fraudulent activities have significantly increased across various domains, such as e-commerce, online review platforms, and social networks, making fraud detection a critical task. Spatial Graph Neural Networks (GNNs) have been successfully…

Machine Learning · Computer Science 2025-04-29 Wenxin Zhang , Jingxing Zhong , Guangzhen Yao , Renda Han , Xiaojian Lin , Zeyu Zhang , Cuicui Luo

Brain-to-image decoding has been recently propelled by the progress in generative AI models and the availability of large ultra-high field functional Magnetic Resonance Imaging (fMRI). However, current approaches depend on complicated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Marlène Careil , Yohann Benchetrit , Jean-Rémi King

Existing open-source film restoration methods show limited performance compared to commercial methods due to training with low-quality synthetic data and employing noisy optical flows. In addition, high-resolution films have not been…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Rongji Xun , Junjie Yuan , Zhongjie Wang

Blind face restoration (BFR) is important while challenging. Prior works prefer to exploit GAN-based frameworks to tackle this task due to the balance of quality and efficiency. However, these methods suffer from poor stability and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xinmin Qiu , Congying Han , Zicheng Zhang , Bonan Li , Tiande Guo , Xuecheng Nie

Denoising Diffusion Probabilistic Model (DDPM) is able to make flexible conditional image generation from prior noise to real data, by introducing an independent noise-aware classifier to provide conditional gradient guidance at each time…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Shengming Li , Guangcong Zheng , Hui Wang , Taiping Yao , Yang Chen , Shoudong Ding , Xi Li

Single image super-resolution (SISR) aims to reconstruct high-resolution (HR) images from the given low-resolution (LR) ones, which is an ill-posed problem because one LR image corresponds to multiple HR images. Recently, learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Haoying Li , Yifan Yang , Meng Chang , Huajun Feng , Zhihai Xu , Qi Li , Yueting Chen