English
Related papers

Related papers: A Residual Diffusion Model for High Perceptual Qua…

200 papers

In this work, we utilize the high-fidelity generation abilities of diffusion models to solve blind JPEG restoration at high compression levels. We propose an elegant modification of the forward stochastic differential equation of diffusion…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Simon Welker , Henry N. Chapman , Timo Gerkmann

Recently, neural speech codecs (NSCs) trained as generative models have shown superior performance compared to conventional codecs at low bitrates. Although most state-of-the-art NSCs are trained as Generative Adversarial Networks (GANs),…

Sound · Computer Science 2025-04-14 Pietro Foti , Andreas Brendel

Ambiguity in medical image segmentation calls for models that capture full conditional distributions rather than a single point estimate. We present Prior-Guided Residual Diffusion (PGRD), a diffusion-based framework that learns voxel-wise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Fuyou Mao , Beining Wu , Yanfeng Jiang , Han Xue , Yan Tang , Hao Zhang

Denoising diffusion models have recently achieved remarkable success in image generation, capturing rich information about natural image statistics. This makes them highly promising for image reconstruction, where the goal is to recover a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Shady Abu-Hussein , Tom Tirer , Raja Giryes

We propose conditional perceptual quality, an extension of the perceptual quality defined in \citet{blau2018perception}, by conditioning it on user defined information. Specifically, we extend the original perceptual quality…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Tongda Xu , Qian Zhang , Yanghao Li , Dailan He , Zhe Wang , Yuanyuan Wang , Hongwei Qin , Yan Wang , Jingjing Liu , Ya-Qin Zhang

Recent literature has effectively leveraged diffusion models trained on continuous variables as priors for solving inverse problems. Notably, discrete diffusion models with discrete latent codes have shown strong performance, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Naoki Murata , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Bac Nguyen , Stefano Ermon , Yuki Mitsufuji

The use of machine learning in fluid dynamics is becoming more common to expedite the computation when solving forward and inverse problems of partial differential equations. Yet, a notable challenge with existing convolutional neural…

Fluid Dynamics · Physics 2024-05-10 Siming Shan , Pengkai Wang , Song Chen , Jiaxu Liu , Chao Xu , Shengze Cai

Conditional generative models of high-dimensional images have many applications, but supervision signals from conditions to images can be expensive to acquire. This paper describes Diffusion-Decoding models with Contrastive representations…

Machine Learning · Computer Science 2021-06-15 Abhishek Sinha , Jiaming Song , Chenlin Meng , Stefano Ermon

We present Intrinsic Image Diffusion, a generative model for appearance decomposition of indoor scenes. Given a single input view, we sample multiple possible material explanations represented as albedo, roughness, and metallic maps.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Peter Kocsis , Vincent Sitzmann , Matthias Nießner

Current image compression models often require separate models for each quality level, making them resource-intensive in terms of both training and storage. To address these limitations, we propose an innovative approach that utilizes…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Ayman A. Ameen , Thomas Richter , André Kaup

Lossless image compression is an important technique for image storage and transmission when information loss is not allowed. With the fast development of deep learning techniques, deep neural networks have been used in this field to…

Image and Video Processing · Electrical Eng. & Systems 2021-08-25 Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Nannan Zou , Emre Aksu , Miska M. Hannuksela

In this paper we consider the problem of acoustic inversion in the context of the optoacoustic tomography image reconstruction problem. By leveraging the ability of the recently proposed diffusion models for image generative tasks among…

Image and Video Processing · Electrical Eng. & Systems 2024-04-17 M. G. González , M. Vera , A. Dreszman , L. J. Rey Vega

We introduce Diffusion-based Audio Captioning (DAC), a non-autoregressive diffusion model tailored for diverse and efficient audio captioning. Although existing captioning models relying on language backbones have achieved remarkable…

Computation and Language · Computer Science 2025-06-03 Manjie Xu , Chenxing Li , Xinyi Tu , Yong Ren , Ruibo Fu , Wei Liang , Dong Yu

Diffusion models have demonstrated remarkable capabilities in generating high-quality samples and enhancing performance across diverse domains through Classifier-Free Guidance (CFG). However, the quality of generated samples is highly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Ao Chen , Lihe Ding , Tianfan Xue

Image denoising aims to remove noise while preserving structural details and perceptual realism, yet distortion-driven methods often produce over-smoothed reconstructions, especially under strong noise and distribution shift. This paper…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Nam Nguyen , Thinh Nguyen , Bella Bose

Distributed Image Compression (DIC) is crucial for multi-view transmission, especially when operating at extremely low bitrates (< 0.1 bpp). Its core challenge is effectively utilizing side information to achieve high-quality reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Guojun Xu , Mingyang Zhang , Jianwen Xiang , Cheng Tan , Yanchao Yang , Junwei Zhou

Fast and effective image compression for multi-dimensional images has become increasingly important for efficient storage and transfer of massive amounts of high-resolution images and videos. Desirable properties in compression methods…

Image and Video Processing · Electrical Eng. & Systems 2020-11-13 Rongjie Liu , Meng Li , Li Ma

Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zijie Li , Henry Li , Yichun Shi , Amir Barati Farimani , Yuval Kluger , Linjie Yang , Peng Wang

Despite a short history, neural image codecs have been shown to surpass classical image codecs in terms of rate-distortion performance. However, most of them suffer from significantly longer decoding times, which hinders the practical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Yixin Gao , Runsen Feng , Zongyu Guo , Zhibo Chen

Visual generation with discrete tokens has gained significant attention as it enables a unified token prediction paradigm shared with language models, promising seamless multimodal architectures. However, current discrete generation methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuqing Wang , Chuofan Ma , Zhijie Lin , Yao Teng , Lijun Yu , Shuai Wang , Jiaming Han , Jiashi Feng , Yi Jiang , Xihui Liu