English
Related papers

Related papers: Steering One-Step Diffusion Model with Fidelity-Ri…

200 papers

Video diffusion models have shown great potential in generating high-quality videos, making them an increasingly popular focus. However, their inherent iterative nature leads to substantial computational and time costs. While efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Xiaofeng Mao , Zhengkai Jiang , Fu-Yun Wang , Jiangning Zhang , Hao Chen , Mingmin Chi , Yabiao Wang , Wenhan Luo

Preprocessing is a well-established technique for optimizing compression, yet existing methods are predominantly Rate-Distortion (R-D) optimized and constrained by pixel-level fidelity. This work pioneers a shift towards Rate-Perception…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Mengxi Guo , Shijie Zhao , Junlin Li , Li Zhang

Latent diffusion models have become the popular choice for scaling up diffusion models for high resolution image synthesis. Compared to pixel-space models that are trained end-to-end, latent models are perceived to be more efficient and to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Emiel Hoogeboom , Thomas Mensink , Jonathan Heek , Kay Lamerigts , Ruiqi Gao , Tim Salimans

With the rapidly increasing number of satellites in space and their enhanced capabilities, the amount of earth observation images collected by satellites is exceeding the transmission limits of satellite-to-ground links. Although existing…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Ziyuan Zhang , Han Qiu , Maosen Zhang , Jun Liu , Bin Chen , Tianwei Zhang , Hewu Li

Discrete diffusion models have recently shown significant progress in modeling complex data, such as natural languages and DNA sequences. However, unlike diffusion models for continuous data, which can generate high-quality samples in just…

Machine Learning · Computer Science 2025-03-20 Anji Liu , Oliver Broadrick , Mathias Niepert , Guy Van den Broeck

A diffusion model, which is formulated to produce an image using thousands of denoising steps, usually suffers from a slow inference speed. Existing acceleration algorithms simplify the sampling by skipping most steps yet exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Mengfei Xia , Yujun Shen , Changsong Lei , Yu Zhou , Ran Yi , Deli Zhao , Wenping Wang , Yong-Jin Liu

Diffusion models have shown promising results in speech enhancement, using a task-adapted diffusion process for the conditional generation of clean speech given a noisy mixture. However, at test time, the neural network used for score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Bunlong Lay , Jean-Marie Lemercier , Julius Richter , Timo Gerkmann

Diffusion models have achieved unprecedented performance in image generation, yet they suffer from slow inference due to their iterative sampling process. To address this, early-exiting has recently been proposed, where the depth of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Daniel Gallo Fernández , Răzvan-Andrei Matişan , Alejandro Monroy Muñoz , Ana-Maria Vasilcoiu , Janusz Partyka , Tin Hadži Veljković , Metod Jazbec

Diffusion-based or flow-based models have achieved significant progress in video synthesis but require multiple iterative sampling steps, which incurs substantial computational overhead. While many distillation methods that are solely based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yanxiao Sun , Jiafu Wu , Yun Cao , Chengming Xu , Yabiao Wang , Weijian Cao , Donghao Luo , Chengjie Wang , Yanwei Fu

Despite super-resolution fluorescence blinking microscopes break the diffraction limit, the intense phototoxic illumination and long-term image sequences thus far still pose to major challenges in visualizing live-organisms. Here, we…

Deep learning-based image compression algorithms typically focus on designing encoding and decoding networks and improving the accuracy of entropy model estimation to enhance the rate-distortion (RD) performance. However, few algorithms…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Junhui Li , Jutao Li , Xingsong Hou , Huake Wang

The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shelly Golan , Roy Ganz , Michael Elad

Diffusion models have demonstrated excellent performance for real-world image super-resolution (Real-ISR), albeit at high computational costs. Most existing methods are trying to derive one-step diffusion models from multi-step counterparts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jianze Li , Jiezhang Cao , Zichen Zou , Xiongfei Su , Xin Yuan , Yulun Zhang , Yong Guo , Xiaokang Yang

Recent advances in diffusion models have enabled the creation of deceptively real images, posing significant security risks when misused. In this study, we empirically show that different timesteps of DDIM inversion reveal varying subtle…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yixin Wu , Feiran Zhang , Tianyuan Shi , Ruicheng Yin , Zhenghua Wang , Zhenliang Gan , Xiaohua Wang , Changze Lv , Xiaoqing Zheng , Xuanjing Huang

The adoption of text-to-image diffusion models raises concerns over reliability, drawing scrutiny under the lens of various metrics like calibration, fairness, or compute efficiency. We focus in this work on two issues that arise when…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Michael Kirchhof , James Thornton , Louis Béthune , Pierre Ablin , Eugene Ndiaye , Marco Cuturi

Rectified Flow (RF) models have advanced high-quality image and video synthesis via optimal transport theory. However, when applied to image-to-image translation, they still depend on costly multi-step denoising, hindering real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Shengqian Li , Ming Gao , Yi Liu , Zuzeng Lin , Feng Wang , Feng Dai

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Computer Science 2025-02-17 Pascal Jutras-Dubé , Patrick Pynadath , Ruqi Zhang

Snapshot compressive imaging (SCI) captures multispectral images (MSIs) using a single coded two-dimensional (2-D) measurement, but reconstructing high-fidelity MSIs from these compressed inputs remains a fundamentally ill-posed challenge.…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Shaoguang Huang , Yunzhen Wang , Haijin Zeng , Hongyu Chen , Hongyan Zhang

Image denoising is a fundamental problem in computational photography, where achieving high perception with low distortion is highly demanding. Current methods either struggle with perceptual quality or suffer from significant distortion.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Tong Li , Hansen Feng , Lizhi Wang , Zhiwei Xiong , Hua Huang

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zihang Liu , Zhenyu Zhang , Hao Tang