English
Related papers

Related papers: Bridging Restoration and Generation Manifolds in O…

200 papers

Despite all recent progress, it is still challenging to edit and manipulate natural images with modern generative models. When using Generative Adversarial Network (GAN), one major hurdle is in the inversion process mapping a real image to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Zhihong Pan , Riccardo Gherardi , Xiufeng Xie , Stephen Huang

Language models often default to a narrow set of high-probability outputs, leaving their generation paths homogeneous and prone to mode collapse. Sampling-based strategies inject randomness but still struggle to guarantee diversity across…

Machine Learning · Computer Science 2026-01-30 Dongxuan Zhu , Ly Tran Ho Khanh , Andy Yat-Ming Cheung , Man-Chung Yue , Viet Anh Nguyen

Score distillation sampling~(SDS) has been widely adopted to overcome the absence of unseen views in reconstructing 3D objects from a \textbf{single} image. It leverages pre-trained 2D diffusion models as teacher to guide the reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Xuanyu Yi , Zike Wu , Qingshan Xu , Pan Zhou , Joo-Hwee Lim , Hanwang Zhang

Traditional one-shot medical image segmentation (MIS) methods use registration networks to propagate labels from a reference atlas or rely on comprehensive sampling strategies to generate synthetic labeled data for training. However, these…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Feng Zhou , Yanjie Zhou , Longjie Wang , Yun Peng , David E. Carlson , Liyun Tu

We propose a unified diffusion model-based correction and super-resolution method to enhance the fidelity and resolution of diverse low-quality data through a two-step pipeline. First, the correction step employs a novel enhanced stochastic…

Numerical Analysis · Mathematics 2025-05-15 Wuzhe Xu , Yulong Lu , Sifan Wang , Tong-Rui Liu

Diffusion models show promise for image restoration, but existing methods often struggle with inconsistent fidelity and undesirable artifacts. To address this, we introduce Kernel Density Steering (KDS), a novel inference-time framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuyang Hu , Kangfu Mei , Mojtaba Sahraee-Ardakan , Ulugbek S. Kamilov , Peyman Milanfar , Mauricio Delbracio

In this paper we tackle Image Super Resolution (ISR), using recent advances in Visual Auto-Regressive (VAR) modeling. VAR iteratively estimates the residual in latent space between gradually increasing image scales, a process referred to as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Enrique Sanchez , Isma Hadji , Adrian Bulat , Christos Tzelepis , Brais Martinez , Georgios Tzimiropoulos

Diffusion distillation has emerged as a promising strategy for accelerating text-to-image (T2I) diffusion models by distilling a pretrained score network into a one- or few-step generator. While existing methods have made notable progress,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Mingyuan Zhou , Yi Gu , Zhendong Wang

Monocular depth estimation within the diffusion-denoising paradigm demonstrates impressive generalization ability but suffers from low inference speed. Recent methods adopt a single-step deterministic paradigm to improve inference…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Ziyang Song , Zerong Wang , Bo Li , Hao Zhang , Ruijie Zhu , Li Liu , Peng-Tao Jiang , Tianzhu Zhang

Speech super-resolution (SR) is the task that restores high-resolution speech from low-resolution input. Existing models employ simulated data and constrained experimental settings, which limit generalization to real-world SR. Predictive…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-26 Heming Wang , Eric W. Healy , DeLiang Wang

Low-field to high-field MRI synthesis has emerged as a cost-effective strategy to enhance image quality under hardware and acquisition constraints, particularly in scenarios where access to high-field scanners is limited or impractical.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Zhenxuan Zhang , Peiyuan Jing , Ruicheng Yuan , Liwei Hu , Anbang Wang , Fanwen Wang , Yinzhe Wu , Kh Tohidul Islam , Zhaolin Chen , Zi Wang , Peter Lally , Guang Yang

Single-image super-resolution (SISR) remains challenging due to the inherent difficulty of recovering fine-grained details and preserving perceptual quality from low-resolution inputs. Existing methods often rely on limited image priors,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kangfu Mei , Hossein Talebi , Mojtaba Ardakani , Vishal M. Patel , Peyman Milanfar , Mauricio Delbracio

The recent increase in the extensive use of digital imaging technologies has brought with it a simultaneous demand for higher-resolution images. We develop a novel edge-informed approach to single image super-resolution (SISR). The SISR…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 Kamyar Nazeri , Harrish Thasarathan , Mehran Ebrahimi

Recently, some works have tried to combine diffusion and Generative Adversarial Networks (GANs) to alleviate the computational cost of the iterative denoising inference in Diffusion Models (DMs). However, existing works in this line suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yihong Luo , Xiaolong Chen , Xinghua Qu , Tianyang Hu , Jing Tang

The recent success of denoising diffusion models has significantly advanced text-to-image generation. While these large-scale pretrained models show excellent performance in general image synthesis, downstream objectives often require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Maorong Wang , Jiafeng Mao , Xueting Wang , Toshihiko Yamasaki

Recent diffusion-based extreme image compression methods have demonstrated remarkable performance at ultra-low bitrates. However, most approaches require training separate diffusion models for each target bitrate, resulting in substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xinning Chai , Zhengxue Cheng , Xin Li , Rong Xie , Li Song

Diffusion models have emerged as the leading approach for text-to-image generation. However, their iterative sampling process, which gradually morphs random noise into coherent images, introduces significant latency that limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Peijie Qiu , Hariharan Ramshankar , Arnau Ramisa , René Vidal , Amit Kumar K C , Vamsi Salaka , Rahul Bhagat

Diffusion models have shown strong performance in speech enhancement, but their real-time applicability has been limited by multi-step iterative sampling. Consistency distillation has recently emerged as a promising alternative by…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-19 Liang Xu , Longfei Felix Yan , W. Bastiaan Kleijn

In real-world single image super-resolution (SISR) task, the low-resolution image suffers more complicated degradations, not only downsampled by unknown kernels. However, existing SISR methods are generally studied with the synthetic…

Image and Video Processing · Electrical Eng. & Systems 2020-09-15 Guanghao Yin , Shouqian Sun , Chao Li , Xin Min

Inference-time steering enables pretrained diffusion/flow models to be adapted to new tasks without retraining. A widely used approach is the ratio-of-densities method, which defines a time-indexed target path by reweighting…

Artificial Intelligence · Computer Science 2025-12-12 Ziseok Lee , Minyeong Hwang , Sanghyun Jo , Wooyeol Lee , Jihyung Ko , Young Bin Park , Jae-Mun Choi , Eunho Yang , Kyungsu Kim