English
Related papers

Related papers: LENS: Low-Frequency Eigen Noise Shaping for Effici…

200 papers

Generative models have made significant impacts across various domains, largely due to their ability to scale during training by increasing data, computational resources, and model size, a phenomenon characterized by the scaling laws.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Nanye Ma , Shangyuan Tong , Haolin Jia , Hexiang Hu , Yu-Chuan Su , Mingda Zhang , Xuan Yang , Yandong Li , Tommi Jaakkola , Xuhui Jia , Saining Xie

Recent strides in the development of diffusion models, exemplified by advancements such as Stable Diffusion, have underscored their remarkable prowess in generating visually compelling images. However, the imperative of achieving a seamless…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Xiefan Guo , Jinlin Liu , Miaomiao Cui , Jiankai Li , Hongyu Yang , Di Huang

Diffusion models are a powerful generative framework, but come with expensive inference. Existing acceleration methods often compromise image quality or fail under complex conditioning when operating in an extremely low-step regime. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Jonas Kohler , Albert Pumarola , Edgar Schönfeld , Artsiom Sanakoyeu , Roshan Sumbaly , Peter Vajda , Ali Thabet

It is well known that many open-released foundational diffusion models have difficulty in generating images that substantially depart from average brightness, despite such images being present in the training data. This is due to an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Minghui Hu , Jianbin Zheng , Chuanxia Zheng , Chaoyue Wang , Dacheng Tao , Tat-Jen Cham

Diffusion models have achieved state-of-the-art image generation. However, the random Gaussian noise used to start the diffusion process influences the final output, causing variations in image quality and prompt adherence. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Harvey Mannering , Zhiwu Huang , Adam Prugel-Bennett

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause of sample quality…

Machine Learning · Computer Science 2024-11-05 Yunshu Wu , Yingtao Luo , Xianghao Kong , Evangelos E. Papalexakis , Greg Ver Steeg

We propose an efficient neural network for RAW image denoising. Although neural network-based denoising has been extensively studied for image restoration, little attention has been given to efficient denoising for compute limited and power…

Image and Video Processing · Electrical Eng. & Systems 2021-03-19 Lucas D. Young , Fitsum A. Reda , Rakesh Ranjan , Jon Morton , Jun Hu , Yazhu Ling , Xiaoyu Xiang , David Liu , Vikas Chandra

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Diffusion models have achieved remarkable success in image and video generation. In this work, we demonstrate that diffusion models can also \textit{generate high-performing neural network parameters}. Our approach is simple, utilizing an…

Machine Learning · Computer Science 2025-01-03 Kai Wang , Dongwen Tang , Boya Zeng , Yida Yin , Zhaopan Xu , Yukun Zhou , Zelin Zang , Trevor Darrell , Zhuang Liu , Yang You

In recent years, diffusion models have become the most popular and powerful methods in the field of image synthesis, even rivaling human artists in artistic creativity. However, the key issue currently limiting the application of diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Zhongjie Duan , Chengyu Wang , Cen Chen , Jun Huang , Weining Qian

Diffusion Probabilistic Models (DPMs) suffer from inefficient inference due to their slow sampling and high memory consumption, which limits their applicability to various medical imaging applications. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu

Images obtained in real-world low-light conditions are not only low in brightness, but they also suffer from many other types of degradation, such as color bias, unknown noise, detail loss and halo artifacts. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-07-01 Xinxu Wei , Xianshi Zhang , Shisen Wang , Cheng Cheng , Yanlin Huang , Kaifu Yang , Yongjie Li

Though diffusion-based video generation has witnessed rapid progress, the inference results of existing models still exhibit unsatisfactory temporal consistency and unnatural dynamics. In this paper, we delve deep into the noise…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Tianxing Wu , Chenyang Si , Yuming Jiang , Ziqi Huang , Ziwei Liu

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

Previous raw image-based low-light image enhancement methods predominantly relied on feed-forward neural networks to learn deterministic mappings from low-light to normally-exposed images. However, they failed to capture critical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex C. Kot , Bihan Wen

Image denoising is a typical ill-posed problem due to complex degradation. Leading methods based on normalizing flows have tried to solve this problem with an invertible transformation instead of a deterministic mapping. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Wenchao Du , Hu Chen , Yi Zhang , H. Yang

Unlike single image task, stereo image enhancement can use another view information, and its key stage is how to perform cross-view feature interaction to extract useful information from another view. However, complex noise in low-light…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Minghua Zhao , Xiangdong Qin , Shuangli Du , Xuefei Bai , Jiahao Lyu , Yiguang Liu

We empirically study the effect of noise scheduling strategies for denoising diffusion generative models. There are three findings: (1) the noise scheduling is crucial for the performance, and the optimal one depends on the task (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Ting Chen

Text-to-image diffusion models generate images by gradually converting white Gaussian noise into a natural image. White Gaussian noise is well suited for producing diverse outputs from a single text prompt due to its absence of structure.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nadav Z. Cohen , Ofir Abramovich , Ariel Shamir

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim