English
Related papers

Related papers: Detail-Preserving Latent Diffusion for Stable Shad…

200 papers

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

3D data simulation aims to bridge the gap between simulated and real-captured 3D data, which is a fundamental problem for real-world 3D visual tasks. Most 3D data simulation methods inject predefined physical priors but struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Mutian Xu , Chongjie Ye , Haolin Liu , Yushuang Wu , Jiahao Chang , Xiaoguang Han

We introduce light diffusion, a novel method to improve lighting in portraits, softening harsh shadows and specular highlights while preserving overall scene illumination. Inspired by professional photographers' diffusers and scrims, our…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 David Futschik , Kelvin Ritland , James Vecore , Sean Fanello , Sergio Orts-Escolano , Brian Curless , Daniel Sýkora , Rohit Pandey

Shadows in scanned documents pose significant challenges for document analysis and recognition tasks due to their negative impact on visual quality and readability. Current shadow removal techniques, including traditional methods and deep…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Ziyang Zhou , Yingtie Lei , Xuhang Chen , Shenghong Luo , Wenjun Zhang , Chi-Man Pun , Zhen Wang

Conditional diffusion models have demonstrated impressive performance in image manipulation tasks. The general pipeline involves adding noise to the image and then denoising it. However, this method faces a trade-off problem: adding too…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Luozhou Wang , Shuai Yang , Shu Liu , Ying-cong Chen

Blind face restoration usually synthesizes degraded low-quality data with a pre-defined degradation model for training, while more complex cases could happen in the real world. This gap between the assumed and actual degradation hurts the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhixin Wang , Xiaoyun Zhang , Ziying Zhang , Huangjie Zheng , Mingyuan Zhou , Ya Zhang , Yanfeng Wang

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Volumetric video relighting is essential for bringing captured performances into virtual worlds, but current approaches struggle to deliver temporally stable, production-ready results. Diffusion-based intrinsic decomposition methods show…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Elisabeth Jüttner , Janelle Pfeifer , Leona Krath , Stefan Korfhage , Hannah Dröge , Matthias B. Hullin , Markus Plack

Recent generative-prior-based methods have shown promising blind face restoration performance. They usually project the degraded images to the latent space and then decode high-quality faces either by single-stage latent optimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Maitreya Suin , Rama Chellappa

Although powerful for image generation, consistent and controllable video is a longstanding problem for diffusion models. Video models require extensive training and computational resources, leading to high costs and large environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Muhammad Haaris Khan , Hadrien Reynaud , Bernhard Kainz

Radiance field representations have recently been explored in the latent space of VAEs that are commonly used by diffusion models. This direction offers efficient rendering and seamless integration with diffusion-based pipelines. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Or Hirschorn , Omer Sela , Inbar Huberman-Spiegelglas , Netalee Efrat , Eli Alshan , Ianir Ideses , Frederic Devernay , Yochai Zvik , Lior Fritz

Recent advancements in diffusion models have significantly improved performance in super-resolution (SR) tasks. However, previous research often overlooks the fundamental differences between SR and general image generation. General image…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Hanlin Wu , Jiangwei Mo , Xiaohui Sun , Jie Ma

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

Text-to-image diffusion models excel at generating diverse portraits, but lack intuitive shadow control. Existing editing approaches, as post-processing, struggle to offer effective manipulation across diverse styles. Additionally, these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Haoming Cai , Tsung-Wei Huang , Shiv Gehlot , Brandon Y. Feng , Sachin Shah , Guan-Ming Su , Christopher Metzler

Diffusion-based methods, leveraging pre-trained large models like Stable Diffusion via ControlNet, have achieved remarkable performance in several low-level vision tasks. However, Pre-Trained Diffusion-Based (PTDB) methods often sacrifice…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xiaogang Xu , Jian Wang , Yunfan Lu , Ruihang Chu , Ruixing Wang , Jiafei Wu , Bei Yu , Liang Lin

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Leveraging the powerful capabilities of diffusion models has yielded quite effective results in medical image segmentation tasks. However, existing methods typically transfer the original training process directly without specific…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Qilin Huang , Tianyu Lin , Zhiguang Chen , Fudan Zheng

High-resolution computed tomography (CT) imaging is essential for medical diagnosis but requires increased radiation exposure, creating a critical trade-off between image quality and patient safety. While deep learning methods have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Chunlei Li , Yilei Shi , Haoxi Hu , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

Although there have been significant advancements in image compression techniques, such as standard and learned codecs, these methods still suffer from severe quality degradation at extremely low bits per pixel. While recent diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Chanung Park , Joo Chan Lee , Jong Hwan Ko