English
Related papers

Related papers: Latent Feature-Guided Diffusion Models for Shadow …

200 papers

There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation. We present a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ting-Hsuan Liao , Songwei Ge , Yiran Xu , Yao-Chih Lee , Badour AlBahar , Jia-Bin Huang

Depth information provides valuable insights into the 3D structure especially the outline of objects, which can be utilized to improve the semantic segmentation tasks. However, a naive fusion of depth information can disrupt feature and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Wei Sun , Yuan Li , Qixiang Ye , Jianbin Jiao , Yanzhao Zhou

Low-light image enhancement aims to improve the visibility of degraded images to better align with human visual perception. While diffusion-based methods have shown promising performance due to their strong generative capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jinhong He , Minglong Xue , Zhipu Liu , Mingliang Zhou , Aoxiang Ning , Palaiahnakote Shivakumara

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Although learning-based image restoration methods have made significant progress, they still struggle with limited generalization to real-world scenarios due to the substantial domain gap caused by training on synthetic data. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kang Liao , Zongsheng Yue , Zhouxia Wang , Chen Change Loy

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

To prevent unauthorized use of text in images, Scene Text Removal (STR) has become a crucial task. It focuses on automatically removing text and replacing it with a natural, text-less background while preserving significant details such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanhita Pathak , Vinay Kaushik , Brejesh Lall

Blind face restoration aims to recover high-quality facial images from various unidentified sources of degradation, posing significant challenges due to the minimal information retrievable from the degraded images. Prior knowledge-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Wanglong Lu , Jikai Wang , Tao Wang , Kaihao Zhang , Xianta Jiang , Hanli Zhao

Due to the high complexity and technical requirements of industrial production processes, surface defects will inevitably appear, which seriously affects the quality of products. Although existing lightweight detection networks are highly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuyi Yu

While perspective is a well-studied topic in art, it is generally taken for granted in images. However, for the recent wave of high-quality image synthesis methods such as latent diffusion models, perspective accuracy is not an explicit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Rishi Upadhyay , Howard Zhang , Yunhao Ba , Ethan Yang , Blake Gella , Sicheng Jiang , Alex Wong , Achuta Kadambi

The search for refining 3D LiDAR data has attracted growing interest motivated by recent techniques such as supervised learning or generative model-based methods. Existing approaches have shown the possibilities for using diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sander Elias Magnussen Helgesen , Kazuto Nakashima , Jim Tørresen , Ryo Kurazume

Incorporating diffusion models in the image compression domain has the potential to produce realistic and detailed reconstructions, especially at extremely low bitrates. Previous methods focus on using diffusion models as expressive…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Lucas Relic , Roberto Azevedo , Markus Gross , Christopher Schroers

This paper aims to recover the intrinsic reflectance layer and shading layer given a single image. Though this intrinsic image decomposition problem has been studied for decades, it remains a significant challenge in cases of complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Xiaodong Wang , Zijun He , Xin Yuan

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu

Shadow-affected images often exhibit pronounced spatial discrepancies in color and illumination, consequently degrading various vision applications including object detection and segmentation systems. To effectively eliminate shadows in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Wei Dong , Han Zhou , Yuqiong Tian , Jingke Sun , Xiaohong Liu , Guangtao Zhai , Jun Chen

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

In this work, we address the limitations of denoising diffusion models (DDMs) in image restoration tasks, particularly the shape and color distortions that can compromise image quality. While DDMs have demonstrated a promising performance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Xinlong Cheng , Tiantian Cao , Guoan Cheng , Bangxuan Huang , Xinghan Tian , Ye Wang , Xiaoyu He , Weixin Li , Tianfan Xue , Xuan Dong

In this work, we dive deep into the impact of additive noise in pre-training deep networks. While various methods have attempted to use additive noise inspired by the success of latent denoising diffusion models, when used in combination…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Hyesong Choi , Daeun Kim , Sungmin Cha , Kwang Moo Yi , Dongbo Min

Recent work has shown that diffusion models can serve as powerful neural rendering engines that can be leveraged for inserting virtual objects into images. However, unlike typical physics-based renderers, these neural rendering engines are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Frédéric Fortier-Chouinard , Zitian Zhang , Louis-Etienne Messier , Mathieu Garon , Anand Bhattad , Jean-François Lalonde

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai