English
Related papers

Related papers: TransDiff: Diffusion-Based Method for Manipulating…

200 papers

Advanced image editing techniques, particularly inpainting, are essential for seamlessly removing unwanted elements while preserving visual integrity. Traditional GAN-based methods have achieved notable success, but recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yigit Ekin , Ahmet Burak Yildirim , Erdem Eren Caglar , Aykut Erdem , Erkut Erdem , Aysegul Dundar

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

Computational imaging is crucial in many disciplines from autonomous driving to life sciences. However, traditional model-driven and iterative methods consume large computational power and lack scalability for imaging. Deep learning (DL) is…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Weiru Fan , Xiaobin Tang , Yiyi Liao , Da-Wei Wang

Single-image relighting is a challenging task that involves reasoning about the complex interplay between geometry, materials, and lighting. Many prior methods either support only specific categories of images, such as portraits, or require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Haian Jin , Yuan Li , Fujun Luan , Yuanbo Xiangli , Sai Bi , Kai Zhang , Zexiang Xu , Jin Sun , Noah Snavely

Currently, methods for single-image deblurring based on CNNs and transformers have demonstrated promising performance. However, these methods often suffer from perceptual limitations, poor generalization ability, and struggle with heavy or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaoyang Liu , Yuquan Wang , Zheng Chen , Jiezhang Cao , He Zhang , Yulun Zhang , Xiaokang Yang

Digital imaging aims to replicate realistic scenes, but Low Dynamic Range (LDR) cameras cannot represent the wide dynamic range of real scenes, resulting in under-/overexposed images. This paper presents a deep learning-based approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Dwip Dalal , Gautam Vashishtha , Prajwal Singh , Shanmuganathan Raman

Generative diffusion priors have recently achieved state-of-the-art performance in natural image super-resolution, demonstrating a powerful capability to synthesize photorealistic details. However, their direct application to remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Enzhuo Zhang , Sijie Zhao , Dilxat Muhtar , Zhenshi Li , Xueliang Zhang , Pengfeng Xiao

Image based rendering is a fundamental problem in computer vision and graphics. Modern techniques often rely on depth image for the 3D construction. However for most of the existing depth cameras, the large and unpredictable noises can be…

Computer Vision and Pattern Recognition · Computer Science 2016-02-17 Rashi Chaudhary , Himanshu Dasgupta

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai

Diffusion models have garnered considerable interest in computer vision, owing both to their capacity to synthesize photorealistic images and to their proven effectiveness in image reconstruction tasks. However, existing approaches fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jonas Dornbusch , Emanuel Pfarr , Florin-Alexandru Vasluianu , Frank Werner , Radu Timofte

Diffusion models show promise for dynamic scene deblurring; however, existing studies often fail to leverage the intrinsic nature of the blurring process within diffusion models, limiting their full potential. To address it, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Jin-Ting He , Fu-Jen Tsai , Yan-Tsung Peng , Min-Hung Chen , Chia-Wen Lin , Yen-Yu Lin

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Transparent objects are ubiquitous in industry, pharmaceuticals, and households. Grasping and manipulating these objects is a significant challenge for robots. Existing methods have difficulty reconstructing complete depth maps for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Bardienus P. Duisterhof , Yuemin Mao , Si Heng Teng , Jeffrey Ichnowski

A vast majority of augmented reality devices come equipped with depth and color cameras. Despite their advantages, extracting both photometric and depth features simultaneously in real-time remains challenging due to inherent differences…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Mehfuz A Rahman , Khushal Das , Jiju Poovvancheri , Neil London , Dong Chen

Face recognition models embed a face image into a low-dimensional identity vector containing abstract encodings of identity-specific facial features that allow individuals to be distinguished from one another. We tackle the challenging task…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Manuel Kansy , Anton Raël , Graziana Mignone , Jacek Naruniec , Christopher Schroers , Markus Gross , Romann M. Weber

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Diffusion-based generative models have shown promise in synthesizing histopathology images to address data scarcity caused by privacy constraints. Diagnostic text reports provide high-level semantic descriptions, and masks offer…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Mahesh Bhosale , Abdul Wasi , Yuanhao Zhai , Yunjie Tian , Samuel Border , Nan Xi , Pinaki Sarder , Junsong Yuan , David Doermann , Xuan Gong

Diffusion models demonstrate impressive image generation performance with text guidance. Inspired by the learning process of diffusion, existing images can be edited according to text by DDIM inversion. However, the vanilla DDIM inversion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qi Qian , Haiyang Xu , Ming Yan , Juhua Hu

Equipping a deep model the abaility of few-shot learning, i.e., learning quickly from only few examples, is a core challenge for artificial intelligence. Gradient-based meta-learning approaches effectively address the challenge by learning…

Machine Learning · Computer Science 2024-01-09 Baoquan Zhang , Chuyao Luo , Demin Yu , Huiwei Lin , Xutao Li , Yunming Ye , Bowen Zhang

Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination. Among these algorithms, diffusion model (DM)-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Chunming He , Chengyu Fang , Yulun Zhang , Tian Ye , Kai Li , Longxiang Tang , Zhenhua Guo , Xiu Li , Sina Farsiu