English
Related papers

Related papers: Diffusion for De-Occlusion: Accessory-Aware Diffus…

200 papers

Advanced auditory models are useful in designing signal-processing algorithms for hearing-loss compensation or speech enhancement. Such auditory models provide rich and detailed descriptions of the auditory pathway, and might allow for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-18 Peter Leer , Jesper Jensen , Zheng-Hua Tan , Jan Østergaard , Lars Bramsløw

Humans possess a remarkable ability to integrate auditory and visual information, enabling a deeper understanding of the surrounding environment. This early fusion of audio and visual cues, demonstrated through cognitive psychology and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shentong Mo , Pedro Morgado

Acquiring the channel state information from limited and noisy observations at pilot positions is critical for wireless multiple-input multiple-output (MIMO)-orthogonal frequency division multiplexing (OFDM) systems. In this paper, we view…

Signal Processing · Electrical Eng. & Systems 2026-04-13 Weijie Zhou , Zhaoyang Zhang , Yuzhi Yang , Sen Yan , Zhixian Kong , Merouane Debbah

Recent advances in diffusion models have introduced a new era of text-guided image manipulation, enabling users to create realistic edited images with simple textual prompts. However, there is significant concern about the potential misuse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 June Suk Choi , Kyungmin Lee , Jongheon Jeong , Saining Xie , Jinwoo Shin , Kimin Lee

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Object tracking is a fundamental task in computer vision, requiring the localization of objects of interest across video frames. Diffusion models have shown remarkable capabilities in visual generation, making them well-suited for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Pha Nguyen , Ngan Le , Jackson Cothren , Alper Yilmaz , Khoa Luu

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai

Diffusion priors have recently demonstrated strong capability in enhancing the quality of sparse-view 3D reconstruction by augmenting training views at novel viewpoints, but they inevitably introduce hallucinated content -- artifacts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xi Liu , Weiwei Sun , Zhou Ren , Chris Broaddus , Siyu Huang , Laurent Guigues

Humans can easily imagine a scene from auditory information based on their prior knowledge of audio-visual events. In this paper, we mimic this innate human ability in deep learning models to improve the quality of video inpainting. To…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-12 Kyuyeon Kim , Junsik Jung , Woo Jae Kim , Sung-Eui Yoon

Optical coherence tomography (OCT) is a prevalent non-invasive imaging method which provides high resolution volumetric visualization of retina. However, its inherent defect, the speckle noise, can seriously deteriorate the tissue…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Dewei Hu , Yuankai K. Tao , Ipek Oguz

Images can be viewed as layered compositions, foreground objects over background, with potential occlusions. This layered representation enables independent editing of elements, offering greater flexibility for content creation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingxi Chen , Yixiao Zhang , Xiaoye Qian , Zongxia Li , Cornelia Fermuller , Caren Chen , Yiannis Aloimonos

Head orientation is a challenging Computer Vision problem that has been extensively researched having a wide variety of applications. However, current state-of-the-art systems still underperform in the presence of occlusions and are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 José Celestino , Manuel Marques , Jacinto C. Nascimento , João Paulo Costeira

Text-to-image generative models have made remarkable advancements in generating high-quality images. However, generated images often contain undesirable artifacts or other errors due to model limitations. Existing techniques to fine-tune…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Peyman Gholami , Robert Xiao

Face inpainting techniques recover missing or occluded facial regions in a visually realistic manner, but preserving the identity in the final output remains a fundamental challenge. Identity consistency is crucial for downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 João Santos , Carlos Santiago , Manuel Marques

Pre-trained diffusion models have enabled significant advancements in All-in-One Restoration (AiOR), offering improved perceptual quality and generalization. However, diffusion-based restoration methods primarily rely on fine-tuning or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sudarshan Rajagopalan , Vishal M. Patel

We present a training-free framework for occluded text rendering with a pretrained FLUX.1-dev backbone. The task requires a model to render recognizable typography and place an occluding object over the intended text region. This setting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jingqi Hou , Hongtian Wang

Spurious features associated with class labels can lead image classifiers to rely on shortcuts that don't generalize well to new domains. This is especially problematic in medical settings, where biased models fail when applied to different…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Qixuan Jin , Walter Gerych , Marzyeh Ghassemi

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that…

Image and Video Processing · Electrical Eng. & Systems 2023-04-03 Pouria Rouzrokh , Bardia Khosravi , Shahriar Faghani , Mana Moassefi , Sanaz Vahdati , Bradley J. Erickson

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtong Tan , Feng Zhao

DiffusionAvatars synthesizes a high-fidelity 3D head avatar of a person, offering intuitive control over both pose and expression. We propose a diffusion-based neural renderer that leverages generic 2D priors to produce compelling images of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Tobias Kirschstein , Simon Giebenhain , Matthias Nießner