English
Related papers

Related papers: Conditional Latent Diffusion Models for Zero-Shot …

200 papers

Diffusion models excel at joint pixel sampling for image generation but lack efficient training-free methods for partial conditional sampling (e.g., inpainting with known pixels). Prior work typically formulates this as an intractable…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Candi Zheng , Yuan Lan , Yang Wang

In recent years, the task of segmenting foreground objects from background in a video, i.e. video object segmentation (VOS), has received considerable attention. In this paper, we propose a single end-to-end trainable deep neural network,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Ye Lyu , George Vosselman , Gui-Song Xia , Michael Ying Yang

We present a target-aware video diffusion model that generates videos from an input image, in which an actor interacts with a specified target while performing a desired action. The target is defined by a segmentation mask, and the action…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Taeksoo Kim , Hanbyul Joo

Weakly supervised object detection (WSOD) using only image-level annotations has attracted growing attention over the past few years. Existing approaches using multiple instance learning easily fall into local optima, because such mechanism…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Chenhao Lin , Siwen Wang , Dongqi Xu , Yu Lu , Wayne Zhang

Denoising diffusion models show remarkable performances in generative tasks, and their potential applications in perception tasks are gaining interest. In this paper, we introduce a novel framework named DiffRef3D which adopts the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Se-Ho Kim , Inyong Koo , Inyoung Lee , Byeongjun Park , Changick Kim

As online shopping is growing, the ability for buyers to virtually visualize products in their settings-a phenomenon we define as "Virtual Try-All"-has become crucial. Recent diffusion models inherently contain a world model, rendering them…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Mehmet Saygin Seyfioglu , Karim Bouyarmane , Suren Kumar , Amir Tavanaei , Ismail B. Tutar

Object detectors often suffer a decrease in performance due to the large domain gap between the training data (source domain) and real-world data (target domain). Diffusion-based generative models have shown remarkable abilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Boyong He , Yuxiang Ji , Zhuoyue Tan , Liaoni Wu

Diffusion models are widely recognized for generating high-quality and diverse images, but their poor real-time performance has led to numerous acceleration works, primarily focusing on UNet-based structures. With the more successful…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Pengtao Chen , Mingzhu Shen , Peng Ye , Jianjian Cao , Chongjun Tu , Christos-Savvas Bouganis , Yiren Zhao , Tao Chen

Recent progress in personalized image generation using diffusion models has been significant. However, development in the area of open-domain and non-fine-tuning personalized image generation is proceeding rather slowly. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jian Ma , Junhao Liang , Chen Chen , Haonan Lu

Object pose estimation plays a vital role in embodied AI and computer vision, enabling intelligent agents to comprehend and interact with their surroundings. Despite the practicality of category-level pose estimation, current approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jiyao Zhang , Mingdong Wu , Hao Dong

Score-based diffusion models have emerged as effective approaches for both conditional and unconditional generation. Still conditional generation is based on either a specific training of a conditional model or classifier guidance, which…

Machine Learning · Computer Science 2024-12-25 Davide Scassola , Sebastiano Saccani , Ginevra Carbone , Luca Bortolussi

Instance segmentation is of great importance for many biological applications, such as study of neural cell interactions, plant phenotyping, and quantitatively measuring how cells react to drug treatment. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jingru Yi , Pengxiang Wu , Hui Tang , Bo Liu , Qiaoying Huang , Hui Qu , Lianyi Han , Wei Fan , Daniel J. Hoeppner , Dimitris N. Metaxas

Obtaining annotated table structure data for complex tables is a challenging task due to the inherent diversity and complexity of real-world document layouts. The scarcity of publicly available datasets with comprehensive annotations for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Syed Jawwad Haider Hamdani , Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Diffusion models have become leading approaches for high-fidelity image generation. Recent DiT-based diffusion models, in particular, achieve strong prompt adherence while producing high-quality samples. We propose SHIFT, a simple but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Nina Konovalova , Andrey Kuznetsov , Aibek Alanov

Analyzing complex scenes with Deep Neural Networks is a challenging task, particularly when images contain multiple objects that partially occlude each other. Existing approaches to image analysis mostly process objects independently and do…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Xiaoding Yuan , Adam Kortylewski , Yihong Sun , Alan Yuille

Temporal action segmentation is crucial for understanding long-form videos. Previous works on this task commonly adopt an iterative refinement paradigm by using multi-stage models. We propose a novel framework via denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Daochang Liu , Qiyue Li , AnhDung Dinh , Tingting Jiang , Mubarak Shah , Chang Xu

Medical image segmentation is crucial for clinical diagnosis and treatment planning. Traditional methods typically produce a single segmentation mask, failing to capture inherent uncertainty. Recent generative models enable the creation of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Huynh Trinh Ngoc , Toan Nguyen Hai , Ba Luong Son , Long Tran Quoc

Denoising diffusion models have gained popularity as a generative modeling technique for producing high-quality and diverse images. Applying these models to downstream tasks requires conditioning, which can take the form of text, class…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Alexandros Graikos , Srikar Yellapragada , Dimitris Samaras

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Open-vocabulary segmentation is the task of segmenting anything that can be named in an image. Recently, large-scale vision-language modelling has led to significant advances in open-vocabulary segmentation, but at the cost of gargantuan…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Laurynas Karazija , Iro Laina , Andrea Vedaldi , Christian Rupprecht