English
Related papers

Related papers: When to Lock Attention: Training-Free KV Control i…

200 papers

In vision-language models (VLMs), misalignment between textual descriptions and visual coordinates often induces hallucinations. This issue becomes particularly severe in dense prediction tasks such as spatial-temporal video grounding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Xiaowen Zhang , Zhi Gao , Licheng Jiao , Lingling Li , Qing Li

Rapid advancements in video diffusion models have enabled the creation of realistic videos, raising concerns about unauthorized use and driving the demand for techniques to protect model ownership. Existing watermarking methods, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 MinHyuk Jang , Youngdong Jang , JaeHyeok Lee , Feng Yang , Gyeongrok Oh , Jongheon Jeong , Sangpil Kim

CLIP-based prompt tuning enables pretrained Vision-Language Models (VLMs) to efficiently adapt to downstream tasks. Although existing studies have made significant progress, they pay limited attention to changes in the internal attention…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haoyang Li , Liang Wang , Siyu Zhou , Jiacheng Sun , Jing Jiang , Chao Wang , Guodong Long , Yan Peng

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

Artificial Intelligence · Computer Science 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Recently, video diffusion models (VDMs) have garnered significant attention due to their notable advancements in generating coherent and realistic video content. However, processing multiple frame features concurrently, coupled with the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Shilong Tian , Hong Chen , Chengtao Lv , Yu Liu , Jinyang Guo , Xianglong Liu , Shengxi Li , Hao Yang , Tao Xie

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Text-to-video diffusion models generate realistic videos, but often fail on prompts requiring fine-grained compositional understanding, such as relations between entities, attributes, actions, and motion directions. We hypothesize that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ariel Shaulov , Eitan Shaar , Amit Edenzon , Gal Chechik , Lior Wolf

Video Quality Assessment (VQA), which intends to predict the perceptual quality of videos, has attracted increasing attention. Due to factors like motion blur or specific distortions, the quality of different regions in a video varies.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yunpeng Qu , Kun Yuan , Qizhi Xie , Ming Sun , Chao Zhou , Jian Wang

Diffusion-based visuomotor policies built on 3D visual representations have achieved strong performance in learning complex robotic skills. However, most existing methods employ an oversized denoising decoder. While increasing model…

Robotics · Computer Science 2026-05-12 Jinhao Zhang , Wenlong Xia , Yaojia Wang , Zhexuan Zhou , Huizhe Li , Yichen Lai , Haoming Song , Youmin Gong , Jie Mei

Visual generation quality has been greatly promoted with the rapid advances in diffusion transformers (DiTs), which is attributed to the scaling of model size and complexity. However, these attributions also hinder the practical deployment…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kai Liu , Shaoqiu Zhang , Linghe Kong , Yulun Zhang

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

Computation and Language · Computer Science 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Training-free video object editing aims to achieve precise object-level manipulation, including object insertion, swapping, and deletion. However, it faces significant challenges in maintaining fidelity and temporal consistency. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yiyang Chen , Xuanhua He , Xiujun Ma , Yue Ma

Visual diffusion models achieve remarkable progress, yet they are typically trained at limited resolutions due to the lack of high-resolution data and constrained computation resources, hampering their ability to generate high-fidelity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Haonan Qiu , Shiwei Zhang , Yujie Wei , Ruihang Chu , Hangjie Yuan , Xiang Wang , Yingya Zhang , Ziwei Liu

Contrastive decoding strategies are widely used to mitigate object hallucinations in multimodal large language models (MLLMs). By reducing over-reliance on language priors, these strategies ensure that generated content remains closely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Hao Yin , Guangzong Si , Zilei Wang

Zero-shot, training-free, image-based text-to-video generation is an emerging area that aims to generate videos using existing image-based diffusion models. Current methods in this space require specific architectural changes to image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Diljeet Jagpal , Xi Chen , Vinay P. Namboodiri

We present Vivid-VR, a DiT-based generative video restoration method built upon an advanced T2V foundation model, where ControlNet is leveraged to control the generation process, ensuring content consistency. However, conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Haoran Bai , Xiaoxu Chen , Canqian Yang , Zongyao He , Sibin Deng , Ying Chen

Layout generation is a foundation task of graphic design, which requires the integration of visual aesthetics and harmonious expression of content delivery. However, existing methods still face challenges in generating precise and visually…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yu Li , Yifan Chen , Gongye Liu , Fei Yin , Qingyan Bai , Jie Wu , Hongfa Wang , Ruihang Chu , Yujiu Yang

This paper presents Qffusion, a dual-frame-guided framework for portrait video editing. Specifically, we consider a design principle of ``animation for editing'', and train Qffusion as a general animation framework from two still reference…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Maomao Li , Lijian Lin , Yunfei Liu , Ye Zhu , Yu Li

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zakaria Patel , Kirill Serkh

Object-level manipulation, relocating or reorienting objects in images or videos while preserving scene realism, is central to film post-production, AR, and creative editing. Yet existing methods struggle to jointly achieve three core…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Penghui Ruan , Bojia Zi , Xianbiao Qi , Youze Huang , Rong Xiao , Pichao Wang , Jiannong Cao , Yuhui Shi