English
Related papers

Related papers: LSA: Localized Semantic Alignment for Enhancing Te…

200 papers

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

Temporal sentence grounding in videos aims to detect and localize one target video segment, which semantically corresponds to a given sentence. Existing methods mainly tackle this task via matching and aligning semantics between a sentence…

Computer Vision and Pattern Recognition · Computer Science 2019-11-01 Yitian Yuan , Lin Ma , Jingwen Wang , Wei Liu , Wenwu Zhu

Graph-based learning excels at capturing interaction patterns in diverse domains like recommendation, fraud detection, and particle physics. However, its performance often degrades under distribution shifts, especially those altering…

Machine Learning · Computer Science 2026-05-12 Hans Hao-Hsun Hsu , Shikun Liu , Han Zhao , Pan Li

The rapid development of diffusion models has greatly advanced AI-generated videos in terms of length and consistency recently, yet assessing AI-generated videos still remains challenging. Previous approaches have often focused on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiaze Li , Haoran Xu , Shiding Zhu , Junwei He , Haozhao Wang

Semantic segmentation from RGB cameras is essential to the perception of autonomous flying vehicles. The stability of predictions through the captured videos is paramount to their reliability and, by extension, to the trustworthiness of the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Cédric Vincent , Taehyoung Kim , Henri Meeß

Event temporal graphs have been shown as convenient and effective representations of complex temporal relations between events in text. Recent studies, which employ pre-trained language models to auto-regressively generate linearised graphs…

Computation and Language · Computer Science 2024-04-03 Xingwei Tan , Yuxiang Zhou , Gabriele Pergola , Yulan He

Diffusion models have exhibited promising progress in video generation. However, they often struggle to retain consistent details within local regions across frames. One underlying cause is that traditional diffusion models approximate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Yupu Yao , Shangqi Deng , Zihan Cao , Harry Zhang , Liang-Jian Deng

Spatially consistent long-horizon video generation aims to maintain temporal and spatial consistency along predefined camera trajectories. Existing methods mostly entangle memory modeling with video generation, leading to inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yanjun Guo , Zhengqiang Zhang , Pengfei Wang , Xinyue Liang , Zhiyuan Ma , Lei Zhang

Transformations produced by image and video generation models often evolve in a highly non-linear manner: long stretches where the content barely changes are followed by sudden, abrupt semantic jumps. To analyze and correct this behavior,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Gal Metzer , Sagi Polaczek , Ali Mahdavi-Amiri , Raja Giryes , Daniel Cohen-Or

Recent advances in training-free video editing have enabled lightweight and precise cross-frame generation by leveraging pre-trained text-to-image diffusion models. However, existing methods often rely on heuristic frame selection to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zhangkai Wu , Xuhui Fan , Zhongyuan Xie , Kaize Shi , Longbing Cao

The development of unsupervised Video Anomaly Detection (VAD) relies on technologies in the field of signal processing. Since the anomaly is quite ambiguous and unbounded, different detection demands may often be raised even in one…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Kai Cheng , Xinzhe Li , Lijuan Che

The task of language-guided video temporal grounding is to localize the particular video clip corresponding to a query sentence in an untrimmed video. Though progress has been made continuously in this field, some issues still need to be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Binjie Zhang , Yu Li , Chun Yuan , Dejing Xu , Pin Jiang , Ying Shan

Vision-Language-Action (VLA) models for autonomous driving must integrate diverse textual inputs, including navigation commands, hazard warnings, and traffic state descriptions, yet current systems often present these as disconnected…

Robotics · Computer Science 2026-04-03 Yun Li , Yidu Zhang , Simon Thompson , Ehsan Javanmardi , Manabu Tsukada

Video large language models (Video-LLMs) can temporally ground language queries and retrieve video moments. Yet, such temporal comprehension capabilities are neither well-studied nor understood. So we conduct a study on prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Minjoon Jung , Junbin Xiao , Byoung-Tak Zhang , Angela Yao

The generative model has made significant advancements in the creation of realistic videos, which causes security issues. However, this emerging risk has not been adequately addressed due to the absence of a benchmark dataset for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Peisong He , Leyao Zhu , Jiaxing Li , Shiqi Wang , Haoliang Li

Real-world visual data rarely presents as isolated, static instances. Instead, it often evolves gradually over time through variations in pose, lighting, object state, or scene context. However, conventional classifiers are typically…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xi Ding , Lei Wang , Piotr Koniusz , Yongsheng Gao

Text to video generation has emerged as a critical frontier in generative artificial intelligence, yet existing approaches struggle with maintaining temporal consistency, compositional understanding, and fine grained control over visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Piyushkumar Patel

As super-resolution (SR) techniques introduce unique distortions that fundamentally differ from those caused by traditional degradation processes (e.g., compression), there is an increasing demand for specialized video quality assessment…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yixiao Li , Xiaoyuan Yang , Weide Liu , Xin Jin , Xu Jia , Yukun Lai , Paul L Rosin , Haotao Liu , Wei Zhou

Learning to localize temporal boundaries of procedure steps in instructional videos is challenging due to the limited availability of annotated large-scale training videos. Recent works focus on learning the cross-modal alignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Yuxiao Chen , Kai Li , Wentao Bao , Deep Patel , Yu Kong , Martin Renqiang Min , Dimitris N. Metaxas

Video-Language Pre-training models have recently significantly improved various multi-modal downstream tasks. Previous dominant works mainly adopt contrastive learning to achieve global feature alignment across modalities. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Fan Ma , Xiaojie Jin , Heng Wang , Jingjia Huang , Linchao Zhu , Jiashi Feng , Yi Yang