English
Related papers

Related papers: Spatio-Temporal Data Enhanced Vision-Language Mode…

200 papers

Recent approaches have shown that large-scale vision-language models such as CLIP can improve semantic segmentation performance. These methods typically aim for pixel-level vision-language alignment, but often rely on low resolution image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Anurag Das , Xinting Hu , Li Jiang , Bernt Schiele

Understanding relations between objects is crucial for understanding the semantics of a visual scene. It is also an essential step in order to bridge visual and language models. However, current state-of-the-art computer vision models still…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Palaash Agrawal , Haidi Azaman , Cheston Tan

Answering complex questions about images is an ambitious goal for machine intelligence, which requires a joint understanding of images, text, and commonsense knowledge, as well as a strong reasoning ability. Recently, multimodal…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Zhecan Wang , Haoxuan You , Liunian Harold Li , Alireza Zareian , Suji Park , Yiqing Liang , Kai-Wei Chang , Shih-Fu Chang

Spatial synchronization in roadside scenarios is essential for integrating data from multiple sensors at different locations. Current methods using cascading spatial transformation (CST) often lead to cumulative errors in large-scale…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Yong Li , Zhiguo Zhao , Yunli Chen , Rui Tian

Scene understanding, defined as learning, extraction, and representation of interactions among traffic elements, is one of the critical challenges toward high-level autonomous driving (AD). Current scene understanding methods mainly focus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yuning Wang , Zhiyuan Liu , Haotian Lin , Junkai Jiang , Shaobing Xu , Jianqiang Wang

Video classification is highly important with wide applications, such as video search and intelligent surveillance. Video naturally consists of static and motion information, which can be represented by frame and optical flow. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-10 Yuxin Peng , Yunzhen Zhao , Junchao Zhang

Temporal modeling and spatio-temporal collaboration are pivotal techniques for video-based human pose estimation. Most state-of-the-art methods adopt optical flow or temporal difference, learning local visual content correspondence across…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Runyang Feng , Haoming Chen

Existing pedestrian attribute recognition (PAR) algorithms adopt pre-trained CNN (e.g., ResNet) as their backbone network for visual feature learning, which might obtain sub-optimal results due to the insufficient employment of the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiao Wang , Jiandong Jin , Chenglong Li , Jin Tang , Cheng Zhang , Wei Wang

Spatio-temporal point process (STPP) is a stochastic collection of events accompanied with time and space. Due to computational complexities, existing solutions for STPPs compromise with conditional independence between time and space,…

Machine Learning · Computer Science 2023-06-27 Yuan Yuan , Jingtao Ding , Chenyang Shao , Depeng Jin , Yong Li

Multimodal semantic cues, such as textual descriptions, have shown strong potential in enhancing target perception for tracking. However, existing methods rely on static textual descriptions from large language models, which lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Yukuan Zhang , Jiarui Zhao , Shangqing Nie , Jin Kuang , Shengsheng Wang

Humans use spatial language to naturally describe object locations and their relations. Interpreting spatial language not only adds a perceptual modality for robots, but also reduces the barrier of interfacing with humans. Previous work…

Robotics · Computer Science 2021-08-03 Kaiyu Zheng , Deniz Bayazit , Rebecca Mathew , Ellie Pavlick , Stefanie Tellex

Scene parsing aims to recognize the object category of every pixel in scene images, and it plays a central role in image content understanding and computer vision applications. However, accurate scene parsing from unconstrained real-world…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ligang Zhang

The efficient operation of modern cellular networks hinges on the accurate analysis of spatio-temporal traffic data. Mastering these patterns is essential for core network functions, chiefly forecasting future load to pre-empt congestion…

Machine Learning · Computer Science 2026-05-13 Yichen Zhang , Jun Li

The Spatio-Temporal Traffic Prediction (STTP) problem is a classical problem with plenty of prior research efforts that benefit from traditional statistical learning and recent deep learning approaches. While STTP can refer to many…

Machine Learning · Computer Science 2022-04-12 Leye Wang , Di Chai , Xuanzhe Liu , Liyue Chen , Kai Chen

Seamless integration of virtual and physical worlds in augmented reality benefits from the system semantically "understanding" the physical environment. AR research has long focused on the potential of context awareness, demonstrating novel…

Human-Computer Interaction · Computer Science 2024-10-08 Chengyuan Xu , Radha Kumaran , Noah Stier , Kangyou Yu , Tobias Höllerer

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

Recent years have witnessed the rapid development of deep-learning-based, graph-neural-network-based forecasting methods for modern intelligent transportation systems. However, most existing work focuses exclusively on capturing…

Machine Learning · Computer Science 2026-04-08 Lixiang Fan , Bohao Li , Tao Zou , Junchen Ye , Bowen Du

Scene text recognition (STR) has been an active research topic in computer vision for years. To tackle this challenging problem, numerous innovative methods have been successively proposed and incorporating linguistic knowledge into STR…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Peng Wang , Cheng Da , Cong Yao

Intelligent Transportation Systems (ITS) demand real-time collision prediction to ensure road safety and reduce accident severity. Conventional approaches rely on transmitting raw video or high-dimensional sensory data from roadside units…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Aisha Syed , Matthew Andrews , Sean Kennedy

Ensuring the safety of vulnerable road users through accurate prediction of pedestrian crossing intention (PCI) plays a crucial role in the context of autonomous and assisted driving. Analyzing the set of observation video frames in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hongbin Liang , Hezhe Qiao , Wei Huang , Qizhou Wang , Mingsheng Shang , Lin Chen