English
Related papers

Related papers: Vision-Motion-Reference Alignment for Referring Mu…

200 papers

Significant progress has been achieved in multi-object tracking (MOT) through the evolution of detection and re-identification (ReID) techniques. Despite these advancements, accurately tracking objects in scenarios with homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Changcheng Xiao , Qiong Cao , Yujie Zhong , Long Lan , Xiang Zhang , Zhigang Luo , Dacheng Tao

Multi-point tracking is a challenging task that involves detecting points in the scene and tracking them across a sequence of frames. Computing detection-based measures like the F-measure on a frame-by-frame basis is not sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Lalith Sharan , Halvar Kelm , Gabriele Romano , Matthias Karck , Raffaele De Simone , Sandy Engelhardt

Multimodal pre-training remains constrained by the descriptive bias of image-caption pairs, leading models to favor surface linguistic cues over grounded visual understanding. We introduce MMRPT, a masked multimodal reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuhui Zheng , Kang An , Ziliang Wang , Yuhang Wang , Faqiang Qian , Yichao Wu

Advanced in-cabin sensing technologies, especially vision based approaches, have tremendously progressed user interaction inside the vehicle, paving the way for new applications of natural user interaction. Just as humans use multiple modes…

Human-Computer Interaction · Computer Science 2022-02-16 Abdul Rafey Aftab , Michael von der Beeck

With the advancement of video analysis technology, the multi-object tracking (MOT) problem in complex scenes involving pedestrians is gaining increasing importance. This challenge primarily involves two key tasks: pedestrian detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jiayi Chen , Chunhua Deng

Multi-view object tracking (MVOT) offers promising solutions to challenges such as occlusion and target loss, which are common in traditional single-view tracking. However, progress has been limited by the lack of comprehensive multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Mengjie Xu , Yitao Zhu , Haotian Jiang , Jiaming Li , Zhenrong Shen , Sheng Wang , Haolin Huang , Xinyu Wang , Qing Yang , Han Zhang , Qian Wang

The goal of multi-object tracking (MOT) is to detect and track all objects in a scene across frames, while maintaining a unique identity for each object. Most existing methods rely on the spatial-temporal motion features and appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Yanzhao Fang

Large language models (LLMs) have become increasingly useful computational models of human language processing, but it remains unclear whether vision-language learning makes text representations more human-like during natural reading. Here,…

Computation and Language · Computer Science 2026-05-28 Jinzhou Wu , Zhengwu Ma , Jixing Li , Baoping Tang , Zitong Lu

Human Video Motion Transfer (HVMT) aims to, given an image of a source person, generate his/her video that imitates the motion of the driving person. Existing methods for HVMT mainly exploit Generative Adversarial Networks (GANs) to perform…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Quanwei Yang , Xinchen Liu , Wu Liu , Hongtao Xie , Xiaoyan Gu , Lingyun Yu , Yongdong Zhang

Autonomous exploration and object search in unknown indoor environments remain challenging for multi-robot systems (MRS). Traditional approaches often rely on greedy frontier assignment strategies with limited inter-robot coordination. In…

Robotics · Computer Science 2026-03-03 Ruiyang Wang , Hao-Lun Hsu , David Hunt , Jiwoo Kim , Shaocheng Luo , Miroslav Pajic

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Multiple object tracking (MOT) is a crucial task in computer vision society. However, most tracking-by-detection MOT methods, with available detected bounding boxes, cannot effectively handle static, slow-moving and fast-moving camera…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Jiarui Cai , Yizhou Wang , Haotian Zhang , Hung-Min Hsu , Chengqian Ma , Jenq-Neng Hwang

Multimodal Large Language Models (MLLMs) have achieved remarkable success in vision-language tasks but their remote sensing (RS) counterpart are relatively under explored. Unlike natural images, RS imagery presents unique challenges that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Abduljaleel Adejumo , Faegheh Yeganli , Clifford Broni-bediako , Aoran Xiao , Naoto Yokoya , Mennatullah Siam

Multi-modal Large Language Models (MLLMs) have demonstrated their ability to perceive objects in still images, but their application in video-related tasks, such as object tracking, remains understudied. This lack of exploration is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Han Wang , Yanjie Wang , Yongjie Ye , Yuxiang Nie , Can Huang

Despite recent progress, Multi-Object Tracking (MOT) continues to face significant challenges, particularly its dependence on prior knowledge and predefined categories, complicating the tracking of unfamiliar objects. Generic Multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Duy Le Dinh Anh , Kim Hoang Tran , Quang-Thuc Nguyen , Ngan Hoang Le

Visual navigation in unknown environments based solely on natural language descriptions is a key capability for intelligent robots. In this work, we propose a navigation framework built upon off-the-shelf Visual Language Models (VLMs),…

Robotics · Computer Science 2025-08-08 Weifan Zhang , Tingguang Li , Yuzhen Liu

Vision-Language Models (VLMs) have shown strong performance in tasks like visual question answering and multimodal text generation, but their effectiveness in scientific domains such as materials science remains limited. While some machine…

Machine Learning · Computer Science 2025-11-11 An Vuong , Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

Building a general model capable of analyzing human trajectories across different geographic regions and different tasks becomes an emergent yet important problem for various applications. However, existing works suffer from the…

Multimedia · Computer Science 2025-09-03 Shuo Liu , Di Yao , Yan Lin , Gao Cong , Jingping Bi

Current mainstream vision-language (VL) tracking framework consists of three parts, \ie a visual feature extractor, a language feature extractor, and a fusion model. To pursue better performance, a natural modus operandi for VL tracking is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Chunhui Zhang , Xin Sun , Yiqian Yang , Li Liu , Qiong Liu , Xi Zhou , Yanfeng Wang

Multi-object tracking (MOT) is a fundamental task in computer vision with critical applications in autonomous driving and robotics. Multimodal MOT that integrates visible light and thermal infrared information is particularly essential for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Weiran Li , Yeqiang Liu , Yijie Wei , Mina Han , Qiannan Guo , Zhenbo Li