English
Related papers

Related papers: ReaMOT: A Benchmark and Framework for Reasoning-ba…

200 papers

Cross-view multi-object tracking aims to link objects between frames and camera views with substantial overlaps. Although cross-view multi-object tracking has received increased attention in recent years, existing datasets still have…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shenghao Hao , Peiyuan Liu , Yibing Zhan , Kaixun Jin , Zuozhu Liu , Mingli Song , Jenq-Neng Hwang , Gaoang Wang

Although most current large multimodal models (LMMs) can already understand photos of natural scenes and portraits, their understanding of abstract images, e.g., charts, maps, or layouts, and visual reasoning capabilities remains quite…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Wenqi Zhang , Zhenglin Cheng , Yuanyu He , Mengna Wang , Yongliang Shen , Zeqi Tan , Guiyang Hou , Mingqian He , Yanna Ma , Weiming Lu , Yueting Zhuang

Although large visual-language models (LVLMs) have demonstrated strong performance in multimodal tasks, errors may occasionally arise due to biases during the reasoning process. Recently, reward models (RMs) have become increasingly pivotal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiacheng Ruan , Wenzhen Yuan , Xian Gao , Ye Guo , Daoxin Zhang , Zhe Xu , Yao Hu , Ting Liu , Yuzhuo Fu

We aim to improve the performance of Multiple Object Tracking and Segmentation (MOTS) by refinement. However, it remains challenging for refining MOTS results, which could be attributed to that appearance features are not adapted to target…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Fan Yang , Xin Chang , Chenyu Dang , Ziqiang Zheng , Sakriani Sakti , Satoshi Nakamura , Yang Wu

Multi-object tracking (MOT) is a fundamental problem in computer vision with numerous applications, such as intelligent surveillance and automated driving. Despite the significant progress made in MOT, pedestrian attributes, such as gender,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yunhao Li , Zhen Xiao , Lin Yang , Dan Meng , Xin Zhou , Heng Fan , Libo Zhang

Recent advances in large language models have significantly improved textual reasoning through the effective use of Chain-of-Thought (CoT) and reinforcement learning. However, extending these successes to vision-language tasks remains…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Minheng Ni , Zhengyuan Yang , Linjie Li , Chung-Ching Lin , Kevin Lin , Wangmeng Zuo , Lijuan Wang

Deeply understanding sports requires an intricate blend of fine-grained visual perception and rule-based reasoning - a challenge that pushes the limits of current multimodal models. To succeed, models must master three critical…

Visual reasoning abilities play a crucial role in understanding complex multimodal data, advancing both domain-specific applications and artificial general intelligence (AGI). Existing methods enhance Vision-Language Models (VLMs) through…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Huajie Tan , Yuheng Ji , Xiaoshuai Hao , Xiansheng Chen , Pengwei Wang , Zhongyuan Wang , Shanghang Zhang

Existing visual trackers mainly operate in a non-interactive, fire-and-forget manner, making them impractical for real-world scenarios that require human-in-the-loop adaptation. To overcome this limitation, we introduce Interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yuqing Huang , Guotian Zeng , Zhenqiao Yuan , Zhenyu He , Xin Li , Yaowei Wang , Ming-Hsuan Yang

While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Congzhi Zhang , Zhibin Wang , Yinchao Ma , Jiawei Peng , Yihan Wang , Qiang Zhou , Jun Song , Bo Zheng

As multi-object tracking (MOT) tasks continue to evolve toward more general and multi-modal scenarios, the rigid and task-specific architectures of existing MOT methods increasingly hinder their applicability across diverse tasks and limit…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Lianjie Jia , Yuhan Wu , Binghao Ran , Yifan Wang , Lijun Wang , Huchuan Lu

Referring Multi-Object Tracking (RMOT) is a relatively new concept that has rapidly gained traction as a promising research direction at the intersection of computer vision and natural language processing. Unlike traditional multi-object…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Huu-Thien Tran , Phuoc-Sang Pham , Thai-Son Tran , Khoa Luu

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

The sequential structure of videos poses a challenge to the ability of multimodal large language models (MLLMs) to locate multi-frame evidence and conduct multimodal reasoning. However, existing video benchmarks mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Kejian Zhu , Zhuoran Jin , Hongbang Yuan , Jiachun Li , Shangqing Tu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Recent advances in reasoning models have shown remarkable progress in text-based domains, but transferring those capabilities to multimodal settings, e.g., to allow reasoning over audio-visual data, still remains a challenge, in part…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Edson Araujo , Saurabhchand Bhati , M. Jehanzeb Mirza , Brian Kingsbury , Samuel Thomas , Rogerio Feris , James R. Glass , Hilde Kuehne

Fine-grained visual reasoning remains a core challenge for multimodal large language models (MLLMs). The recently introduced ReasonMap highlights this gap by showing that even advanced MLLMs struggle with spatial reasoning in structured and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Sicheng Feng , Kaiwen Tuo , Song Wang , Lingdong Kong , Jianke Zhu , Huan Wang

Multi-object tracking (MOT) is an important problem in computer vision which has a wide range of applications. Formulating MOT as multi-task learning of object detection and re-ID in a single network is appealing since it allows joint…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Yifu Zhang , Chunyu Wang , Xinggang Wang , Wenjun Zeng , Wenyu Liu

As multimodal content continues to expand at a rapid pace, audio retrieval has emerged as a key enabling technology for media search, content organization, and intelligent assistants. However, most existing benchmarks concentrate on…

Artificial Intelligence · Computer Science 2026-05-07 Honglei Zhang , Yuting Chen , Chenpeng Hu , Siyue Zhang , Yilei Shi

Multimodal vision-language (VL) learning has noticeably pushed the tendency toward generic intelligence owing to emerging large foundation models. However, tracking, as a fundamental vision problem, surprisingly enjoys less bonus from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mingzhe Guo , Zhipeng Zhang , Liping Jing , Haibin Ling , Heng Fan

The new trend in multi-object tracking task is to track objects of interest using natural language. However, the scarcity of paired prompt-instance data hinders its progress. To address this challenge, we propose a high-quality yet low-cost…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Zeliang Ma , Song Yang , Zhe Cui , Zhicheng Zhao , Fei Su , Delong Liu , Jingyu Wang