English
Related papers

Related papers: Perception Test 2025: Challenge Summary and a Unif…

200 papers

Understanding surveillance video content remains a critical yet underexplored challenge in vision-language research, particularly due to its real-world complexity, irregular event dynamics, and safety-critical implications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bo Liu , Pengfei Qiao , Minhan Ma , Xuange Zhang , Yinan Tang , Peng Xu , Kun Liu , Tongtong Yuan

Multi-modal fusion is proven to be an effective method to improve the accuracy and robustness of speaker tracking, especially in complex scenarios. However, how to combine the heterogeneous information and exploit the complementarity of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Yidi Li , Hong Liu , Hao Tang

This report summarizes the objectives, datasets, and top-performing methodologies of the 2026 Pixel-level Video Understanding in the Wild (PVUW) Challenge, hosted at CVPR 2026, which evaluates state-of-the-art models under highly…

Object tracking has been broadly applied in unmanned aerial vehicle (UAV) tasks in recent years. However, existing algorithms still face difficulties such as partial occlusion, clutter background, and other challenging visual factors.…

Robotics · Computer Science 2020-09-01 Yujie He , Changhong Fu , Fuling Lin , Yiming Li , Peng Lu

Most recent work in goal oriented visual navigation resorts to large-scale machine learning in simulated environments. The main challenge lies in learning compact representations generalizable to unseen environments and in learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Guillaume Bono , Leonid Antsfeld , Boris Chidlovskii , Philippe Weinzaepfel , Christian Wolf

Multi-Object Tracking (MOT) has been notoriously difficult to evaluate. Previous metrics overemphasize the importance of either detection or association. To address this, we present a novel MOT evaluation metric, HOTA (Higher Order Tracking…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathon Luiten , Aljosa Osep , Patrick Dendorfer , Philip Torr , Andreas Geiger , Laura Leal-Taixe , Bastian Leibe

The ninth AI City Challenge continues to advance real-world applications of computer vision and AI in transportation, industrial automation, and public safety. The 2025 edition featured four tracks and saw a 17% increase in participation,…

Accurate emotion understanding in videos necessitates effectively recognizing and interpreting emotional states by integrating visual, textual, auditory, and contextual cues. Although recent Large Multimodal Models (LMMs) have exhibited…

With the rapid growth of Internet video data amounts and types, a unified Video Quality Assessment (VQA) is needed to inspire video communication with perceptual quality. To meet the real-time and universal requirements in providing such…

Multimedia · Computer Science 2023-03-27 Xinhui Huang , Chunyi Li , Abdelhak Bentaleb , Roger Zimmermann , Guangtao Zhai

Traffic event cognition and reasoning in videos is an important task that has a wide range of applications in intelligent transportation, assisted driving, and autonomous vehicles. In this paper, we create a novel dataset, SUTD-TrafficQA…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Li Xu , He Huang , Jun Liu

The goal of the YouMakeup VQA Challenge 2020 is to provide a common benchmark for fine-grained action understanding in domain-specific videos e.g. makeup instructional videos. We propose two novel question-answering tasks to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Shizhe Chen , Weiying Wang , Ludan Ruan , Linli Yao , Qin Jin

Multi-Object Tracking (MOT) has traditionally focused on a few specific categories, restricting its applicability to real-world scenarios involving diverse objects. Open-Vocabulary Multi-Object Tracking (OVMOT) addresses this by enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Zekun Qian , Wei Feng , Ruize Han , Junhui Hou

Dynamic attention mechanism and global modeling ability make Transformer show strong feature learning ability. In recent years, Transformer has become comparable to CNNs methods in computer vision. This review mainly investigates the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Yuting Yang , Licheng Jiao , Xu Liu , Fang Liu , Shuyuan Yang , Zhixi Feng , Xu Tang

Visual Question Answering (VQA) has become one of the key benchmarks of visual recognition progress. Multiple VQA extensions have been explored to better simulate real-world settings: different question formulations, changing training and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Arjun Mani , Nobline Yoo , Will Hinthorn , Olga Russakovsky

Multimodal Large Language Models (MLLMs) such as GPT-4V and Gemini Pro face challenges in achieving human-level perception in Visual Question Answering (VQA), particularly in object-oriented perception tasks which demand fine-grained…

Computation and Language · Computer Science 2024-04-09 Songtao Jiang , Yan Zhang , Chenyi Zhou , Yeying Jin , Yang Feng , Jian Wu , Zuozhu Liu

We propose Context-aware Video-text Alignment (CVA), a novel framework to address a significant challenge in video temporal grounding: achieving temporally sensitive video-text alignment that remains robust to irrelevant background context.…

Machine Learning · Computer Science 2026-03-27 Sungho Moon , Seunghun Lee , Jiwan Seo , Sunghoon Im

Currently, vision encoder models like Vision Transformers (ViTs) typically excel at image recognition tasks but cannot simultaneously support text recognition like human visual recognition. To address this limitation, we propose UNIT, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Yi Zhu , Yanpeng Zhou , Chunwei Wang , Yang Cao , Jianhua Han , Lu Hou , Hang Xu

Multi-object tracking (MOT) has profound applications in a variety of fields, including surveillance, sports analytics, self-driving, and cooperative robotics. Despite considerable advancements, existing MOT methodologies tend to falter…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Hamza Mukhtar , Muhammad Usman Ghani Khan

3D Scene Question Answering (3D SQA) represents an interdisciplinary task that integrates 3D visual perception and natural language processing, empowering intelligent agents to comprehend and interact with complex 3D environments. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Zechuan Li , Hongshan Yu , Yihao Ding , Yan Li , Yong He , Naveed Akhtar

Current multimodal models aim to transcend the limitations of single-modality representations by unifying understanding and generation, often using text-to-image (T2I) tasks to calibrate semantic consistency. However, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Juanxi Tian , Siyuan Li , Conghui He , Lijun Wu , Cheng Tan