English
Related papers

Related papers: Perception Test 2025: Challenge Summary and a Unif…

200 papers

Tracking and segmenting multiple similar objects with distinct or complex parts in long-term videos is particularly challenging due to the ambiguity in identifying target components and the confusion caused by occlusion, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xin Li , Deshui Miao , Zhenyu He , Yaowei Wang , Huchuan Lu , Ming-Hsuan Yang

Existing multimodal tracking studies focus on bi-modal scenarios such as RGB-Thermal, RGB-Event, and RGB-Language. Although promising tracking performance is achieved through leveraging complementary cues from different sources, it remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Andong Lu , Mai Wen , Jinhu Wang , Yuanzhi Guo , Chenglong Li , Jin Tang , Bin Luo

Visual Question Answering (VQA) requires models to reason over multimodal information, combining visual and textual data. With the development of continual learning, significant progress has been made in retaining knowledge and adapting to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Zhifei Li , Yiran Wang , Chenyi Xiong , Yujing Xia , Xiaoju Hou , Yue Zhao , Miao Zhang , Kui Xiao , Bing Yang

Despite the rapid development of video Large Language Models (LLMs), a comprehensive evaluation is still absent. In this paper, we introduce a unified evaluation that encompasses multiple video tasks, including captioning, question and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Shuailin Li , Yuang Zhang , Yucheng Zhao , Qiuyue Wang , Fan Jia , Yingfei Liu , Tiancai Wang

Accurate and efficient Video Quality Assessment (VQA) has long been a key research challenge. Current mainstream VQA methods typically improve performance by pretraining on large-scale classification datasets (e.g., ImageNet, Kinetics-400),…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yachun Mi , Yu Li , Yanting Li , Chen Hui , Tong Zhang , Zhixuan Li , Chenyue Song , Wei Yang Bryan Lim , Shaohui Liu

Vision-language tasks, such as VQA, SNLI-VE, and VCR are challenging because they require the model's reasoning ability to understand the semantics of the visual world and natural language. Supervised methods working for vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhecan Wang , Rui Sun , Haoxuan You , Noel Codella , Kai-Wei Chang , Shih-Fu Chang

The field of Abstract Visual Reasoning (AVR) encompasses a wide range of problems, many of which are inspired by human IQ tests. The variety of AVR tasks has resulted in state-of-the-art AVR methods being task-specific approaches.…

Artificial Intelligence · Computer Science 2024-06-18 Mikołaj Małkiński , Jacek Mańdziuk

We present our three branch solutions for International Challenge on Activity Recognition at CVPR2019. This model seeks to fuse richer information of global video clip, short human attention and long-term human activity into a unified…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Jin Xia , Jiajun Tang , Cewu Lu

Composed Video Retrieval (CoVR) aims to retrieve a target video from a large gallery using a reference video and a textual query specifying visual modifications. However, existing benchmarks consider only visual changes, ignoring videos…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Gyuwon Han , Young Kyun Jang , Chanho Eom

When watching videos, the occurrence of a visual event is often accompanied by an audio event, e.g., the voice of lip motion, the music of playing instruments. There is an underlying correlation between audio and visual events, which can be…

Multimedia · Computer Science 2020-08-19 Ying Cheng , Ruize Wang , Zhihao Pan , Rui Feng , Yuejie Zhang

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

This paper presents the Video Super-Resolution (SR) Quality Assessment (QA) Challenge that was part of the Advances in Image Manipulation (AIM) workshop, held in conjunction with ECCV 2024. The task of this challenge was to develop an…

Robotic manipulation has seen rapid progress with vision-language-action (VLA) policies. However, visuo-tactile perception is critical for contact-rich manipulation, as tasks such as insertion are difficult to complete robustly using vision…

The problem of visual tracking evaluation is sporting a large variety of performance measures, and largely suffers from lack of consensus about which measures should be used in experiments. This makes the cross-paper tracker comparison…

Computer Vision and Pattern Recognition · Computer Science 2016-03-08 Luka Čehovin , Aleš Leonardis , Matej Kristan

The real world is dynamic, yet most image fusion methods process static frames independently, ignoring temporal correlations in videos and leading to flickering and temporal inconsistency. To address this, we propose Unified Video Fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Zixiang Zhao , Haowen Bai , Bingxin Ke , Yukun Cui , Lilun Deng , Yulun Zhang , Kai Zhang , Konrad Schindler

Multimodal models like LLaVA-1.5 achieve state-of-the-art visual understanding through visual instruction tuning on multitask datasets, enabling strong instruction-following and multimodal performance. However, multitask learning faces…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Wenzhuo Liu , Fei Zhu , Haiyang Guo , Longhui Wei , Cheng-Lin Liu

Small object-centric spatial understanding in indoor videos remains a significant challenge for multimodal large language models (MLLMs), despite its practical value for object search and assistive applications. Although existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhiyu Zhou , Peilin Liu , Ruoxuan Zhang , Luyang Zhang , Cheng Zhang , Hongxia Xie , Wen-Huang Cheng

The increasing popularity of short video platforms such as YouTube Shorts, TikTok, and Kwai has led to a surge in User-Generated Content (UGC), which presents significant challenges for the generalization performance of Video Quality…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Xinli Yue , Jianhui Sun , Liangchao Yao , Fan Xia , Yuetang Deng , Tianyi Wang , Lei Li , Fengyun Rao , Jing Lv , Qian Wang , Lingchen Zhao

This paper focuses on the Audio-Visual Question Answering (AVQA) task that aims to answer questions derived from untrimmed audible videos. To generate accurate answers, an AVQA model is expected to find the most informative audio-visual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zhangbin Li , Dan Guo , Jinxing Zhou , Jing Zhang , Meng Wang

In long-video understanding, conventional uniform frame sampling often fails to capture key visual evidence, leading to degraded performance and increased hallucinations. To address this, recent agentic thinking-with-videos paradigms have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Wenqi Liu , Yunxiao Wang , Shijie Ma , Meng Liu , Qile Su , Tianke Zhang , Haonan Fan , Changyi Liu , Kaiyu Jiang , Jiankang Chen , Kaiyu Tang , Bin Wen , Fan Yang , Tingting Gao , Han Li , Yinwei Wei , Xuemeng Song