English
Related papers

Related papers: TempCore: Are Video QA Benchmarks Temporally Groun…

200 papers

Rapid development of large language models (LLMs) has significantly advanced multimodal large language models (LMMs), particularly in vision-language tasks. However, existing video-language models often overlook precise temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shimin Chen , Xiaohan Lan , Yitian Yuan , Zequn Jie , Lin Ma

Large language models (LLMs) have shown promise in generating program workflows for visual tasks. However, previous approaches often rely on closed-source models, lack systematic reasoning, and struggle with long-form video question…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chenglin Li , Feng Han , Yikun Wang , Ruilin Li , Shuai Dong , Haowen Hou , Haitao Li , Qianglong Chen , Feng Tao , Jingqi Tong , Yin Zhang , Jiaqi Wang

Vision-language models (VLMs) show promise as tools for inferring affect from visual stimuli at scale; it is not yet clear how closely their outputs align with human affective ratings. We benchmarked nine VLMs, ranging from state-of-the-art…

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections…

Computation and Language · Computer Science 2026-04-15 Nicholas Moratelli , Christopher Davis , Leonardo F. R. Ribeiro , Bill Byrne , Gonzalo Iglesias

Despite the recent success of video self-supervised learning models, there is much still to be understood about their generalization capability. In this paper, we investigate how sensitive video self-supervised learning is to the current…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Fida Mohammad Thoker , Hazel Doughty , Piyush Bagad , Cees Snoek

Video Large Language Models (Video LLMs) have recently exhibited remarkable capabilities in general video understanding. However, they mainly focus on holistic comprehension and struggle with capturing fine-grained spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yuqian Yuan , Hang Zhang , Wentong Li , Zesen Cheng , Boqiang Zhang , Long Li , Xin Li , Deli Zhao , Wenqiao Zhang , Yueting Zhuang , Jianke Zhu , Lidong Bing

Video Large Language Models (Video LLMs) have shown remarkable progress in understanding and reasoning about visual content, particularly in tasks involving text recognition and text-based visual question answering (Text VQA). However,…

Vision-language temporal alignment is a crucial capability for human dynamic recognition and cognition in real-world scenarios. While existing research focuses on capturing vision-language relevance, it faces limitations due to biased…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Hao Du , Bo Wu , Yan Lu , Zhendong Mao

Existing efforts in text-based video question answering (TextVideoQA) are criticized for their opaque decisionmaking and heavy reliance on scene-text recognition. In this paper, we propose to study Grounded TextVideoQA by forcing models to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Sheng Zhou , Junbin Xiao , Xun Yang , Peipei Song , Dan Guo , Angela Yao , Meng Wang , Tat-Seng Chua

Vision-language-action (VLA) models achieve strong in-distribution performance but degrade sharply under novel camera viewpoints and visual perturbations. We show that this brittleness primarily arises from misalignment in Spatial Modeling,…

Robotics · Computer Science 2026-04-01 Weiqi Li , Quande Zhang , Ruifeng Zhai , Liang Lin , Guangrun Wang

While automatic subjective speech quality assessment has witnessed much progress, an open question is whether an automatic quality assessment at frame resolution is possible. This would be highly desirable, as it adds explainability to the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-10 Michael Kuhlmann , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

Multimodal large language models (MLLMs) have demonstrated remarkable potential for enhancing scene understanding in autonomous driving systems through powerful logical reasoning capabilities. However, the deployment of these models faces…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Yunsheng Ma , Amr Abdelraouf , Rohit Gupta , Ziran Wang , Kyungtae Han

Vision Language Models (VLMs) excel at visual question answering (VQA) but remain limited to snapshot vision, reasoning from static images. In contrast, embodied agents require ambulatory vision, actively moving to obtain more informative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Juil Koo , Daehyeon Choi , Sangwoo Youn , Phillip Y. Lee , Minhyuk Sung

Large Vision-Language Models (LVLMs) have achieved strong performance on vision-language tasks, particularly Visual Question Answering (VQA). While prior work has explored unimodal biases in VQA, the problem of selection bias in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Md. Atabuzzaman , Ali Asgarov , Chris Thomas

Visual Place Recognition (VPR) has evolved from handcrafted descriptors to deep learning approaches, yet significant challenges remain. Current approaches, including Vision Foundation Models (VFMs) and Multimodal Large Language Models…

Machine Learning · Computer Science 2025-09-03 Jintao Cheng , Weibin Li , Jiehao Luo , Xiaoyu Tang , Zhijian He , Jin Wu , Yao Zou , Wei Zhang

Large video language models (LVLMs) have made notable progress in video understanding, spurring the development of corresponding evaluation benchmarks. However, existing benchmarks generally assess overall performance across entire video…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Hou Xia , Zheren Fu , Fangcan Ling , Jiajun Li , Yi Tu , Zhendong Mao , Yongdong Zhang

Recently, large vision-language models (LVLMs) have emerged as the preferred tools for judging text-image alignment, yet their robustness along the visual modality remains underexplored. This work is the first study to address a key…

Computation and Language · Computer Science 2025-11-18 Yerin Hwang , Dongryeol Lee , Kyungmin Min , Taegwan Kang , Yong-il Kim , Kyomin Jung

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Video editing models have advanced significantly, but evaluating their performance remains challenging. Traditional metrics, such as CLIP text and image scores, often fall short: text scores are limited by inadequate training data and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Varun Biyyala , Bharat Chanderprakash Kathuria , Jialu Li , Youshan Zhang

Evaluating short-form video content requires moving beyond surface-level quality metrics toward human-aligned, multimodal reasoning. While existing frameworks like VideoScore-2 assess visual and semantic fidelity, they do not capture how…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arnav Gupta , Gurekas Singh Sahney , Hardik Rathi , Abhishek Chandwani , Ishaan Gupta , Pratik Narang , Dhruv Kumar