English
Related papers

Related papers: TimeLogic: A Temporal Logic Benchmark for Video QA

200 papers

Question Answering over Temporal Knowledge Graphs (TKGQA) has attracted growing interest for handling time-sensitive queries. However, existing methods still struggle with: 1) weak incorporation of temporal constraints in question…

Computation and Language · Computer Science 2026-02-24 Wuzhenghong Wen , Bowen Zhou , Jinwen Huang , Xianjie Wu , Yuwei Sun , Su Pan , Liang Li , Jianting Liu

Knowledge Base Question Answering (KBQA) tasks that involve complex reasoning are emerging as an important research direction. However, most existing KBQA datasets focus primarily on generic multi-hop reasoning over explicit facts, largely…

In this paper, we introduce EconLogicQA, a rigorous benchmark designed to assess the sequential reasoning capabilities of large language models (LLMs) within the intricate realms of economics, business, and supply chain management.…

Computation and Language · Computer Science 2024-09-24 Yinzhu Quan , Zefang Liu

Large Language Models (LLMs) have demonstrated immense advances in a wide range of natural language tasks. However, these models are susceptible to hallucinations and errors on particularly temporal understanding tasks involving multiple…

Computation and Language · Computer Science 2025-06-30 Alexandru Dumitru , V Venktesh , Adam Jatowt , Avishek Anand

Time series data are foundational in finance, healthcare, and energy domains. However, most existing methods and datasets remain focused on a narrow spectrum of tasks, such as forecasting or anomaly detection. To bridge this gap, we…

Computation and Language · Computer Science 2025-07-01 Yaxuan Kong , Yiyuan Yang , Yoontae Hwang , Wenjie Du , Stefan Zohren , Zhangyang Wang , Ming Jin , Qingsong Wen

Recent advancements in Large Video-Language Models (LVLMs) have led to promising results in multimodal video understanding. However, it remains unclear whether these models possess the cognitive capabilities required for high-level tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Chenglin Li , Qianglong Chen , Zhi Li , Feng Tao , Yin Zhang

Question answering over temporal knowledge graphs (TKGQA) has recently found increasing interest. TKGQA requires temporal reasoning techniques to extract the relevant information from temporal knowledge bases. The only existing TKGQA…

Artificial Intelligence · Computer Science 2023-07-21 Zifeng Ding , Zongyue Li , Ruoxia Qi , Jingpei Wu , Bailan He , Yunpu Ma , Zhao Meng , Shuo Chen , Ruotong Liao , Zhen Han , Volker Tresp

The rapid growth of streaming video applications demands multimodal models with enhanced capabilities for temporal dynamics understanding and complex reasoning. However, current Video Question Answering (VideoQA) datasets suffer from two…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Yuhang Hu , Zhenyu Yang , Shihan Wang , Shengsheng Qian , Bin Wen , Fan Yang , Tingting Gao , Changsheng Xu

The unprecedented surge in video data production in recent years necessitates efficient tools to extract meaningful frames from videos for downstream tasks. Long-term temporal reasoning is a key desideratum for frame retrieval systems.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Minkyu Choi , Harsh Goel , Mohammad Omama , Yunhao Yang , Sahil Shah , Sandeep Chinchali

Visual reasoning over structured data such as tables is a critical capability for modern vision-language models (VLMs), yet current benchmarks remain limited in scale, diversity, or reasoning depth, especially when it comes to rendered…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Boammani Aser Lompo , Marc Haraoui

Visual events are a composition of temporal actions involving actors spatially interacting with objects. When developing computer vision models that can reason about compositional spatio-temporal events, we need benchmarks that can analyze…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Madeleine Grunde-McLaughlin , Ranjay Krishna , Maneesh Agrawala

Videos, with their unique temporal dimension, demand precise grounded understanding, where answers are directly linked to visual, interpretable evidence. Despite significant breakthroughs in text-based reasoning with large language models,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ye Liu , Kevin Qinghong Lin , Chang Wen Chen , Mike Zheng Shou

Understanding real-world videos such as movies requires integrating visual and dialogue cues. Yet existing VideoQA benchmarks struggle to capture this multimodal reasoning and, given the difficulty of evaluating free-form answers, largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Shaden Shaar , Bradon Thymes , Sirawut Chaixanien , Claire Cardie , Bharath Hariharan

Video question answering (VQA) is a multimodal task that requires the interpretation of a video to answer a given question. Existing VQA methods primarily utilize question and answer (Q&A) pairs to learn the spatio-temporal characteristics…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Ju-Young Oh , Ho-Joong Kim , Seong-Whan Lee

This paper introduces UnSeenTimeQA, a novel data contamination-free time-sensitive question-answering (TSQA) benchmark. It differs from existing TSQA benchmarks by avoiding web-searchable queries grounded in the real world. We present a…

Computation and Language · Computer Science 2025-06-04 Md Nayem Uddin , Amir Saeidi , Divij Handa , Agastya Seth , Tran Cao Son , Eduardo Blanco , Steven R. Corman , Chitta Baral

Despite remarkable recent progress, existing long-form VideoQA datasets fall short of meeting the criteria for genuine long-form video understanding. This is primarily due to the use of short videos for question curation, and the reliance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hongjie Zhang , Lu Dong , Yi Liu , Yifei Huang , Yali Wang , Limin Wang , Yu Qiao

Recent advancements in Large Video Language Models (LVLMs) have highlighted their potential for multi-modal understanding, yet evaluating their factual grounding in videos remains a critical unsolved challenge. To address this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Meng Cao , Pengfei Hu , Yingyao Wang , Jihao Gu , Haoran Tang , Haoze Zhao , Chen Wang , Jiahua Dong , Wangbo Yu , Ge Zhang , Jun Song , Xiang Li , Bo Zheng , Ian Reid , Xiaodan Liang

Understanding images and text together is an important aspect of cognition and building advanced Artificial Intelligence (AI) systems. As a community, we have achieved good benchmarks over language and vision domains separately, however…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Shailaja Keyur Sampat , Yezhou Yang , Chitta Baral

Fine-grained spatio-temporal understanding is essential for video reasoning and embodied AI. Yet, while Multimodal Large Language Models (MLLMs) master static semantics, their grasp of temporal dynamics remains brittle. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Baiqi Li , Kangyi Zhao , Ce Zhang , Chancharik Mitra , Jean de Dieu Nyandwi , Gedas Bertasius

Videos convey rich information. Dynamic spatio-temporal relationships between people/objects, and diverse multimodal events are present in a video clip. Hence, it is important to develop automated models that can accurately extract such…

Computation and Language · Computer Science 2020-05-14 Hyounghun Kim , Zineng Tang , Mohit Bansal