English
Related papers

Related papers: STEER: Structured Event Evidence for Video Reasoni…

200 papers

Elucidating the reasoning process with structured explanations from question to answer is crucial, as it significantly enhances the interpretability, traceability, and trustworthiness of question-answering (QA) systems. However, structured…

Computation and Language · Computer Science 2024-09-30 Guoxin Chen , Kexin Tang , Chao Yang , Fuying Ye , Yu Qiao , Yiming Qian

Long-form video reasoning remains a major challenge for Video Large Language Models (Video LLMs), as static uniform frame sampling leads to information dilution and obscures critical evidence. Furthermore, existing pixel-space video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xuchen Li , Xuzhao Li , Shiyu Hu , Kaiqi Huang

Human processes video reasoning in a sequential spatio-temporal reasoning logic, we first identify the relevant frames ("when") and then analyse the spatial relationships ("where") between key objects, and finally leverage these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Zixu Cheng , Jian Hu , Ziquan Liu , Chenyang Si , Wei Li , Shaogang Gong

We introduce STRIVE (SpatioTemporal Reinforcement with Importance-aware Variant Exploration), a structured reinforcement learning framework for video question answering. While group-based policy optimization methods have shown promise in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Emad Bahrami , Olga Zatsarynna , Parth Pathak , Sunando Sengupta , Juergen Gall , Mohsen Fayyaz

Current approaches to memory in Large Language Models (LLMs) predominantly rely on static Retrieval-Augmented Generation (RAG), which often results in scattered retrieval and fails to capture the structural dependencies required for complex…

Computation and Language · Computer Science 2026-02-11 Zhengxuan Lu , Dongfang Li , Yukun Shi , Beilun Wang , Longyue Wang , Baotian Hu

Multimodal emotion analysis is shifting from static classification to generative reasoning. Beyond simple label prediction, robust affective reasoning must synthesize fine-grained signals such as facial micro-expressions and prosodic which…

Multimedia · Computer Science 2026-02-05 Zhixian Zhao , Wenjie Tian , Lei Xie

Recently we have witnessed the rapid development of video question answering models. However, most models can only handle simple videos in terms of temporal reasoning, and their performance tends to drop when answering temporal-reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Yueqian Wang , Yuxuan Wang , Kai Chen , Dongyan Zhao

The reasoning abilities of large language models (LLMs) have improved with chain-of-thought (CoT) prompting, allowing models to solve complex tasks stepwise. However, training CoT capabilities requires detailed reasoning data, which is…

Artificial Intelligence · Computer Science 2025-04-11 Fu-Chieh Chang , Yu-Ting Lee , Hui-Ying Shih , Yi Hsuan Tseng , Pei-Yuan Wu

Video reasoning has advanced with large multimodal models (LMMs), yet their inference is often a single pass that returns an answer without verifying whether the reasoning is evidence-aligned. We introduce Reinforce to Learn, Elect to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Songyuan Yang , Weijiang Yu , Jilin Ma , Ziyu Liu , Guijian Tang , Wenjing Yang , Huibin Tan , Nong Xiao

Video Large Language Models (Video-LLMs) have recently shown strong performance in basic video understanding tasks, such as captioning and coarse-grained question answering, but struggle with compositional reasoning that requires multi-step…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haiyi Qiu , Minghe Gao , Long Qian , Kaihang Pan , Qifan Yu , Juncheng Li , Wenjie Wang , Siliang Tang , Yueting Zhuang , Tat-Seng Chua

Table reasoning with large language models (LLMs) plays a critical role in building intelligent systems capable of understanding and analyzing tabular data. Despite recent progress, existing methods still face key limitations: their…

Artificial Intelligence · Computer Science 2026-01-27 Huajian Zhang , Mingyue Cheng , Yucong Luo , Xiaoyu Tao

Vision-Language Models (VLMs) have achieved strong performance on general multimodal reasoning, yet remain challenged in integrating nonlocal visual information to support semantically underdetermined visual reasoning. We describe this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tengda Guo , Jie Leng , Hanlei Li , Yaoyuan Liang , Qingyue Zhang , Dian Yang , Mingyu Zhang , Yuhua Fu , Shao-Lun Huang

Emotional support conversations require more than fluent responses. Supporters need to understand the seeker's situation and emotions, adopt an appropriate strategy, and respond in a natural, human-like manner. Despite advances in large…

Computation and Language · Computer Science 2026-04-10 Yunxiao Wang , Meng Liu , Kaiyu Jiang , Bin Wen , Fan Yang , Tingting Gao , Lizi Liao

Multi-video event understanding demands models that can locate and attribute query-relevant evidence scattered across long, heterogeneous video corpora. Existing large vision-language models (LVLMs) often underperform in this regime because…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Pengyu Yan , Akhil Gorugantu , Mahesh Bhosale , Abdul Wasi , Vishvesh Trivedi , David Doermann

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Lu Qiu , Ying Shan , Xihui Liu

We investigate complex video question answering via chain-of-evidence reasoning -- identifying sequences of temporal spans from multiple relevant parts of the video, together with visual evidence within them. Existing models struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yujie Lu , Yale Song , William Wang , Lorenzo Torresani , Tushar Nagarajan

Event stream based scene text recognition is a newly arising research topic in recent years which performs better than the widely used RGB cameras in extremely challenging scenarios, especially the low illumination, fast motion. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Xiao Wang , Jingtao Jiang , Qiang Chen , Lan Chen , Lin Zhu , Yaowei Wang , Yonghong Tian , Jin Tang

Video reasoning, the task of enabling machines to infer from dynamic visual content through multi-step logic, is crucial for advanced AI. While the Chain-of-Thought (CoT) mechanism has enhanced reasoning in text-based tasks, its application…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Mi Luo , Zihui Xue , Alex Dimakis , Kristen Grauman

Video Large Language Models (Video-LLMs) have shown strong video understanding, yet their application to long-form videos remains constrained by limited context windows. A common workaround is to compress long videos into a handful of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yun Wang , Long Zhang , Jingren Liu , Jiaqi Yan , Zhanjie Zhang , Jiahao Zheng , Ao Ma , Run Ling , Xun Yang , Dapeng Wu , Xiangyu Chen , Xuelong Li

Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mingfang Zhang , Jingjing Pan , Ashutosh Kumar , Rajat Saini , Mustafa Erdogan , Hsuan-Kung Yang , Caixin Kang , Yifei Huang , Yoichi Sato , Quan Kong
‹ Prev 1 2 3 10 Next ›