English
Related papers

Related papers: STEER: Structured Event Evidence for Video Reasoni…

200 papers

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

Video reasoning segmentation requires localizing objects across video frames from natural language expressions, often involving spatial reasoning and implicit references. Recent approaches leverage frozen large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ali Cheraghian , Hamidreza Dastmalchi , Abdelwahed Khamis , Morteza Saberi , Aijun An , Lars Petersson

Ensuring the safety and harmlessness of Large Language Models (LLMs) has become equally critical as their performance in applications. However, existing safety alignment methods typically suffer from safety-performance trade-offs and the…

Computation and Language · Computer Science 2025-06-30 Yichi Zhang , Siyuan Zhang , Yao Huang , Zeyu Xia , Zhengwei Fang , Xiao Yang , Ranjie Duan , Dong Yan , Yinpeng Dong , Jun Zhu

The task of Video Question Answering (VideoQA) consists in answering natural language questions about a video and serves as a proxy to evaluate the performance of a model in scene sequence understanding. Most methods designed for VideoQA…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Theophile Sautory , Nuri Cingillioglu , Alessandra Russo

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni

Existing Vision-Language Models often struggle with complex, multi-question reasoning tasks where partial correctness is crucial for effective learning. Traditional reward mechanisms, which provide a single binary score for an entire…

Large language models (LLMs) achieve strong performance by generating long chains of thought, but longer traces always introduce redundant or ineffective reasoning steps. One typical behavior is that they often perform unnecessary…

Computation and Language · Computer Science 2026-01-13 Jinyi Han , Zixiang Di , Zishang Jiang , Ying Liao , Jiaqing Liang , Yongqi Wang , Yanghua Xiao

Physical video understanding requires more than naming an event correctly. A model can answer a question about pouring, sliding, or collision from textual regularities while still failing to localize the event in time or space. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Alibay Osmanli , Zixu Cheng , Shaogang Gong

Large Language Models (LLMs) trained for average correctness often exhibit mode collapse, producing narrow decision behaviors on tasks where multiple responses may be reasonable. This limitation is particularly problematic in ordinal…

Artificial Intelligence · Computer Science 2026-02-04 Eric Yang , Jong Ha Lee , Jonathan Amar , Elissa Ye , Yugang Jia

Spiking Neural Networks (SNNs) are inherently suited for continuous learning due to their event-driven temporal dynamics; however, their application to Class-Incremental Learning (CIL) has been hindered by catastrophic forgetting and the…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Matteo Gianferrari , Omayma Moussadek , Riccardo Salami , Cosimo Fiorini , Lorenzo Tartarini , Daniela Gandolfi , Simone Calderara

Vision-Language Models (VLMs) have achieved remarkable progress in integrating visual perception with language understanding. However, effective multimodal reasoning requires both accurate perception and robust reasoning, and weakness in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Sourabh Sharma , Sonam Gupta , Sadbhawna

The internalization of chain-of-thought processes into hidden states has emerged as a highly efficient paradigm for scaling test-time compute. However, existing activation steering methods rely on static control vectors that fail to adapt…

Machine Learning · Computer Science 2026-02-06 Zhenning Shi , Yijia Zhu , Junhan Shi , Xun Zhang , Lei Wang , Congcong Miao

Reasoning in interactive problem solving scenarios requires models to construct reasoning threads that reflect user understanding and align with structured domain knowledge. However, current reasoning models often lack explicit semantic…

Artificial Intelligence · Computer Science 2025-08-19 Daniel Burkhardt , Xiangwei Cheng

Reasoning about real-life events is a unifying challenge in AI and NLP that has profound utility in a variety of domains, while fallacy in high-stake applications could be catastrophic. Able to work with diverse text in these domains, large…

Computation and Language · Computer Science 2024-08-30 Li Zhang

When humans observe a physical system, they can easily locate objects, understand their interactions, and anticipate future behavior, even in settings with complicated and previously unseen interactions. For computers, however, learning…

Machine Learning · Computer Science 2020-02-13 Jannik Kossen , Karl Stelzner , Marcel Hussing , Claas Voelcker , Kristian Kersting

As AI systems are being integrated more rapidly into diverse and complex real-world environments, the ability to perform holistic reasoning over an implicit query and an image to localize a target is becoming increasingly important.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Seokju Yun , Dongheon Lee , Noori Bae , Jaesung Jun , Chanseul Cho , Youngmin Ro

Next-generation AI companions must go beyond general video understanding to resolve spatial and temporal references in dynamic, real-world environments. Existing Video Large Language Models (Video LLMs), while capable of coarse-level…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Honglu Zhou , Xiangyu Peng , Shrikant Kendre , Michael S. Ryoo , Silvio Savarese , Caiming Xiong , Juan Carlos Niebles

Most existing visual reasoning tasks, such as CLEVR in VQA, ignore an important factor, i.e.~transformation. They are solely defined to test how well machines understand concepts and relations within static settings, like one image. Such…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Xin Hong , Yanyan Lan , Liang Pang , Jiafeng Guo , Xueqi Cheng

Joint video-language learning has received increasing attention in recent years. However, existing works mainly focus on single or multiple trimmed video clips (events), which makes human-annotated event boundaries necessary during…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Teng Wang , Jinrui Zhang , Feng Zheng , Wenhao Jiang , Ran Cheng , Ping Luo

Many video reasoning tasks require tracking motion, temporal order, and evolving visual states across frames. Existing methods built on large vision-language models (LVLMs) often address this challenge by externalizing reasoning through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yiming Liang , Yixiao Chen , Yiyang Zhou , Yixuan Wang , Shoubin Yu , Andong Deng , Fuxiao Liu , Qin Zhang , Chen Chen , Mohit Bansal , Huaxiu Yao