English
Related papers

Related papers: Video Reasoning without Training

200 papers

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Automating Register Transfer Level (RTL) code generation using Large Language Models (LLMs) offers substantial promise for streamlining digital circuit design and reducing human effort. However, current LLM-based approaches face significant…

Artificial Intelligence · Computer Science 2025-05-20 Yiting Wang , Guoheng Sun , Wanghao Ye , Gang Qu , Ang Li

Multimodal Large Language Models (MLLMs) perform well in single-image visual grounding but struggle with real-world tasks that demand cross-image reasoning and multi-modal instructions. To address this, we adopt a reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bob Zhang , Haoran Li , Tao Zhang , Jianan Li , Cilin Yan , Xikai Liu , Jiayin Cai , Yanbin Hao

Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generation rather than verifiable reasoning. This limitation is especially pronounced in tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Tinghui Zhu , Sheng Zhang , James Y. Huang , Selena Song , Xiaofei Wen , Yuankai Li , Hoifung Poon , Muhao Chen

Reinforcement learning has advanced video reasoning in large multi-modal models, yet dominant pipelines either rely on on-policy self-exploration, which plateaus at the model's knowledge boundary, or hybrid replay that mixes policies and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Haojian Huang , Chuanyu Qin , Yinchuan Li , Yingcong Chen

Large Language Models (LLMs) have shown impressive performance in reasoning tasks. However, LLMs tend to generate excessively long reasoning content, leading to significant computational overhead. Our observations indicate that even on…

Computation and Language · Computer Science 2025-05-21 Guochao Jiang , Guofeng Quan , Zepeng Ding , Ziqin Luo , Dixuan Wang , Zheng Hu

Large reasoning models (LRMs) "think" by generating structured chain-of-thought (CoT) before producing a final answer, yet they still lack the ability to reason critically about safety alignment and are easily biased when a flawed premise…

Video Question Answering (VideoQA) demands models that jointly reason over spatial, temporal, and linguistic cues. However, the task's inherent complexity often requires multi-step reasoning that current large multimodal models (LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jason Nguyen , Ameet Rao , Alexander Chang , Ishaan Kumar , Erin Tan

Multimodal Large Language Models (MLLMs) hold great promise for advanced reasoning at the intersection of text and images, yet they have not fully realized this potential. MLLMs typically integrate an LLM, a vision encoder, and a connector…

Machine Learning · Computer Science 2025-11-07 Nikita Rajaneesh , Thomas Zollo , Richard Zemel

Large reasoning models (LRMs) achieve strong accuracy through test-time scaling, generating longer chains of thought or sampling multiple solutions, but at steep costs in tokens and latency. We argue that memory is a core ingredient for…

Multiagent Systems · Computer Science 2026-03-04 Daivik Patel , Shrenik Patel

Recent advances in image reasoning methods, particularly "Thinking with Images", have demonstrated remarkable success in Multimodal Large Language Models (MLLMs); however, this dynamic reasoning paradigm has not yet been extended to video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shijian Wang , Jiarui Jin , Xingjian Wang , Linxin Song , Runhao Fu , Hecheng Wang , Zongyuan Ge , Yuan Lu , Xuelian Cheng

Understanding text-rich videos requires reading small, transient textual cues that often demand repeated inspection. Yet most video QA models rely on single-pass perception over fixed frames, leading to hallucinations and failures on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yolo Y. Tang , Daiki Shimada , Hang Hua , Chao Huang , Jing Bi , Rogerio Feris , Chenliang Xu

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Large Language Models (LLMs) rely on generating extensive intermediate reasoning units (e.g., tokens, sentences) to enhance final answer quality across a wide range of complex tasks. While this approach has proven effective, it inevitably…

Computation and Language · Computer Science 2025-06-05 Joonwon Jang , Jaehee Kim , Wonbin Kweon , Seonghyeon Lee , Hwanjo Yu

Current large vision-language models (LVLMs) typically employ a connector module to link visual features with text embeddings of large language models (LLMs) and use end-to-end training to achieve multi-modal understanding in a unified…

Artificial Intelligence · Computer Science 2025-08-14 Zixian Guo , Ming Liu , Qilong Wang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

Test-time thinking (that is, generating explicit intermediate reasoning chains) is known to boost performance in large language models and has recently shown strong gains for large vision language models (LVLMs). However, despite these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jing Bi , Filippos Bellos , Junjia Guo , Yayuan Li , Chao Huang , Yolo Y. Tang , Luchuan Song , Susan Liang , Zhongfei Mark Zhang , Jason J. Corso , Chenliang Xu

Vision Language Models (VLMs) have demonstrated strong capabilities across various visual understanding and reasoning tasks, driven by incorporating image representations into the token inputs of Large Language Models (LLMs). However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kevin Y. Li , Sachin Goyal , Joao D. Semedo , J. Zico Kolter

Recent advances have established a new machine learning paradigm based on scaling up compute at inference time as well as at training time. In that line of work, a combination of Supervised Fine-Tuning (SFT) on synthetic demonstrations and…

Machine Learning · Computer Science 2025-07-08 Corrado Rainone , Tim Bakker , Roland Memisevic

Improving Multi-modal Large Language Models (MLLMs) in the post-training stage typically relies on supervised fine-tuning (SFT) or reinforcement learning (RL), which require expensive and manually annotated multi-modal data--an ultimately…

Computation and Language · Computer Science 2025-10-28 Lai Wei , Yuting Li , Chen Wang , Yue Wang , Linghe Kong , Weiran Huang , Lichao Sun

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni