English
Related papers

Related papers: VideoAuto-R1: Video Auto Reasoning via Thinking On…

200 papers

While Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), relying solely on linear text sequences remains a bottleneck for complex tasks. We observe that even…

Computation and Language · Computer Science 2026-02-12 Lingzhuang Sun , Yuxia Zhu , Ruitong Liu , Hao Liang , Zheng Sun , Caijun Jia , Honghao He , Yuchen Wu , Siyuan Li , Jingxuan Wei , Xiangxiang Zhang , Bihui Yu , Wentao Zhang

Long video understanding is challenging due to rich and complicated multimodal clues in long temporal range.Current methods adopt reasoning to improve the model's ability to analyze complex video clues in long videos via text-form…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Houlun Chen , Xin Wang , Guangyao Li , Yuwei Zhou , Yihan Chen , Jia Jia , Wenwu Zhu

Large language models have manifested remarkable capabilities by leveraging chain-of-thought (CoT) reasoning techniques to solve intricate questions through step-by-step reasoning chains. Despite its success, the efficacy of such reasoning…

Computation and Language · Computer Science 2024-03-29 Yexin Wu , Zhuosheng Zhang , Hai Zhao

Long chains of thought (CoT) from current language models frequently contain logical gaps and unjustified leaps, limiting the gains from additional test-time compute. Improving reasoning quality directly would require process reward models,…

Artificial Intelligence · Computer Science 2026-05-26 Jingchu Gai , Guanning Zeng , Christina Baek , Chen Wu , J. Zico Kolter , Andrej Risteski , Aditi Raghunathan

Modern systems for multi-hop question answering (QA) typically break questions into a sequence of reasoning steps, termed chain-of-thought (CoT), before arriving at a final answer. Often, multiple chains are sampled and aggregated through a…

Computation and Language · Computer Science 2024-08-05 Ori Yoran , Tomer Wolfson , Ben Bogin , Uri Katz , Daniel Deutch , Jonathan Berant

Recent advances in video understanding have been driven by MLLMs. But these MLLMs are good at analyzing short videos, while suffering from difficulties in understanding videos with a longer context. To address this difficulty, several agent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zikang Wang , Boyu Chen , Zhengrong Yue , Yi Wang , Yu Qiao , Limin Wang , Yali Wang

Despite recent breakthroughs in reasoning-enhanced large language models (LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine translation (MT), where human translators naturally employ structured, multi-layered…

Computation and Language · Computer Science 2025-05-27 Minggui He , Yilun Liu , Shimin Tao , Yuanchang Luo , Hongyong Zeng , Chang Su , Li Zhang , Hongxia Ma , Daimeng Wei , Weibin Meng , Hao Yang , Boxing Chen , Osamu Yoshie

Chain-of-Thought (CoT) reasoning successfully enhances the reasoning capabilities of Large Language Models (LLMs), yet it incurs substantial computational overhead for inference. Existing CoT compression methods often suffer from a critical…

Machine Learning · Computer Science 2026-05-26 Yuntian Tang , Bohan Jia , Wenxuan Huang , Lianyue Zhang , Jiao Xie , Wenxi Li , Wei Li , Jie Hu , Xinghao Chen Rongrong Ji , Shaohui Lin

Large language models (LLMs) perform better when they produce step-by-step, "Chain-of-Thought" (CoT) reasoning before answering a question, but it is unclear if the stated reasoning is a faithful explanation of the model's actual reasoning…

Recent advances in large Vision-Language Models (VLMs) have exhibited strong reasoning capabilities on complex visual tasks by thinking with images in their Chain-of-Thought (CoT), which is achieved by actively invoking tools to analyze…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuanyu Wan , Lijun Zhang

While Chain-of-Thought (CoT) significantly enhances the performance of Large Language Models (LLMs), explicit reasoning chains introduce substantial computational redundancy. Recent latent reasoning methods attempt to mitigate this by…

Computation and Language · Computer Science 2026-02-02 Fanmeng Wang , Haotian Liu , Guojiang Zhao , Hongteng Xu , Zhifeng Gao

Reinforcement Learning Finetuning (RFT) has significantly advanced the reasoning capabilities of large language models (LLMs) by enabling long chains of thought, self-correction, and effective tool use. While recent works attempt to extend…

Machine Learning · Computer Science 2026-03-06 Mingyuan Wu , Jingcheng Yang , Jize Jiang , Meitang Li , Kaizhuo Yan , Hanchao Yu , Minjia Zhang , Chengxiang Zhai , Klara Nahrstedt

Chain-of-thought (CoT) reasoning and reasoning-tuned models such as DeepSeek-R1 are commonly assumed to reduce shallow heuristic biases by thinking carefully. We test this on position bias in multiple-choice QA and find a different story:…

Artificial Intelligence · Computer Science 2026-05-11 Xiao Wang

Chain-of-thought prompting (CoT) has the potential to improve the explainability of language model reasoning. But CoT can also systematically misrepresent the factors influencing models' behavior -- for example, rationalizing answers in…

Computation and Language · Computer Science 2025-06-30 James Chua , Edward Rees , Hunar Batra , Samuel R. Bowman , Julian Michael , Ethan Perez , Miles Turpin

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Chain-of-thought (CoT) supervision can substantially improve transformer performance, yet the mechanisms by which models learn to follow and benefit from CoT remain poorly understood. We investigate these learning dynamics through the lens…

Machine Learning · Computer Science 2025-10-31 Zihan Pengmei , Costas Mavromatis , Zhengyuan Shen , Yunyi Zhang , Vassilis N. Ioannidis , Huzefa Rangwala

Video reasoning using Large Multimodal Models (LMMs) relies on costly reinforcement learning (RL) and verbose chain-of-thought, resulting in substantial computational overhead during both training and inference. Moreover, the mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Deepak Sridhar , Kartikeya Bhardwaj , Jeya Pradha Jeyaraj , Nuno Vasconcelos , Ankita Nayak , Harris Teague

Chain-of-Thought (CoT) prompting has proven to be effective in enhancing the reasoning capabilities of Large Language Models (LLMs) with at least 100 billion parameters. However, it is ineffective or even detrimental when applied to…

Computation and Language · Computer Science 2023-10-24 Chengcheng Han , Xiaowei Du , Che Zhang , Yixin Lian , Xiang Li , Ming Gao , Baoyuan Wang

Vision-language models (VLMs) have recently demonstrated strong efficacy as visual assistants that can parse natural queries about the visual content and generate human-like outputs. In this work, we explore the ability of these models to…

Computation and Language · Computer Science 2024-03-21 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Multi-modal Large Language Models (MLLMs) show promise in video understanding. However, their reasoning often suffers from thinking drift and weak temporal comprehension, even when enhanced by Reinforcement Learning (RL) techniques like…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Peiyao Wang , Haotian Xu , Noranart Vesdapunt , Rui Hou , Jingyi Zhang , Haibin Ling , Oleksandr Obiednikov , Ning Zhou , Kah Kuen Fu