English
Related papers

Related papers: Process-of-Thought Reasoning for Videos

200 papers

Video reasoning, which requires multi-step deduction across frames, remains a major challenge for multimodal large language models (MLLMs). While reinforcement learning (RL)-based methods enhance reasoning capabilities, they often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kun Ouyang , Yuanxin Liu , Linli Yao , Yishuo Cai , Hao Zhou , Jie Zhou , Fandong Meng , Xu Sun

Chain-of-Thought (CoT) has become a vital technique for enhancing the performance of Large Language Models (LLMs), attracting increasing attention from researchers. One stream of approaches focuses on the iterative enhancement of LLMs by…

Computation and Language · Computer Science 2024-10-08 Yongheng Zhang , Qiguang Chen , Jingxuan Zhou , Peng Wang , Jiasheng Si , Jin Wang , Wenpeng Lu , Libo Qin

Large Language Models have demonstrated remarkable abilities across various tasks, with Chain-of-Thought (CoT) prompting emerging as a key technique to enhance reasoning capabilities. However, existing research primarily focuses on…

Artificial Intelligence · Computer Science 2024-10-07 Lijie Hu , Liang Liu , Shu Yang , Xin Chen , Zhen Tan , Muhammad Asif Ali , Mengdi Li , Di Wang

Large Language Models (LLMs) significantly benefit from Chain-of-Thought (CoT) prompting in performing various reasoning tasks. While CoT allows models to produce more comprehensive reasoning processes, its emphasis on intermediate…

Computation and Language · Computer Science 2023-10-05 Zhan Ling , Yunhao Fang , Xuanlin Li , Zhiao Huang , Mingu Lee , Roland Memisevic , Hao Su

Chain-of-thought (CoT) reasoning has emerged as an effective approach for activating latent capabilities in LLMs. Interestingly, we observe that both CoT reasoning and self-training share the core objective: iteratively leveraging…

Computation and Language · Computer Science 2025-05-27 Zongqian Wu , Baoduo Xu , Ruochen Cui , Mengmeng Zhan , Xiaofeng Zhu , Lei Feng

Despite exciting recent results showing vision-language systems' capacity to reason about images using natural language, their capacity for video reasoning remains under-explored. We motivate framing video reasoning as the sequential…

Computation and Language · Computer Science 2023-11-10 Vaishnavi Himakunthala , Andy Ouyang , Daniel Rose , Ryan He , Alex Mei , Yujie Lu , Chinmay Sonar , Michael Saxon , William Yang Wang

Chain-of-thought (CoT) traces are increasingly used both to improve language model capability and to audit model behavior, implicitly assuming that the visible trace remains synchronized with the computation that determines the answer. We…

Artificial Intelligence · Computer Science 2026-05-13 Wenkai Li , Fan Yang , Ananya Hazarika , Shaunak A. Mehta , Koichi Onoue

Recent video generation models can produce smooth and visually appealing clips, but they often struggle to synthesize complex dynamics with a coherent chain of consequences. Accurately modeling visual outcomes and state transitions over…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Ziqi Huang , Ning Yu , Gordon Chen , Haonan Qiu , Paul Debevec , Ziwei Liu

Video Reasoning Segmentation (VRS) aims to segment target objects in videos based on implicit instructions that convey human intent and temporal logic. Existing MLLM-based methods predict masks with a [SEG] token after selecting frames via…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Junwei Wen , Deshui Miao , Guangming Lu , Xin Li , Wenjie Pei

Understanding videos is an important research topic for multimodal learning. Leveraging large-scale datasets of web-crawled video-text pairs as weak supervision has become a pre-training paradigm for learning joint representations and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Gengyuan Zhang , Jinhe Bi , Jindong Gu , Yanyu Chen , Volker Tresp

Long video understanding is challenging due to rich and complicated multimodal clues in long temporal range.Current methods adopt reasoning to improve the model's ability to analyze complex video clues in long videos via text-form…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Houlun Chen , Xin Wang , Guangyao Li , Yuwei Zhou , Yihan Chen , Jia Jia , Wenwu Zhu

Chain-of-Thought (CoT) reasoning, which breaks down complex tasks into intermediate reasoning steps, has significantly enhanced the performance of large language models (LLMs) on challenging tasks. However, the detailed reasoning process in…

Computation and Language · Computer Science 2025-02-20 Yingqian Cui , Pengfei He , Jingying Zeng , Hui Liu , Xianfeng Tang , Zhenwei Dai , Yan Han , Chen Luo , Jing Huang , Zhen Li , Suhang Wang , Yue Xing , Jiliang Tang , Qi He

Automated video surveillance with Large Vision-Language Models is limited by their inherent bias towards normality, often failing to detect crimes. While Chain-of-Thought reasoning strategies show significant potential for improving…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Pedro Domingos , João Pereira , Vasco Lopes , João Neves , David Semedo

We study how different Chain-of-Thought (CoT) designs affect the acquisition of the generalizable visual reasoning ability in vision-language models (VLMs). While CoT data, especially long or visual CoT such as "think with image", has been…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yifan Du , Kun Zhou , Yingqian Min , Yue Ling , Wayne Xin Zhao , Youbin Wu

Chain-of-thought (CoT) reasoning has advanced medical visual question answering (VQA), yet most existing CoT rationales are free-form and fail to capture the structured reasoning process clinicians actually follow. This work asks: Can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lin Fan , Yafei Ou , Zhipeng Deng , Pengyu Dai , Hou Chongxian , Jiale Yan , Yaqian Li , Kaiwen Long , Xun Gong , Masayuki Ikebe , Yefeng Zheng

Chain-of-Thought (CoT) is a critical technique in enhancing the reasoning ability of Large Language Models (LLMs), and latent reasoning methods have been proposed to accelerate the inefficient token-level reasoning chain. We notice that…

Computation and Language · Computer Science 2026-02-05 Fangwei Zhu , Zhifang Sui

Recent video reasoning models increasingly produce spatio-temporal evidence chains that localize objects at specific timestamps. While these traces improve interpretability by grounding \emph{where} and \emph{when} evidence appears, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Bishoy Galoaa , Shayda Moezzi , Xiangyu Bai , Sarah Ostadabbas

By extending the advantage of chain-of-thought (CoT) reasoning in human-like step-by-step processes to multimodal contexts, multimodal CoT (MCoT) reasoning has recently garnered significant research attention, especially in the integration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yaoting Wang , Shengqiong Wu , Yuecheng Zhang , Shuicheng Yan , Ziwei Liu , Jiebo Luo , Hao Fei

Recent studies have shown that long chain-of-thought (CoT) reasoning can significantly enhance the performance of large language models (LLMs) on complex tasks. However, this benefit is yet to be demonstrated in the domain of video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yuanxin Liu , Kun Ouyang , Haoning Wu , Yi Liu , Lin Sui , Xinhao Li , Yan Zhong , Y. Charles , Xinyu Zhou , Xu Sun

Recently, there has been significant progress in teaching language models to perform step-by-step reasoning to solve complex numerical reasoning tasks. Chain-of-thoughts prompting (CoT) is by far the state-of-art method for these tasks. CoT…

Computation and Language · Computer Science 2023-10-24 Wenhu Chen , Xueguang Ma , Xinyi Wang , William W. Cohen