English
Related papers

Related papers: Process-of-Thought Reasoning for Videos

200 papers

Mathematical reasoning in real-world video settings presents a fundamentally different challenge than in static images or text. It requires interpreting fine-grained visual information, accurately reading handwritten or digital text, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Hanoona Rasheed , Abdelrahman Shaker , Anqi Tang , Muhammad Maaz , Ming-Hsuan Yang , Salman Khan , Fahad Shahbaz Khan

When presented with questions involving visual thinking, humans naturally switch reasoning modalities, often forming mental images or drawing visual aids. Large language models have shown promising results in arithmetic and symbolic…

Computation and Language · Computer Science 2024-06-21 Sachit Menon , Richard Zemel , Carl Vondrick

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Multimodal latent reasoning has emerged as a promising paradigm that replaces explicit Chain-of-Thought (CoT) decoding with implicit feature propagation, simultaneously enhancing representation informativeness and reducing inference…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yudong Han , Yong Wang , Zaiquan Yang , Zhen Qu , Liyuan Pan , Xiangxiang Chu

Recent breakthroughs in video generation have demonstrated an emerging capability termed Chain-of-Frames (CoF) reasoning, where models resolve complex tasks through the generation of continuous frames. While these models show promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yifan Li , Yukai Gu , Yingqian Min , Zikang Liu , Yifan Du , Kun Zhou , Min Yang , Wayne Xin Zhao , Minghui Qiu

Chain-of-Thought (CoT) prompting has significantly enhanced the mathematical reasoning capabilities of Large Language Models. We find existing fine-tuning datasets frequently suffer from the "answer right but reasoning wrong" probelm, where…

Artificial Intelligence · Computer Science 2026-01-13 Zihang Li , Yuhang Wang , Yikun Zong , Wenhan Yu , Xiaokun Yuan , Runhan Jiang , Zirui Liu , Tong Yang , Arthur Jiang

Chain-of-thought (CoT) reasoning is critical for improving the interpretability and reliability of Large Vision-Language Models (LVLMs). However, existing training algorithms such as SFT, PPO, and GRPO may not generalize well across unseen…

Artificial Intelligence · Computer Science 2025-10-31 Guohao Sun , Hang Hua , Jian Wang , Jiebo Luo , Sohail Dianat , Majid Rabbani , Raghuveer Rao , Zhiqiang Tao

Large language models (LLMs) can perform complex reasoning by generating intermediate reasoning steps. Providing these steps for prompting demonstrations is called chain-of-thought (CoT) prompting. CoT prompting has two major paradigms. One…

Computation and Language · Computer Science 2022-10-10 Zhuosheng Zhang , Aston Zhang , Mu Li , Alex Smola

Chain-of-Thought (CoT) reasoning enhances Large Language Models (LLMs) by encouraging step-by-step reasoning in natural language. However, leveraging a latent continuous space for reasoning may offer benefits in terms of both efficiency and…

Computation and Language · Computer Science 2025-09-24 Zhenyi Shen , Hanqi Yan , Linhai Zhang , Zhanghao Hu , Yali Du , Yulan He

Human-like chatbots necessitate the use of commonsense reasoning in order to effectively comprehend and respond to implicit information present within conversations. Achieving such coherence and informativeness in responses, however, is a…

Computation and Language · Computer Science 2023-10-24 Hyungjoo Chae , Yongho Song , Kai Tzu-iunn Ong , Taeyoon Kwon , Minjin Kim , Youngjae Yu , Dongha Lee , Dongyeop Kang , Jinyoung Yeo

Program-of-Thought (PoT), which aims to use programming language instead of natural language as an intermediate step in reasoning, is an important way for LLMs to solve mathematical problems. Since different programming languages excel in…

Computation and Language · Computer Science 2024-12-18 Nianqi Li , Zujie Liang , Siyu Yuan , Jiaqing Liang , Feng Wei , Yanghua Xiao

Multi-modal reasoning requires the seamless integration of visual and linguistic cues, yet existing Chain-of-Thought methods suffer from two critical limitations in cross-modal scenarios: (1) over-reliance on single coarse-grained image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wenting Lu , Didi Zhu , Tao Shen , Donglin Zhu , Ayong Ye , Chao Wu

Reasoning Video Object Segmentation is a challenging task, aiming at generating a mask sequence from an input video given a complex and implicit text query. While existing works finetune Multimodal Large Language Models (MLLM) for the task,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiu-hong Kao , Yu-Wing Tai , Chi-Keung Tang

Current Large Language Models (LLMs), especially Large Reasoning Models, can generate Chain-of-Thought (CoT) reasoning traces to illustrate how they produce final outputs, thereby facilitating trust calibration for users. However, these CoT…

Human-Computer Interaction · Computer Science 2026-04-07 Shiwei Chen , Niruthikka Sritharan , Xiaolin Wen , Chenxi Zhang , Xingbo Wang , Yong Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks but their performance in complex logical reasoning tasks remains unsatisfactory. Although some prompting methods, such as Chain-of-Thought, can…

Computation and Language · Computer Science 2025-02-10 Tongxuan Liu , Wenjiang Xu , Weizhe Huang , Yuting Zeng , Jiaxing Wang , Xingyu Wang , Hailong Yang , Jing Li

Abstract reasoning, the ability to reason from the abstract essence of a problem, serves as a key to generalization in human reasoning. However, eliciting language models to perform reasoning with abstraction remains unexplored. This paper…

Computation and Language · Computer Science 2024-09-27 Ruixin Hong , Hongming Zhang , Xiaoman Pan , Dong Yu , Changshui Zhang

Despite significant progress in video question answering (VideoQA), existing methods fall short of questions that require causal/temporal reasoning across frames. This can be attributed to imprecise motion representations. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Junwen Chen , Jie Zhu , Yu Kong

Generating intermediate steps, or Chain of Thought (CoT), is an effective way to significantly improve language models' (LM) multi-step reasoning capability. However, the CoT lengths can grow rapidly with the problem complexity, easily…

Computation and Language · Computer Science 2023-06-13 Soochan Lee , Gunhee Kim

Reasoning models have demonstrated remarkable progress in solving complex and logic-intensive tasks by generating extended Chain-of-Thoughts (CoTs) prior to arriving at a final answer. Yet, the emergence of this "slow-thinking" paradigm,…

Computation and Language · Computer Science 2025-09-30 Sicheng Feng , Gongfan Fang , Xinyin Ma , Xinchao Wang

Large Vision-Language Models (LVLMs) have achieved significant success in multimodal tasks, with multimodal chain-of-thought (MCoT) further enhancing performance and interpretability. Recent MCoT methods fall into two categories: (i)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zihui Cheng , Qiguang Chen , Xiao Xu , Jiaqi Wang , Weiyun Wang , Hao Fei , Yidong Wang , Alex Jinpeng Wang , Zhi Chen , Wanxiang Che , Libo Qin