中文
相关论文

相关论文: Process-of-Thought Reasoning for Videos

200 篇论文

Chain-of-Thought (CoT) prompting is a widely used inference-time technique for improving reasoning, yet its gains are uneven across tasks. We analyze when and why CoT helps by modeling the step-wise reasoning trajectory as a Markov chain.…

机器学习 · 计算机科学 2026-03-03 Zihan Wang , Yijun Dong , Qi Lei

Chain-of-thought (CoT) reasoning is useful for monitoring language models only when the reasoning trace faithfully reflects the computation that produces the final answer. However, models can rely on prompt-to-answer shortcuts that bypass…

机器学习 · 计算机科学 2026-05-26 Jinghan Jia , Joe Benton , Eric Easley

Recent advances in video generation have revealed an unexpected phenomenon: diffusion-based video models exhibit non-trivial reasoning capabilities. Prior work attributes this to a Chain-of-Frames (CoF) mechanism, where reasoning is assumed…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Ruisi Wang , Zhongang Cai , Fanyi Pu , Junxiang Xu , Wanqi Yin , Maijunxian Wang , Ran Ji , Chenyang Gu , Bo Li , Ziqi Huang , Hokin Deng , Dahua Lin , Ziwei Liu , Lei Yang

Video content comprehension is essential for various applications, ranging from video analysis to interactive systems. Despite advancements in large-scale vision-language models (VLMs), these models often struggle to capture the nuanced,…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Shuyi Zhang , Xiaoshuai Hao , Yingbo Tang , Lingfeng Zhang , Pengwei Wang , Zhongyuan Wang , Hongxuan Ma , Shanghang Zhang

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Large language models (LLMs) possess vast semantic knowledge but often struggle with complex reasoning tasks, particularly in relational reasoning problems such as kinship or spatial reasoning. In this paper, we present Path-of-Thoughts…

计算与语言 · 计算机科学 2026-03-25 Ge Zhang , Mohammad Ali Alomrani , Hongjian Gu , Jiaming Zhou , Yaochen Hu , Bin Wang , Qun Liu , Mark Coates , Yingxue Zhang , Jianye Hao

Multimodal large language models (LLMs) have made rapid progress in visual understanding, yet their extension from images to videos often reduces to a naive concatenation of frame tokens. In this work, we investigate what video finetuning…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Ruiqi Yang , Tian Yun , Zihan Wang , Ellie Pavlick

Reinforcement fine-tuning (RFT), a two-stage framework consisting of supervised fine-tuning (SFT) and reinforcement learning (RL) has shown promising results on improving reasoning ability of large language models (LLMs). Yet extending RFT…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yifan Jiang , Yueying Wang , Rui Zhao , Toufiq Parag , Zhimin Chen , Zhenyu Liao , Jayakrishnan Unnikrishnan

Human intelligence requires correctness and robustness, with the former being foundational for the latter. In video understanding, correctness ensures the accurate interpretation of visual content, and robustness maintains consistent…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Yuanhan Zhang , Yunice Chew , Yuhao Dong , Aria Leo , Bo Hu , Ziwei Liu

Recent advances in large language models elicit reasoning in a chain-of-thought that allows models to decompose problems in a human-like fashion. Though this paradigm improves multi-step reasoning ability in language models, it is limited…

We present Proof-of-Perception (PoP), a tool-using framework that casts multimodal reasoning as an executable graph with explicit reliability guarantees. Each perception or logic node outputs a conformal set, yielding calibrated, stepwise…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Arya Fayyazi , Haleh Akrami

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

Despite recent advances in Vision-Language Models (VLMs), long-video understanding remains a challenging problem. Although state-of-the-art long-context VLMs can process around 1000 input frames, they still struggle to effectively leverage…

机器学习 · 计算机科学 2025-07-04 Anurag Arnab , Ahmet Iscen , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Chain-of-Thought (CoT) is an efficient prompting method that enables the reasoning ability of large language models by augmenting the query using multiple examples with multiple intermediate steps. Despite the empirical success, the…

机器学习 · 计算机科学 2025-05-27 Hongkang Li , Songtao Lu , Pin-Yu Chen , Xiaodong Cui , Meng Wang

We investigate complex video question answering via chain-of-evidence reasoning -- identifying sequences of temporal spans from multiple relevant parts of the video, together with visual evidence within them. Existing models struggle with…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Yujie Lu , Yale Song , William Wang , Lorenzo Torresani , Tushar Nagarajan

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies…

计算与语言 · 计算机科学 2024-05-21 Zhuosheng Zhang , Aston Zhang , Mu Li , Hai Zhao , George Karypis , Alex Smola

Current Large Language Model reasoning systems process queries independently, discarding valuable cross-instance signals such as shared reasoning patterns and consistency constraints. We introduce Batch-of-Thought (BoT), a training-free…

人工智能 · 计算机科学 2026-05-12 Xuan Yang , Furong Jia , Roy Xie , Xiong Xi , Hengwei Bian , Jian Li , Monica Agrawal

Chain-of-Thought (CoT) reasoning enhances the decision-making capabilities of vision-language-action models in autonomous driving, but its autoregressive nature introduces significant inference latency, making it impractical for real-time…

机器人学 · 计算机科学 2026-02-04 Yi Gu , Yan Wang , Yuxiao Chen , Yurong You , Wenjie Luo , Yue Wang , Wenhao Ding , Boyi Li , Heng Yang , Boris Ivanovic , Marco Pavone

The video reasoning ability of multimodal large language models (MLLMs) is crucial for downstream tasks like video question answering and temporal grounding. While recent approaches have explored text-based chain-of-thought (CoT) reasoning…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Haoji Zhang , Xin Gu , Jiawen Li , Chixiang Ma , Sule Bai , Chubin Zhang , Bowen Zhang , Zhichao Zhou , Dongliang He , Yansong Tang

Chain-of-Thought (CoT) empowers Large Language Models (LLMs) to tackle complex problems, but remains constrained by the computational cost and reasoning path collapse when grounded in discrete token spaces. Recent latent reasoning…

人工智能 · 计算机科学 2026-02-05 Jiecong Wang , Hao Peng , Chunyang Liu