English
Related papers

Related papers: Process-of-Thought Reasoning for Videos

200 papers

Existing Video Large Language Models (Video LLMs) struggle with complex video understanding, exhibiting limited reasoning capabilities and potential hallucinations. In particular, these methods tend to perform reasoning solely relying on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Qizhong Tan , Zhuotao Tian , Guangming Lu , Jun Yu , Wenjie Pei

Chain of Thought (CoT) was introduced in recent research as a method for improving step-by-step reasoning in Large Language Models. However, CoT has limited applications such as its need for hand-crafted few-shot exemplar prompts and no…

Computation and Language · Computer Science 2024-12-11 Arda Sevinc , Abdurrahman Gumus

Despite recent progress in video large language models (VideoLLMs), a key open challenge remains: how to equip models with chain-of-thought (CoT) reasoning abilities grounded in fine-grained object-level video understanding. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yanan Wang , Julio Vizcarra , Zhi Li , Hao Niu , Mori Kurokawa

Recent advancements in Chain-of-Thought (CoT) and related rationale-based works have significantly improved the performance of Large Language Models (LLMs) in complex reasoning tasks. With the evolution of Multimodal Large Language Models…

Artificial Intelligence · Computer Science 2024-05-30 Qiji Zhou , Ruochen Zhou , Zike Hu , Panzhong Lu , Siyang Gao , Yue Zhang

Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). CoT explicitly encourages the LLM to generate intermediate rationales for solving a problem, by providing a series…

Computation and Language · Computer Science 2023-06-02 Boshi Wang , Sewon Min , Xiang Deng , Jiaming Shen , You Wu , Luke Zettlemoyer , Huan Sun

Many SLT systems quietly assume that brief chunks of signing map directly to spoken-language words. That assumption breaks down because signers often create meaning on the fly using context, space, and movement. We revisit SLT and argue…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Yiyang Jiang , Li Zhang , Xiao-Yong Wei , Li Qing

Chain-of-thought (CoT) reasoning has exhibited impressive performance in language models for solving complex tasks and answering questions. However, many real-world questions require multi-modal information, such as text and images.…

Artificial Intelligence · Computer Science 2023-12-15 Liqi He , Zuchao Li , Xiantao Cai , Ping Wang

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

While end-to-end video-to-audio generation has greatly improved, producing high-fidelity audio that authentically captures the nuances of visual content remains challenging. Like professionals in the creative industries, this generation…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-06 Huadai Liu , Kaicheng Luo , Jialei Wang , Wen Wang , Qian Chen , Zhou Zhao , Wei Xue

Chain of Thought (CoT) reasoning enhances language models' performance but often leads to inefficient "overthinking" on simple problems. We identify that existing approaches directly penalizing reasoning length fail to account for varying…

Computation and Language · Computer Science 2025-05-22 Junjie Yang , Ke Lin , Xing Yu

Chain-of-thought (CoT) reasoning in vision language models (VLMs) is crucial for improving interpretability and trustworthiness. However, current training recipes lack robust CoT reasoning data, relying on datasets dominated by short…

Artificial Intelligence · Computer Science 2024-10-22 Ruohong Zhang , Bowen Zhang , Yanghao Li , Haotian Zhang , Zhiqing Sun , Zhe Gan , Yinfei Yang , Ruoming Pang , Yiming Yang

This is the second in a series of short reports that seek to help business, education, and policy leaders understand the technical details of working with AI through rigorous testing. In this report, we investigate Chain-of-Thought (CoT)…

Computation and Language · Computer Science 2025-06-10 Lennart Meincke , Ethan Mollick , Lilach Mollick , Dan Shapiro

Chain-of-thought (CoT) reasoning enhances performance of large language models, but questions remain about whether these reasoning traces faithfully reflect the internal processes of the model. We present the first comprehensive study of…

Computation and Language · Computer Science 2025-11-04 Sriram Balasubramanian , Samyadeep Basu , Soheil Feizi

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni

Chain of thought reasoning has demonstrated remarkable success in large language models, yet its adaptation to vision-language reasoning remains an open challenge with unclear best practices. Existing attempts typically employ reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Honghao Chen , Xingzhou Lou , Xiaokun Feng , Kaiqi Huang , Xinlong Wang

While Chain-of-Thought (CoT) prompting enhances the reasoning capabilities of large language models, the faithfulness of the generated rationales remains an open problem for model interpretability. We propose a novel theoretical lens for…

Artificial Intelligence · Computer Science 2025-10-02 Elija Perrier

While recent multimodal models have shown progress in vision-language tasks, small-scale variants still struggle with the fine-grained temporal reasoning required for video understanding. We introduce ReasonAct, a method that enhances video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaxin Liu , Zhaolu Kang

Large language models are increasingly being used to assess and forecast research ideas, yet we lack scalable ways to evaluate the quality of models' judgments about these scientific ideas. Towards this goal, we introduce PoT, a…

Computation and Language · Computer Science 2026-01-13 Bingyang Ye , Shan Chen , Jingxuan Tu , Chen Liu , Zidi Xiong , Samuel Schmidgall , Danielle S. Bitterman

Existing works of reasoning segmentation often fall short in complex cases, particularly when addressing complicated queries and out-of-domain images. Inspired by the chain-of-thought reasoning, where harder problems require longer thinking…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Shiu-hong Kao , Chak Ho Huang , Huaiqian Liu , Yu-Wing Tai , Chi-Keung Tang