English
Related papers

Related papers: CoTasks: Chain-of-Thought based Video Instruction …

200 papers

Image retrieval remains a fundamental yet challenging problem in computer vision. While recent advances in Multimodal Large Language Models (MLLMs) have demonstrated strong reasoning capabilities, existing methods typically employ them only…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shangrong Wu , Yanghong Zhou , Yang Chen , Feng Zhang , P. Y. Mok

Many video reasoning tasks require tracking motion, temporal order, and evolving visual states across frames. Existing methods built on large vision-language models (LVLMs) often address this challenge by externalizing reasoning through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yiming Liang , Yixiao Chen , Yiyang Zhou , Yixuan Wang , Shoubin Yu , Andong Deng , Fuxiao Liu , Qin Zhang , Chen Chen , Mohit Bansal , Huaxiu Yao

Large language models (LLMs) solve problems more accurately and interpretably when instructed to work out the answer step by step using a ``chain-of-thought'' (CoT) prompt. One can also improve LLMs' performance on a specific task by…

Chain-of-thought (CoT) prompting enables large language models (LLMs) to solve complex reasoning tasks by generating an explanation before the final prediction. Despite it's promising ability, a critical downside of CoT prompting is that…

Computation and Language · Computer Science 2023-03-08 Seungone Kim , Se June Joo , Yul Jang , Hyungjoo Chae , Jinyoung Yeo

Mathematical reasoning remains a significant challenge for large language models (LLMs), despite progress in prompting techniques such as Chain-of-Thought (CoT). We present **Chain of Mathematically Annotated Thought (CoMAT)**, which…

Artificial Intelligence · Computer Science 2026-01-16 Joshua Ong Jun Leang , Aryo Pradipta Gema , Shay B. Cohen

Accurately estimating task progress is critical for embodied agents to plan and execute long-horizon, multi-step tasks. Despite promising advances, existing Vision-Language Models (VLMs) based methods primarily leverage their video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yuelin Zhang , Sijie Cheng , Chen Li , Zongzhao Li , Yuxin Huang , Yang Liu , Wenbing Huang

Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), especially when combined with reinforcement learning (RL) based post-training methods. While longer reasoning traces can improve…

Machine Learning · Computer Science 2026-02-16 Qinhang Wu , Sen Lin , Ming Zhang , Yingbin Liang , Ness B. Shroff

Despite recent advances in Vision-Language Models (VLMs), long-video understanding remains a challenging problem. Although state-of-the-art long-context VLMs can process around 1000 input frames, they still struggle to effectively leverage…

Machine Learning · Computer Science 2025-07-04 Anurag Arnab , Ahmet Iscen , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Large multimodal models (LMMs) have shown great potential for video reasoning with textual Chain-of-Thought. However, they remain vulnerable to hallucinations, especially when processing long-form videos where evidence is sparse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zuhao Yang , Sudong Wang , Kaichen Zhang , Keming Wu , Sicong Leng , Yifan Zhang , Bo Li , Chengwei Qin , Shijian Lu , Xingxuan Li , Lidong Bing

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

While recent multimodal models have shown progress in vision-language tasks, small-scale variants still struggle with the fine-grained temporal reasoning required for video understanding. We introduce ReasonAct, a method that enhances video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaxin Liu , Zhaolu Kang

Test-Time Training (TTT) models context dependencies by adapting part of the model's weights (referred to as fast weights) during inference. This fast weight, akin to recurrent states in RNNs, stores temporary memories of past tokens in the…

Machine Learning · Computer Science 2025-06-02 Tianyuan Zhang , Sai Bi , Yicong Hong , Kai Zhang , Fujun Luan , Songlin Yang , Kalyan Sunkavalli , William T. Freeman , Hao Tan

Recent reasoning models through test-time scaling have demonstrated that long chain-of-thoughts can unlock substantial performance boosts in hard reasoning tasks such as math and code. However, the benefit of such long thoughts for system-2…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yuan-Hong Liao , Sven Elflein , Liu He , Laura Leal-Taixé , Yejin Choi , Sanja Fidler , David Acuna

Equipped with Chain-of-Thought (CoT), Large language models (LLMs) have shown impressive reasoning ability in various downstream tasks. Even so, suffering from hallucinations and the inability to access external knowledge, LLMs often come…

Computation and Language · Computer Science 2023-10-31 Keheng Wang , Feiyu Duan , Sirui Wang , Peiguang Li , Yunsen Xian , Chuantao Yin , Wenge Rong , Zhang Xiong

Chain-of-Thought (CoT) reasoning enhances the decision-making capabilities of vision-language-action models in autonomous driving, but its autoregressive nature introduces significant inference latency, making it impractical for real-time…

Robotics · Computer Science 2026-02-04 Yi Gu , Yan Wang , Yuxiao Chen , Yurong You , Wenjie Luo , Yue Wang , Wenhao Ding , Boyi Li , Heng Yang , Boris Ivanovic , Marco Pavone

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

While researchers have made significant progress in enabling large language models (LLMs) to perform multi-step planning, LLMs struggle to ensure that those plans align with high-level user intent and satisfy symbolic constraints,…

Machine Learning · Computer Science 2026-05-14 Kamel Alrashedy , Vriksha Srihari , Zulfiqar Zaidi , Ridam Srivastava , Pradyumna Tambwekar , Matthew Gombolay

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

Computation and Language · Computer Science 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

Existing Video Large Language Models (Video LLMs) struggle with complex video understanding, exhibiting limited reasoning capabilities and potential hallucinations. In particular, these methods tend to perform reasoning solely relying on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Qizhong Tan , Zhuotao Tian , Guangming Lu , Jun Yu , Wenjie Pei

Chain-of-thought prompting (CoT) has the potential to improve the explainability of language model reasoning. But CoT can also systematically misrepresent the factors influencing models' behavior -- for example, rationalizing answers in…

Computation and Language · Computer Science 2025-06-30 James Chua , Edward Rees , Hunar Batra , Samuel R. Bowman , Julian Michael , Ethan Perez , Miles Turpin