English
Related papers

Related papers: TwiFF (Think With Future Frames): A Large-Scale Da…

200 papers

Understanding and predicting emotion from videos has gathered significant attention in recent studies, driven by advancements in video large language models (VideoLLMs). While advanced methods have made progress in video emotion analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zhicheng Zhang , Weicheng Wang , Yongjie Zhu , Wenyu Qin , Pengfei Wan , Di Zhang , Jufeng Yang

Recent large vision-language models (LVLMs) have demonstrated impressive reasoning ability by generating long chain-of-thought (CoT) responses. However, CoT reasoning in multimodal contexts is highly vulnerable to visual hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yongchang Zhang , Oliver Ma , Tianyi Liu , Guangquan Zhou , Yang Chen

We present VRBench, the first long narrative video benchmark crafted for evaluating large models' multi-step reasoning capabilities, addressing limitations in existing evaluations that overlook temporal reasoning and procedural validity. It…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiashuo Yu , Yue Wu , Meng Chu , Zhifei Ren , Zizheng Huang , Pei Chu , Ruijie Zhang , Yinan He , Qirui Li , Songze Li , Zhenxiang Li , Zhongying Tu , Conghui He , Yu Qiao , Yali Wang , Yi Wang , Limin Wang

Chain-of-thought (CoT) reasoning in vision language models (VLMs) is crucial for improving interpretability and trustworthiness. However, current training recipes lack robust CoT reasoning data, relying on datasets dominated by short…

Artificial Intelligence · Computer Science 2024-10-22 Ruohong Zhang , Bowen Zhang , Yanghao Li , Haotian Zhang , Zhiqing Sun , Zhe Gan , Yinfei Yang , Ruoming Pang , Yiming Yang

Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yang Luo , Xuanlei Zhao , Baijiong Lin , Lingting Zhu , Liyao Tang , Yuqi Liu , Ying-Cong Chen , Shengju Qian , Xin Wang , Yang You

Evaluating whether Multimodal Large Language Models (MLLMs) genuinely reason about physical dynamics remains challenging. Most existing benchmarks rely on recognition-style protocols such as Visual Question Answering (VQA) and Violation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Jiarong Liang , Max Ku , Ka-Hei Hui , Ping Nie , Wenhu Chen

This paper presents ThinkDiff, a novel alignment paradigm that empowers text-to-image diffusion models with multimodal in-context understanding and reasoning capabilities by integrating the strengths of vision-language models (VLMs).…

Machine Learning · Computer Science 2025-02-18 Zhenxing Mi , Kuan-Chieh Wang , Guocheng Qian , Hanrong Ye , Runtao Liu , Sergey Tulyakov , Kfir Aberman , Dan Xu

Multimodal Chain of Thought (MCoT) is a popular prompting strategy for improving the performance of multimodal large language models (MLLMs) across a range of complex reasoning tasks. Despite its popularity, there is a notable absence of…

Computation and Language · Computer Science 2025-03-03 Xiongtao Zhou , Jie He , Lanyu Chen , Jingyu Li , Haojing Chen , Víctor Gutiérrez-Basulto , Jeff Z. Pan , Hanjie Chen

Existing automatic captioning methods for visual content face challenges such as lack of detail, content hallucination, and poor instruction following. In this work, we propose VisualFactChecker (VFC), a flexible training-free pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yunhao Ge , Xiaohui Zeng , Jacob Samuel Huffman , Tsung-Yi Lin , Ming-Yu Liu , Yin Cui

Comic understanding presents a significant challenge for Multimodal Large Language Models (MLLMs), as the intended meaning of a comic often emerges from the joint interpretation of visual, textual, and social cues. This naturally motivates…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Chengcheng Feng , Haojie Yin , Yucheng Jin , Kaizhu Huang

Video Models have achieved remarkable success in high-fidelity video generation with coherent motion dynamics. Analogous to the development from text generation to text-based reasoning in language modeling, the development of video models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Cheng Yang , Haiyuan Wan , Yiran Peng , Xin Cheng , Zhaoyang Yu , Jiayi Zhang , Junchi Yu , Xinlei Yu , Xiawu Zheng , Dongzhan Zhou , Chenglin Wu

While large multimodal models (LMMs) have demonstrated strong performance across various Visual Question Answering (VQA) tasks, certain challenges require complex multi-step reasoning to reach accurate answers. One particularly challenging…

Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities across modalities such as images and text. However, tabular data, despite being a critical real-world modality, remains relatively underexplored in…

Computation and Language · Computer Science 2026-03-26 Kun-Yang Yu , Zhi Zhou , Shi-Yu Tian , Xiao-Wen Yang , Zi-Yi Jia , Ming Yang , Zi-Jian Cheng , Lan-Zhe Guo , Yu-Feng Li

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Recent progress in Multimodal Large Language Models (MLLMs) demonstrates that Chain-of-Thought (CoT) reasoning enables systematic solutions to complex understanding tasks. However, its extension to generation tasks remains nascent and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Siyu Jiao , Yiheng Lin , Yujie Zhong , Qi She , Wei Zhou , Xiaohan Lan , Zilong Huang , Fei Yu , Yingchen Yu , Yunqing Zhao , Yao Zhao , Yunchao Wei

In the domain of text-to-image generative models, biases inherent in training datasets often propagate into generated content, posing significant ethical challenges, particularly in socially sensitive contexts. We introduce FairCoT, a novel…

Machine Learning · Computer Science 2025-09-16 Zahraa Al Sahili , Ioannis Patras , Matthew Purver

The rapid advancement of Multimodal Large Language Models (MLLMs) has enabled browsing agents to acquire and reason over multimodal information in the real world. But existing benchmarks suffer from two limitations: insufficient evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhengbo Zhang , Jinbo Su , Zhaowen Zhou , Changtao Miao , Yuhan Hong , Qimeng Wu , Yumeng Liu , Feier Wu , Yihe Tian , Yuhao Liang , Zitong Shan , Wanke Xia , Yi-Fan Zhang , Bo Zhang , Zhe Li , Shiming Xiang , Ying Yan

Recent advancements in Large Vision-Language Models have showcased remarkable capabilities. However, they often falter when confronted with complex reasoning tasks that humans typically address through visual aids and deliberate,…

Computation and Language · Computer Science 2025-04-15 Yikun Wang , Siyin Wang , Qinyuan Cheng , Zhaoye Fei , Liang Ding , Qipeng Guo , Dacheng Tao , Xipeng Qiu

CoT has significantly enhanced the reasoning ability of LLMs while it faces challenges when extended to multimodal domains, particularly in mathematical tasks. Existing MLLMs typically perform textual reasoning solely from a single static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Lihong Wang , Liangqi Li , Weiwei Feng , Jiamin Wu , Changtao Miao , Tieru Wu , Rui Ma , Bo Zhang , Zhe Li

Reasoning is a fundamental capability for solving complex multi-step problems, particularly in visual contexts where sequential step-wise understanding is essential. Existing approaches lack a comprehensive framework for evaluating visual…