English
Related papers

Related papers: Benchmarking Sequential Visual Input Reasoning and…

200 papers

Recent Multimodal Large Language Models (MLLMs) excel in vision-language understanding but face challenges in adapting to dynamic real-world scenarios that require continuous integration of new knowledge and skills. While continual learning…

Computation and Language · Computer Science 2025-10-02 Hongbo Zhao , Fei Zhu , Haiyang Guo , Meng Wang , Rundong Wang , Gaofeng Meng , Zhaoxiang Zhang

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Large Vision Language Models (LVLMs) have demonstrated remarkable abilities in understanding and reasoning about both visual and textual information. However, existing evaluation methods for LVLMs, primarily based on benchmarks like Visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xinyu Wang , Bohan Zhuang , Qi Wu

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

Artificial Intelligence · Computer Science 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Large Multimodal Models (LMMs) have achieved remarkable progress across various capabilities; however, complex video reasoning in the scientific domain remains a significant and challenging frontier. Current video benchmarks predominantly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Andong Deng , Taojiannan Yang , Shoubin Yu , Lincoln Spencer , Mohit Bansal , Chen Chen , Serena Yeung-Levy , Xiaohan Wang

Multimodal large language models (MLLMs) have achieved impressive progress on vision language benchmarks, yet their capacity for visual cognitive and visuospatial reasoning remains less understood. We introduce "Mind's Eye", a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Rohit Sinha , Aditya Kanade , Sai Srinivas Kancheti , Vineeth N Balasubramanian , Tanuja Ganu

Multimodal Large Language Models (MLLMs) have demonstrated significant advances in visual understanding tasks involving both images and videos. However, their capacity to comprehend human-centric video data remains underexplored, primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxuan Cai , Jiangning Zhang , Zhenye Gan , Qingdong He , Xiaobin Hu , Junwei Zhu , Yabiao Wang , Chengjie Wang , Zhucun Xue , Chaoyou Fu , Xinwei He , Xiang Bai

Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image. However, it is difficult for these case studies to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Chaoyou Fu , Peixian Chen , Yunhang Shen , Yulei Qin , Mengdan Zhang , Xu Lin , Jinrui Yang , Xiawu Zheng , Ke Li , Xing Sun , Yunsheng Wu , Rongrong Ji , Caifeng Shan , Ran He

Multimodal Large Language Models (MLLMs) have demonstrated significant potential to advance a broad range of domains. However, current benchmarks for evaluating MLLMs primarily emphasize general knowledge and vertical step-by-step reasoning…

Multimodal large language models (MLLMs) are increasingly deployed in real-world, agentic settings where outputs must not only be correct, but also conform to predefined data schemas. Despite recent progress in structured generation in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Di Feng , Kaixin Ma , Feng Nan , Haofeng Chen , Bohan Zhai , David Griffiths , Mingfei Gao , Zhe Gan , Eshan Verma , Yinfei Yang , Zhifeng Chen , Afshin Dehghan

While multimodal large language models (MLLMs) have demonstrated extraordinary vision-language understanding capabilities, their abilities to solve instance-level visual-language problems beyond a single image warrant further exploration.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yunqiu Xu , Linchao Zhu , Yi Yang

Multimodal Large Language Models (MLLMs) are increasingly applied in real-world scenarios where user-provided images are often imperfect, requiring active image manipulations such as cropping, editing, or enhancement to uncover salient…

As multimodal large language models (MLLMs) advance rapidly, rigorous evaluation has become essential, providing further guidance for their development. In this work, we focus on a unified and robust evaluation of \textbf{vision perception}…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Feng Chen , Chenhui Gou , Jing Liu , Yang Yang , Zhaoyang Li , Jiyuan Zhang , Zhenbang Sun , Bohan Zhuang , Qi Wu

Recent advancements in multimodal slow-thinking systems have demonstrated remarkable performance across various visual reasoning tasks. However, their capabilities in text-rich image reasoning tasks remain understudied due to the absence of…

Machine Learning · Computer Science 2026-05-27 Mingxin Huang , Yongxin Shi , Dezhi Peng , Songxuan Lai , Zecheng Xie , Lianwen Jin

Mathematical reasoning is essential for problem-solving in education, science, and industry, serving as a crucial benchmark for evaluating artificial intelligence systems. As Large Language Models (LLMs) improve their reasoning…

Computation and Language · Computer Science 2026-05-20 Husnain Amjad , Raja Khurram Shahzad , Aamir Shahzad , Mehwish Fatima

Despite strong performance of Multimodal Large Language Models (MLLMs) on multimodal tasks, predicting whether and why an image is persuasive remains challenging. We first show that prompting MLLMs to reason before prediction does not…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Naeun Lee , Hyunjong Kim , Sunghwan Choi , Injin Kong , Yohan Jo

Multimodal large language models (MLLMs) that integrate visual and textual reasoning leverage chain-of-thought (CoT) prompting to tackle complex visual tasks, yet continue to exhibit visual hallucinations and an over-reliance on textual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Jing Bi , Guangyu Sun , Ali Vosoughi , Chen Chen , Chenliang Xu

Scientific reasoning, the process through which humans apply logic, evidence, and critical thinking to explore and interpret scientific phenomena, is essential in advancing knowledge reasoning across diverse fields. However, despite…

Computation and Language · Computer Science 2026-04-21 Yibo Yan , Shen Wang , Jiahao Huo , Jingheng Ye , Zhendong Chu , Xuming Hu , Philip S. Yu , Carla Gomes , Bart Selman , Qingsong Wen

Predictive analysis is a cornerstone of modern decision-making, with applications in various domains. Large Language Models (LLMs) have emerged as powerful tools in enabling nuanced, knowledge-intensive conversations, thus aiding in complex…

Computation and Language · Computer Science 2025-05-26 Qin Chen , Yuanyi Ren , Xiaojun Ma , Yuyang Shi