English
Related papers

Related papers: What, Whether and How? Unveiling Process Reward Mo…

200 papers

While Multimodal Large Language Models (MLLMs) excel at single-image understanding, they exhibit significantly degraded performance in multi-image reasoning scenarios. Multi-image reasoning presents fundamental challenges including complex…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jianghao Yin , Qingbin Li , Kun Sun , Cheng Ding , Jie Wang , Qin Chen , Jie Zhou , Nan Wang , Changqing Li , Pei Wu , Jian Xu , Zheming Yang , Liang He

AI models have achieved state-of-the-art results in textual reasoning; however, their ability to reason over spatial and relational structures remains a critical bottleneck -- particularly in early-grade maths, which relies heavily on…

Existing evaluation frameworks for Multimodal Large Language Models (MLLMs) primarily focus on image reasoning or general video understanding tasks, largely overlooking the significant role of image context in video comprehension. To bridge…

The reliability of large language models (LLMs) during test-time scaling is often assessed with \emph{external verifiers} or \emph{reward models} that distinguish correct reasoning from flawed logic. Prior work generally assumes that…

Large Multimodal Models (LMMs) demonstrate significant cross-modal reasoning capabilities. However, financial applications face challenges due to the lack of high-quality multimodal reasoning datasets and the inefficiency of existing…

Computation and Language · Computer Science 2025-06-17 Kai Lan , Jiayong Zhu , Jiangtong Li , Dawei Cheng , Guang Chen , Changjun Jiang

Reward models (RMs) play a critical role in enhancing the reasoning performance of LLMs. For example, they can provide training signals to finetune LLMs during reinforcement learning (RL) and help select the best answer from multiple…

Computation and Language · Computer Science 2025-10-06 Qiyuan Liu , Hao Xu , Xuhong Chen , Wei Chen , Yee Whye Teh , Ning Miao

Recent studies have demonstrated the effectiveness of Large Language Models (LLMs) as reasoning modules that can deconstruct complex tasks into more manageable sub-tasks, particularly when applied to visual reasoning tasks for images. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ahmad Mahmood , Ashmal Vayani , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Vision-Language Models (VLMs) have recently emerged as powerful tools, excelling in tasks that integrate visual and textual comprehension, such as image captioning, visual question answering, and image-text retrieval. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ilias Stogiannidis , Steven McDonagh , Sotirios A. Tsaftaris

Multi-image reasoning and grounding require understanding complex cross-image relationships at both object levels and image levels. Current Large Visual Language Models (LVLMs) face two critical challenges: the lack of cross-image reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Lihao Zheng , Jiawei Chen , Xintian Shen , Hao Ma , Tao Wei

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Recent progress in the reasoning capabilities of multimodal large language models (MLLMs) has empowered them to address more complex tasks such as scientific analysis and mathematical reasoning. Despite their promise, MLLMs' reasoning…

Computation and Language · Computer Science 2026-03-03 Jiachun Li , Shaoping Huang , Zhuoran Jin , Chenlong Zhang , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Human reasoning relies on constructing and manipulating mental models -- simplified internal representations of situations used to understand and solve problems. Conceptual diagrams (e.g., a sketch drawn to aid reasoning) externalize these…

Artificial Intelligence · Computer Science 2025-09-30 Nasim Borazjanizadeh , Roei Herzig , Eduard Oks , Trevor Darrell , Rogerio Feris , Leonid Karlinsky

Existing video benchmarks often resemble image-based benchmarks, with question types like "What actions does the person perform throughout the video?" or "What color is the woman's dress in the video?" For these, models can often answer by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yiyang Zhou , Linjie Li , Shi Qiu , Zhengyuan Yang , Yuyang Zhao , Siwei Han , Yangfan He , Kangqi Li , Haonian Ji , Zihao Zhao , Haibo Tong , Lijuan Wang , Huaxiu Yao

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

Computation and Language · Computer Science 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

Advancements in large language models (LLMs) have demonstrated their potential in facilitating high-level reasoning, logical reasoning and robotics planning. Recently, LLMs have also been able to generate reward functions for low-level…

Robotics · Computer Science 2024-02-21 Marta Skreta , Zihan Zhou , Jia Lin Yuan , Kourosh Darvish , Alán Aspuru-Guzik , Animesh Garg

Recent advances in large language models (LLMs) have significantly improved performance on the Text-to-SQL task by leveraging their powerful reasoning capabilities. To enhance accuracy during the reasoning process, external Process Reward…

Computation and Language · Computer Science 2025-05-20 Yuxin Zhang , Meihao Fan , Ju Fan , Mingyang Yi , Yuyu Luo , Jian Tan , Guoliang Li

Logical reasoning consistently plays a fundamental and significant role in the domains of knowledge engineering and artificial intelligence. Recently, Large Language Models (LLMs) have emerged as a noteworthy innovation in natural language…

Computation and Language · Computer Science 2024-09-17 Fangzhi Xu , Qika Lin , Jiawei Han , Tianzhe Zhao , Jun Liu , Erik Cambria

Can Visual Language Models (VLMs) effectively capture human visual preferences? This work addresses this question by training VLMs to think about preferences at test time, employing reinforcement learning methods inspired by DeepSeek R1 and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Alexander Gambashidze , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

With the continuous advancement of large language models (LLMs), it is essential to create new benchmarks to effectively evaluate their expanding capabilities and identify areas for improvement. This work focuses on multi-image reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Mehran Kazemi , Nishanth Dikkala , Ankit Anand , Petar Devic , Ishita Dasgupta , Fangyu Liu , Bahare Fatemi , Pranjal Awasthi , Dee Guo , Sreenivas Gollapudi , Ahmed Qureshi
‹ Prev 1 4 5 6 7 8 10 Next ›