English
Related papers

Related papers: Interpretable Physics Reasoning and Performance Ta…

200 papers

Vision Language Models (VLMs) have demonstrated remarkable performance in 2D vision and language tasks. However, their ability to reason about spatial arrangements remains limited. In this work, we introduce Spatial Region GPT (SpatialRGPT)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 An-Chieh Cheng , Hongxu Yin , Yang Fu , Qiushan Guo , Ruihan Yang , Jan Kautz , Xiaolong Wang , Sifei Liu

Advancements in large language models (LLMs) have demonstrated their potential in facilitating high-level reasoning, logical reasoning and robotics planning. Recently, LLMs have also been able to generate reward functions for low-level…

Robotics · Computer Science 2024-02-21 Marta Skreta , Zihan Zhou , Jia Lin Yuan , Kourosh Darvish , Alán Aspuru-Guzik , Animesh Garg

Vision--language models (VLMs) achieve strong performance on many multimodal benchmarks but remain brittle on spatial reasoning tasks that require aligning abstract overhead representations with egocentric views. We introduce m2sv, a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yosub Shin , Michael Buriek , Igor Molybog

Recent advancements in Large Multimodal Models (LMMs) have shown promising results in mathematical reasoning within visual contexts, with models approaching human-level performance on existing benchmarks such as MathVista. However, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Ke Wang , Junting Pan , Weikang Shi , Zimu Lu , Mingjie Zhan , Hongsheng Li

This paper introduces a novel benchmark dataset designed to evaluate the capabilities of Vision Language Models (VLMs) on tasks that combine visual reasoning with subject-specific background knowledge in the German language. In contrast to…

Artificial Intelligence · Computer Science 2025-06-30 René Peinl , Vincent Tischler

Cognitive science research treats visual perception, the ability to understand and make sense of a visual input, as one of the early developmental signs of intelligence. Its TVPS-4 framework categorizes and tests human perception into seven…

Computation and Language · Computer Science 2026-01-23 Samrajnee Ghosh , Naman Agarwal , Hemanshu Garg , Chinmay Mittal , Mausam , Parag Singla

Vision-Language Models (VLMs) are increasingly deployed in embodied environments, where they need produce numerical outputs such as action magnitudes and spatial coordinates. Although these numbers appear meaningful, it remains unclear…

Artificial Intelligence · Computer Science 2026-05-25 Jianshu Zhang , Yijiang Li , Huifeixin Chen , Haoran Lu , Letian Xue , Bingyang Wang , Han Liu

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

Reliable evaluation of AI models is critical for scientific progress and practical application. While existing VLM benchmarks provide general insights into model capabilities, their heterogeneous designs and limited focus on a few imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Tim Rädsch , Leon Mayer , Simon Pavicic , A. Emre Kavur , Marcel Knopp , Barış Öztürk , Klaus Maier-Hein , Paul F. Jaeger , Fabian Isensee , Annika Reinke , Lena Maier-Hein

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Recently, large language and vision models (LLVMs) have received significant attention and development efforts due to their remarkable generalization performance across a wide range of tasks requiring perception and cognitive abilities. A…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Young-Jun Lee , Byungsoo Ko , Han-Gyu Kim , Yechan Hwang , Ho-Jin Choi

Vision-language models (VLMs) have demonstrated remarkable progress in multimodal reasoning. However, existing benchmarks remain limited in terms of high-quality, human-verified examples. Many current datasets rely on synthetically…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Patrick Haller , Fabio Barth , Jonas Golde , Georg Rehm , Alan Akbik

Vision-Language Models (VLMs) have demonstrated remarkable performance across a variety of real-world tasks. However, existing VLMs typically process visual information by serializing images, a method that diverges significantly from the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yueyan Li , Chenggong Zhao , Zeyuan Zang , Caixia Yuan , Xiaojie Wang

Vision-Language Models (VLMs) combine visual perception with the general capabilities, such as reasoning, of Large Language Models (LLMs). However, the mechanisms by which these two abilities can be combined and contribute remain poorly…

Computation and Language · Computer Science 2025-07-16 Shiqi Chen , Jinghan Zhang , Tongyao Zhu , Wei Liu , Siyang Gao , Miao Xiong , Manling Li , Junxian He

Recent advances in multimodal large language models (MLLMs) have yielded increasingly powerful models, yet their perceptual capacities remain poorly characterized. In practice, most model families scale language component while reusing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Tejas Anvekar , Fenil Bardoliya , Pavan K. Turaga , Chitta Baral , Vivek Gupta

Large language models (LLMs) and vision language models (VLMs), such as DeepSeek R1,OpenAI o3, and Gemini 2.5 Pro, have demonstrated remarkable reasoning capabilities across logical inference, problem solving, and decision making. However,…

Artificial Intelligence · Computer Science 2025-11-19 Xiaoxing Lian , Aidong Yang , Jun Zhu , Peng Wang , Yue Zhang

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

Despite the promise of foundation models in medical AI, current systems remain limited - they are modality-specific and lack transparent reasoning processes, hindering clinical adoption. To address this gap, we present EVLF-FM, a multimodal…

Vision language models (VLMs) achieve unified modeling of images and text, enabling them to accomplish complex real-world tasks through perception, planning, and reasoning. Among these tasks, reasoning is particularly representative, with…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Fan Yuan , Yuchen Yan , Yifan Jiang , Haoran Zhao , Tao Feng , Jinyan Chen , Yanwei Lou , Wenqi Zhang , Yongliang Shen , Weiming Lu , Jun Xiao , Yueting Zhuang

Multimodal Large Language Models (MLLMs) strive to achieve a profound, human-like understanding of and interaction with the physical world, but often exhibit a shallow and incoherent integration when acquiring information (Perception) and…