中文
相关论文

相关论文: Solution for SMART-101 Challenge of CVPR Multi-mod…

200 篇论文

Cognitive science research treats visual perception, the ability to understand and make sense of a visual input, as one of the early developmental signs of intelligence. Its TVPS-4 framework categorizes and tests human perception into seven…

计算与语言 · 计算机科学 2026-01-23 Samrajnee Ghosh , Naman Agarwal , Hemanshu Garg , Chinmay Mittal , Mausam , Parag Singla

Complex Visual Question Answering (Complex VQA) tasks, which demand sophisticated multi-modal reasoning and external knowledge integration, present significant challenges for existing large vision-language models (LVLMs) often limited by…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Jingwei Peng , Jiehao Chen , Mateo Alejandro Rojas , Meilin Zhang

Recent advances in Large Multimodal Models (LMMs) have revolutionized their reasoning and Optical Character Recognition (OCR) capabilities. However, their complex logical reasoning performance on text-rich images remains underexplored. To…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Maoyuan Ye , Haibin He , Qihuang Zhong , Jing Zhang , Juhua Liu , Bo Du

Large Vision-Language Models (LVLMs), despite their recent success, are hardly comprehensively tested for their cognitive abilities. Inspired by the prevalent use of the Cookie Theft task in human cognitive tests, we propose a novel…

人工智能 · 计算机科学 2025-02-14 Xiujie Song , Mengyue Wu , Kenny Q. Zhu , Chunhao Zhang , Yanyi Chen

Recent advancements in multimodal slow-thinking systems have demonstrated remarkable performance across various visual reasoning tasks. However, their capabilities in text-rich image reasoning tasks remain understudied due to the absence of…

机器学习 · 计算机科学 2026-05-27 Mingxin Huang , Yongxin Shi , Dezhi Peng , Songxuan Lai , Zecheng Xie , Lianwen Jin

Large Language Models (LLMs) have achieved remarkable performance across a wide range of mathematical benchmarks. However, concerns remain as to whether these successes reflect genuine reasoning or superficial pattern recognition. Existing…

人工智能 · 计算机科学 2026-04-21 Yujie Hou , Mei Wang , Yaoyao Zhong , Ting Zhang , Xuetao Ma , Hua Huang

Current large vision-language models (LVLMs) typically employ a connector module to link visual features with text embeddings of large language models (LLMs) and use end-to-end training to achieve multi-modal understanding in a unified…

人工智能 · 计算机科学 2025-08-14 Zixian Guo , Ming Liu , Qilong Wang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

This paper introduces the novel task of multimodal puzzle solving, framed within the context of visual question-answering. We present a new dataset, AlgoPuzzleVQA designed to challenge and evaluate the capabilities of multimodal language…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Deepanway Ghosal , Vernon Toh Yan Han , Chia Yew Ken , Soujanya Poria

The visual commonsense reasoning (VCR) task is to choose an answer and provide a justifying rationale based on the given image and textural question. Representative works first recognize objects in images and then associate them with key…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Jian Zhu , Hanli Wang , Miaojing Shi

Large Vision-Language Models (LVLMs) struggle with puzzles, which require precise perception, rule comprehension, and logical reasoning. Assessing and enhancing their performance in this domain is crucial, as it reflects their ability to…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Yufan Ren , Konstantinos Tertikas , Shalini Maiti , Junlin Han , Tong Zhang , Sabine Süsstrunk , Filippos Kokkinos

Research on Multi-modal Large Language Models (MLLMs) towards the multi-image cross-modal instruction has received increasing attention and made significant progress, particularly in scenarios involving closely resembling images (e.g.,…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Tao Wu , Mengze Li , Jingyuan Chen , Wei Ji , Wang Lin , Jinyang Gao , Kun Kuang , Zhou Zhao , Fei Wu

Multi-Modal Large Language Models (MLLMs) have demonstrated impressive performance in various VQA tasks. However, they often lack interpretability and struggle with complex visual inputs, especially when the resolution of the input image is…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Hao Shao , Shengju Qian , Han Xiao , Guanglu Song , Zhuofan Zong , Letian Wang , Yu Liu , Hongsheng Li

Vision-language models (VLMs) excel in semantic tasks but falter at a core human capability: detecting hidden content in optical illusions or AI-generated images through perceptual adjustments like zooming. We introduce HC-Bench, a…

计算与语言 · 计算机科学 2025-10-16 Sifan Li , Yujun Cai , Yiwei Wang

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids generally enhance…

计算与语言 · 计算机科学 2024-09-26 Wenwen Zhuang , Xin Huang , Xiantao Zhang , Jin Zeng

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Understanding and reasoning over diagrams is a fundamental aspect of human intelligence. While Large Multimodal Models (LMMs) have demonstrated impressive capabilities across various tasks, existing benchmarks lack comprehensive evaluation…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Fengji Zhang , Linquan Wu , Huiyu Bai , Guancheng Lin , Xiao Li , Xiao Yu , Yue Wang , Bei Chen , Jacky Keung

Multi-step spatial reasoning entails understanding and reasoning about spatial relationships across multiple sequential steps, which is crucial for tackling complex real-world applications, such as robotic manipulation, autonomous…

人工智能 · 计算机科学 2025-06-23 Kexian Tang , Junyao Gao , Yanhong Zeng , Haodong Duan , Yanan Sun , Zhening Xing , Wenran Liu , Kaifeng Lyu , Kai Chen

Despite significant advancements, current large language models (LLMs) and vision-language models (LVLMs) continue to struggle with complex, multi-step, cross-modal common sense reasoning tasks, often exhibiting a lack of "deliberative…

计算与语言 · 计算机科学 2025-08-06 Wenjie Luo , Ruocheng Li , Shanshan Zhu , Julian Perry

This paper presents a summary of the VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models (LMMs), hosted as part of the ICCV 2025 Workshop on Visual Quality Assessment. The challenge aims to evaluate and enhance…

Is vision good enough for language? Recent advancements in multimodal models primarily stem from the powerful reasoning abilities of large language models (LLMs). However, the visual component typically depends only on the instance-level…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Shengbang Tong , Zhuang Liu , Yuexiang Zhai , Yi Ma , Yann LeCun , Saining Xie