English
Related papers

Related papers: Multimodal Fact-Level Attribution for Verifiable R…

200 papers

Despite recent progress in multimodal large language models (MLLMs), reliable visual question answering in aerial scenes remains challenging. In such scenes, task-critical evidence is often carried by small objects, explicit quantities,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junxiao Xue , Quan Deng , Tingqi Hu , Meicong Si , Xinyi Yin , Yunyun Shi , Xuecheng Wu

Recent progress in the reasoning capabilities of multimodal large language models (MLLMs) has empowered them to address more complex tasks such as scientific analysis and mathematical reasoning. Despite their promise, MLLMs' reasoning…

Computation and Language · Computer Science 2026-03-03 Jiachun Li , Shaoping Huang , Zhuoran Jin , Chenlong Zhang , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

With the increasing demand for step-wise, cross-modal, and knowledge-grounded reasoning, multimodal large language models (MLLMs) are evolving beyond the traditional fixed retrieve-then-generate paradigm toward more sophisticated agentic…

Artificial Intelligence · Computer Science 2026-03-03 Xuying Ning , Dongqi Fu , Tianxin Wei , Mengting Ai , Jiaru Zou , Ting-Wei Li , Hanghang Tong , Yada Zhu , Hendrik Hamann , Jingrui He

Multimodal large language models (MLLMs) achieve strong performance on benchmarks that evaluate text, image, or video understanding separately. However, these settings do not assess a critical real-world requirement, which involves…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Dannong Xu , Zhongyu Yang , Jun Chen , Yingfang Yuan , Ming Hu , Lei Sun , Luc Van Gool , Danda Pani Paudel , Chun-Mei Feng

The powerful reasoning and generative capabilities of large language models (LLMs) have inspired researchers to apply them to reasoning-based recommendation tasks, which require in-depth reasoning about user interests and the generation of…

Information Retrieval · Computer Science 2025-11-25 Shihao Cai , Chongming Gao , Haoyan Liu , Wentao Shi , Jianshan Sun , Ruiming Tang , Fuli Feng

Large language models (LLMs) power deep research agents that synthesize information from hundreds of web sources into cited reports, yet these citations cannot be reliably verified. Current approaches either trust models to self-cite…

Computation and Language · Computer Science 2026-05-08 Hailey Onweller , Elias Lumer , Austin Huber , Pia Ramchandani , Vamse Kumar Subbiah , Corey Feld

Understanding human intents from multimodal signals is critical for analyzing human behaviors and enhancing human-machine interactions in real-world scenarios. However, existing methods exhibit limitations in their modality-level reliance,…

Multimedia · Computer Science 2025-09-03 Qianrui Zhou , Hua Xu , Yifan Wang , Xinzhi Dong , Hanlei Zhang

In education, the traditional Automatic Short Answer Grading (ASAG) with feedback problem has focused primarily on evaluating text-only responses. However, real-world assessments often include multimodal responses containing both diagrams…

Artificial Intelligence · Computer Science 2026-02-06 Pritam Sil , Pushpak Bhattacharyya , Pawan Goyal , Ganesh Ramakrishnan

With the rapid evolution of multimodal large language models, the capacity to deeply understand and interpret human intentions has emerged as a critical capability, which demands detailed and thoughtful reasoning. In recent studies,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Qize Yang , Shimin Yao , Weixuan Chen , Shenghao Fu , Detao Bai , Jiaxing Zhao , Boyuan Sun , Bowen Yin , Xihan Wei , Jingren Zhou

Multimodal large language models (MLLMs) have broadened the scope of AI applications. Existing automatic evaluation methodologies for MLLMs are mainly limited in evaluating queries without considering user experiences, inadequately…

Multimodal large language models (MLLMs) have achieved impressive progress in vision-language reasoning, yet their ability to understand temporally unfolding narratives in videos remains underexplored. True narrative understanding requires…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hyeonjeong Ha , Jinjin Ge , Bo Feng , Kaixin Ma , Gargi Chakraborty

Recent advances in multimodal large language models (MLLMs) have demonstrated remarkable capabilities in vision-language tasks, yet they often struggle with vision-centric scenarios where precise visual focus is needed for accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yunze Man , De-An Huang , Guilin Liu , Shiwei Sheng , Shilong Liu , Liang-Yan Gui , Jan Kautz , Yu-Xiong Wang , Zhiding Yu

Despite the increasing use of large language models (LLMs) for context-grounded tasks like summarization and question-answering, understanding what makes an LLM produce a certain response is challenging. We propose Multi-Level Explanations…

Evaluation of multimodal reasoning models is typically reduced to a single accuracy score, implicitly treating reasoning as a unitary capability. We introduce MathLens, a benchmark of textbook-style geometry problems that exposes this…

Computation and Language · Computer Science 2026-05-08 Jiwan Chung , Neel Joshi , Pratyusha Sharma , Youngjae Yu , Vibhav Vineet

The rise of Multimodal Large Language Models (MLLMs), renowned for their advanced instruction-following and reasoning capabilities, has significantly propelled the field of visual reasoning. However, due to limitations in their image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Jiaxing Chen , Yuxuan Liu , Dehu Li , Xiang An , Weimo Deng , Ziyong Feng , Yongle Zhao , Yin Xie

Strong Artificial Intelligence (Strong AI) or Artificial General Intelligence (AGI) with abstract reasoning ability is the goal of next-generation AI. Recent advancements in Large Language Models (LLMs), along with the emerging field of…

Computation and Language · Computer Science 2024-01-19 Yiqi Wang , Wentao Chen , Xiaotian Han , Xudong Lin , Haiteng Zhao , Yongfei Liu , Bohan Zhai , Jianbo Yuan , Quanzeng You , Hongxia Yang

Visual reasoning is a core component of human intelligence and a critical capability for advanced multimodal models. Yet current reasoning evaluations of multimodal large language models (MLLMs) often rely on text descriptions and allow…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Weiye Xu , Jiahao Wang , Weiyun Wang , Zhe Chen , Wengang Zhou , Aijun Yang , Lewei Lu , Houqiang Li , Xiaohua Wang , Xizhou Zhu , Wenhai Wang , Jifeng Dai , Jinguo Zhu

Multi-image Interleaved Reasoning aims to improve Multi-modal Large Language Models (MLLMs) ability to jointly comprehend and reason across multiple images and their associated textual contexts, introducing unique challenges beyond…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hang Du , Jiayang Zhang , Guoshun Nan , Wendi Deng , Zhenyan Chen , Chenyang Zhang , Wang Xiao , Shan Huang , Yuqi Pan , Tao Qi , Sicong Leng

Recent multimodal large language models (MLLMs) have demonstrated significant potential in open-ended conversation, generating more accurate and personalized responses. However, their abilities to memorize, recall, and reason in sustained…

Existing multimodal retrieval benchmarks primarily focus on evaluating whether models can retrieve and utilize external textual knowledge for question answering. However, there are scenarios where retrieving visual information is either…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Wenbo Hu , Jia-Chen Gu , Zi-Yi Dou , Mohsen Fayyaz , Pan Lu , Kai-Wei Chang , Nanyun Peng