English
Related papers

Related papers: SciVer: Evaluating Foundation Models for Multimoda…

200 papers

Exponential growth in digital information outlets and the race to publish has made scientific misinformation more prevalent than ever. However, the task to fact-verify a given scientific claim is not straightforward even for researchers.…

Computation and Language · Computer Science 2022-04-19 Ashish Rana , Deepanshu Khanna , Tirthankar Ghosal , Muskaan Singh , Harpreet Singh , Prashant Singh Rana

Medical vision--language models (VLMs) are usually evaluated on intact image--question pairs, but trustworthy clinical use requires a stronger property: a model must recognise when the evidential basis for an answer has failed. We study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hanqi Jiang , Junhao Chen , Mingyu Kang , Hyeokjae Kwon , Yi Pan , Lifeng Chen , Weihang You , Haozhen Gong , Ruiyu Yan , Jinglei Lv , Lin Zhao , Hui Ren , Quanzheng Li , Tianming Liu , Xiang Li

We introduce EXAMS-V, a new challenging multi-discipline multimodal multilingual exam benchmark for evaluating vision language models. It consists of 20,932 multiple-choice questions across 20 school disciplines covering natural science,…

Computation and Language · Computer Science 2024-03-18 Rocktim Jyoti Das , Simeon Emilov Hristov , Haonan Li , Dimitar Iliyanov Dimitrov , Ivan Koychev , Preslav Nakov

Multimodal Large Language models (MLLMs) have shown promise in web-related tasks, but evaluating their performance in the web domain remains a challenge due to the lack of comprehensive benchmarks. Existing benchmarks are either designed…

Computation and Language · Computer Science 2024-04-10 Junpeng Liu , Yifan Song , Bill Yuchen Lin , Wai Lam , Graham Neubig , Yuanzhi Li , Xiang Yue

Recent math benchmarks for large language models (LLMs) such as MathArena indicate that state-of-the-art reasoning models achieve impressive performance on mathematical competitions like AIME, with the leading model, Gemini-2.5-Pro,…

Multi-modal large language models (MLLMs) have demonstrated promising capabilities across various tasks by integrating textual and visual information to achieve visual understanding in complex scenarios. Despite the availability of several…

Artificial Intelligence · Computer Science 2024-12-03 Zhihuan Jiang , Zhen Yang , Jinhao Chen , Zhengxiao Du , Weihan Wang , Bin Xu , Jie Tang

This paper presents a comprehensive survey of the taxonomy and evolution of multimodal foundation models that demonstrate vision and vision-language capabilities, focusing on the transition from specialist models to general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Chunyuan Li , Zhe Gan , Zhengyuan Yang , Jianwei Yang , Linjie Li , Lijuan Wang , Jianfeng Gao

Although LLMs have shown great performance on Mathematics and Coding related reasoning tasks, the reasoning capabilities of LLMs regarding other forms of reasoning are still an open problem. Here, we examine the issue of reasoning from the…

Computation and Language · Computer Science 2025-06-18 John Dougrez-Lewis , Mahmud Elahi Akhter , Federico Ruggeri , Sebastian Löbbers , Yulan He , Maria Liakata

Large Language Models (LLMs) have shown impressive capabilities in contextual understanding and reasoning. However, evaluating their performance across diverse scientific domains remains underexplored, as existing benchmarks primarily focus…

Computation and Language · Computer Science 2025-05-22 Jing Yu , Yuqi Tang , Kehua Feng , Mingyang Rao , Lei Liang , Zhiqiang Zhang , Mengshu Sun , Wen Zhang , Qiang Zhang , Keyan Ding , Huajun Chen

Visual foundation models (VFMs) have become increasingly popular due to their state-of-the-art performance. However, interpretability remains crucial for critical applications. In this sense, self-explainable models (SEM) aim to provide…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Hugues Turbé , Mina Bjelogrlic , Gianmarco Mengaldo , Christian Lovis

Seeking answers to questions within long scientific research articles is a crucial area of study that aids readers in quickly addressing their inquiries. However, existing question-answering (QA) datasets based on scientific papers are…

Computation and Language · Computer Science 2025-01-14 Shraman Pramanick , Rama Chellappa , Subhashini Venugopalan

Multimodal representation learning has attracted increasing attention in AI, driven by the strong performance of large, pretrained multimodal foundation models such as Qwen, LLaVA, and CLIP. These models deliver impressive performance on a…

Information Retrieval · Computer Science 2026-05-27 Junchen Fu , Xuri Ge , Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Xi Wang , Qijiong Liu , Qian Li , Joemon M. Jose

Recent advances in large language models have enabled deep research systems that generate expert-level reports through multi-step reasoning and evidence-based synthesis. However, evaluating such reports remains challenging: report quality…

Computation and Language · Computer Science 2026-03-11 Janghoon Han , Heegyu Kim , Changho Lee , Dahm Lee , Min Hyung Park , Hosung Song , Stanley Jungkyu Choi , Moontae Lee , Honglak Lee

Contemporary vision-language models (VLMs) perform well on existing multimodal reasoning benchmarks (78-85\% accuracy on MMMU, MathVista). Yet, these results fail to sufficiently distinguish true scientific reasoning articulation…

Computation and Language · Computer Science 2025-11-13 Arka Mukherjee , Shreya Ghosh

Mathematical geometric reasoning is essential for scientific discovery and educational development, requiring precise logic and rigorous formal verification. While recent advances in Multimodal Large Language Models (MLLMs) have improved…

Artificial Intelligence · Computer Science 2025-08-06 Jingxuan Wei , Caijun Jia , Qi Chen , Honghao He , Linzhuang Sun , Conghui He , Lijun Wu , Bihui Yu , Cheng Tan

Answer verification methods are widely employed in language model training pipelines spanning data curation, evaluation, and reinforcement learning with verifiable rewards (RLVR). While prior work focus on developing unified verifiers…

Machine Learning · Computer Science 2025-12-02 Ruixiang Feng , Zhenwei An , Yuntao Wen , Ran Le , Yiming Jia , Chen Yang , Zongchao Chen , Lisi Chen , Shen Gao , Shuo Shang , Yang Song , Tao Zhang

Evaluating whether multimodal large language models truly understand long-form scientific papers remains challenging: answer-only metrics and synthetic "Needle-In-A-Haystack" tests often reward answer matching without requiring a causal,…

Computation and Language · Computer Science 2026-01-16 Yiming Ren , Junjie Wang , Yuxin Meng , Yihang Shi , Zhiqiang Lin , Ruihang Chu , Yiran Xu , Ziming Li , Yunfei Zhao , Zihan Wang , Yu Qiao , Ruiming Tang , Minghao Liu , Yujiu Yang

IQ testing has served as a foundational methodology for evaluating human cognitive capabilities, deliberately decoupling assessment from linguistic background, language proficiency, or domain-specific knowledge to isolate core competencies…

Artificial Intelligence · Computer Science 2025-06-05 Huanqia Cai , Yijun Yang , Winston Hu

The proliferation of misinformation necessitates scalable, automated fact-checking solutions. Yet, current benchmarks often overlook multilingual and topical diversity. This paper introduces a novel, dynamically extensible data set that…

Computers and Society · Computer Science 2025-10-22 Lorraine Saju , Arnim Bleier , Jana Lasser , Claudia Wagner

Recent advancements in multimodal slow-thinking systems have demonstrated remarkable performance across various visual reasoning tasks. However, their capabilities in text-rich image reasoning tasks remain understudied due to the absence of…

Machine Learning · Computer Science 2026-05-27 Mingxin Huang , Yongxin Shi , Dezhi Peng , Songxuan Lai , Zecheng Xie , Lianwen Jin
‹ Prev 1 8 9 10 Next ›