中文
相关论文

相关论文: MuSciClaims: Multimodal Scientific Claim Verificat…

200 篇论文

Multimodal symbolic logical reasoning, which aims to deduce new facts from multimodal input via formal logic, is critical in high-stakes applications such as autonomous driving and medical diagnosis, as its rigorous, deterministic reasoning…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Jundong Xu , Hao Fei , Yuhui Zhang , Liangming Pan , Qijun Huang , Qian Liu , Preslav Nakov , Min-Yen Kan , William Yang Wang , Mong-Li Lee , Wynne Hsu

Deep models that are both effective and explainable are desirable in many settings; prior explainable models have been unimodal, offering either image-based visualization of attention weights or text-based generation of post-hoc…

Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal…

Verifying scientific claims presents a significantly greater challenge than verifying political or news-related claims. Unlike the relatively broad audience for political claims, the users of scientific claim verification systems can vary…

计算与语言 · 计算机科学 2025-02-17 Sujit Kumar , Anshul Sharma , Siddharth Hemant Khincha , Gargi Shroff , Sanasam Ranbir Singh , Rahul Mishra

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Scientific fact-checking aims to determine the veracity of scientific claims by retrieving and analysing evidence from research literature. The problem is inherently more complex than general fact-checking since it must accommodate the…

信息检索 · 计算机科学 2025-08-18 Xingyu Deng , Xi Wang , Mark Stevenson

Health-related misinformation claims often falsely cite a credible biomedical publication as evidence. These publications only superficially seem to support the false claim, when logical fallacies are applied. In this work, we aim to detect…

计算与语言 · 计算机科学 2025-02-10 Max Glockner , Yufang Hou , Preslav Nakov , Iryna Gurevych

In multimodal misinformation, deception usually arises not just from pixel-level manipulations in an image, but from the semantic and contextual claim jointly expressed by the image-text pair. Yet most deepfake detectors, engineered to…

计算机视觉与模式识别 · 计算机科学 2026-02-03 A S M Sharifuzzaman Sagar , Mohammed Bennamoun , Farid Boussaid , Naeha Sharif , Lian Xu , Shaaban Sahmoud , Ali Kishk

Scientific figure interpretation is a crucial capability for AI-driven scientific assistants built on advanced Large Vision Language Models. However, current datasets and benchmarks primarily focus on simple charts or other relatively…

Unified multimodal models aim to jointly enable visual understanding and generation, yet current benchmarks rarely examine their true integration. Existing evaluations either treat the two abilities in isolation or overlook tasks that…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Kai Zou , Ziqi Huang , Yuhao Dong , Shulin Tian , Dian Zheng , Hongbo Liu , Jingwen He , Bin Liu , Yu Qiao , Ziwei Liu

Mechanistic interpretability papers increasingly use causal vocabulary: circuits, mediators, causal abstraction, monosemanticity. Such claims require explicit identification assumptions. A purposive audit of 10 papers across four…

机器学习 · 计算机科学 2026-05-11 Zezheng Lin , Fengming Liu

As large language models (LLMs) transition from general knowledge retrieval to complex scientific discovery, their evaluation standards must also incorporate the rigorous norms of scientific inquiry. Existing benchmarks exhibit a critical…

This paper describes SciClops, a method to help combat online scientific misinformation. Although automated fact-checking methods have gained significant attention recently, they require pre-existing ground-truth evidence, which, in the…

计算与语言 · 计算机科学 2021-10-26 Panayiotis Smeros , Carlos Castillo , Karl Aberer

With the rapid progress of Multimodal LLMs, evaluating their mathematical reasoning capabilities has become an increasingly important research direction. In particular, visual-textual mathematical reasoning serves as a key indicator of an…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Hao Liang , Linzhuang Sun , Minxuan Zhou , Zirong Chen , Meiyi Qiang , Mingan Lin , Tianpeng Li , Fan Yang , Zenan Zhou , Wentao Zhang

We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that SUPPORTS or REFUTES a given scientific claim, and to identify rationales justifying each decision. To study…

计算与语言 · 计算机科学 2020-10-06 David Wadden , Shanchuan Lin , Kyle Lo , Lucy Lu Wang , Madeleine van Zuylen , Arman Cohan , Hannaneh Hajishirzi

Automated fact-checking has drawn considerable attention over the past few decades due to the increase in the diffusion of misinformation on online platforms. This is often carried out as a sequence of tasks comprising (i) the detection of…

计算与语言 · 计算机科学 2024-03-27 Rrubaa Panchendrarajan , Arkaitz Zubiaga

Multimodal Large Language Models demonstrate strong performance on multimodal benchmarks, yet often exhibit poor robustness when exposed to spurious modality interference, such as irrelevant text in vision understanding, or irrelevant…

机器学习 · 计算机科学 2026-01-30 Rui Cai , Bangzheng Li , Xiaofei Wen , Muhao Chen , Zhe Zhao

Multimodal Large Language Models (MLLMs) have demonstrated significant advances across numerous vision-language tasks. MLLMs have shown promising capability in aligning visual and textual modalities, allowing them to process image-text…

计算与语言 · 计算机科学 2025-09-29 Xiaolong Wang , Zhaolu Kang , Wangyuxuan Zhai , Xinyue Lou , Yunghwei Lai , Ziyue Wang , Yawen Wang , Kaiyu Huang , Yile Wang , Peng Li , Yang Liu

Current multimodal benchmarks often conflate reasoning with domain-specific knowledge, making it difficult to isolate and evaluate general reasoning abilities in non-expert settings. To address this, we introduce VisualPuzzles, a benchmark…

计算与语言 · 计算机科学 2025-05-01 Yueqi Song , Tianyue Ou , Yibo Kong , Zecheng Li , Graham Neubig , Xiang Yue

Verification of biomedical claims is critical for healthcare decision-making, public health policy and scientific research. We present an interactive biomedical claim verification system by integrating LLMs, transparent model explanations,…

人机交互 · 计算机科学 2025-03-03 Siting Liang , Daniel Sonntag