中文
相关论文

相关论文: Fact or Guesswork? Evaluating Large Language Model…

200 篇论文

Large Language Models (LLMs) are versatile, yet they often falter in tasks requiring deep and reliable reasoning due to issues like hallucinations, limiting their applicability in critical scenarios. This paper introduces a rigorously…

计算与语言 · 计算机科学 2023-11-21 Saizhuo Wang , Zhihan Liu , Zhaoran Wang , Jian Guo

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-checkers with their…

计算与语言 · 计算机科学 2024-10-31 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Marián Šimko

Evaluating large language models (LLMs) in medicine is crucial because medical applications require high accuracy with little room for error. Current medical benchmarks have three main types: medical exam-based, comprehensive medical, and…

Previous literatures show that pre-trained masked language models (MLMs) such as BERT can achieve competitive factual knowledge extraction performance on some datasets, indicating that MLMs can potentially be a reliable knowledge source. In…

计算与语言 · 计算机科学 2021-06-18 Boxi Cao , Hongyu Lin , Xianpei Han , Le Sun , Lingyong Yan , Meng Liao , Tong Xue , Jin Xu

The automatic generation of medical reports utilizing Multimodal Large Language Models (MLLMs) frequently encounters challenges related to factual instability, which may manifest as the omission of findings or the incorporation of…

计算与语言 · 计算机科学 2026-03-03 Cunyuan Yang , Dejuan Song , Xiaotao Pang , Qianqian Shen , Wenjie Nie , Yifan Huang , Lei Wu , Wei Han , Haishuai Wang , Jiajun Bu

The automatic construction of knowledge graphs (KGs) is an important research area in medicine, with far-reaching applications spanning drug discovery and clinical trial design. These applications hinge on the accurate identification of…

计算与语言 · 计算机科学 2025-01-30 Vahan Arsenyan , Spartak Bughdaryan , Fadi Shaya , Kent Small , Davit Shahnazaryan

Clinical diagnosis is time-consuming, requiring intensive interactions between patients and medical professionals. While large language models (LLMs) could ease the pre-diagnostic workload, their limited domain knowledge hinders effective…

计算与语言 · 计算机科学 2026-03-03 Liwen Sun , Xiang Yu , Ming Tan , Zhuohao Chen , Anqi Cheng , Ashutosh Joshi , Chenyan Xiong

In the face of rapidly expanding online medical literature, automated systems for aggregating and summarizing information are becoming increasingly crucial for healthcare professionals and patients. Large Language Models (LLMs), with their…

计算与语言 · 计算机科学 2024-03-07 Niraj Yagnik , Jay Jhaveri , Vivek Sharma , Gabriel Pila

Structured knowledge bases (KBs) are a foundation of many intelligent applications, yet are notoriously incomplete. Language models (LMs) have recently been proposed for unsupervised knowledge base completion (KBC), yet, despite encouraging…

计算与语言 · 计算机科学 2023-03-21 Blerta Veseli , Sneha Singhania , Simon Razniewski , Gerhard Weikum

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

计算与语言 · 计算机科学 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

Prior research on training grounded factuality classification models to detect hallucinations in large language models (LLMs) has relied on public natural language inference (NLI) data and synthetic data. However, conventional NLI datasets…

计算与语言 · 计算机科学 2025-01-29 Deren Lei , Yaxi Li , Siyao Li , Mengya Hu , Rui Xu , Ken Archer , Mingyu Wang , Emily Ching , Alex Deng

Clinical Decision Support Systems (CDSS) utilize evidence-based knowledge and patient data to offer real-time recommendations, with Large Language Models (LLMs) emerging as a promising tool to generate plain-text explanations for medical…

计算与语言 · 计算机科学 2023-10-04 D. Umerenkov , G. Zubkova , A. Nesterov

Model editing aims to precisely alter the behaviors of large language models (LLMs) in relation to specific knowledge, while leaving unrelated knowledge intact. This approach has proven effective in addressing issues of hallucination and…

计算与语言 · 计算机科学 2024-09-24 Derong Xu , Ziheng Zhang , Zhihong Zhu , Zhenxi Lin , Qidong Liu , Xian Wu , Tong Xu , Wanyu Wang , Yuyang Ye , Xiangyu Zhao , Enhong Chen , Yefeng Zheng

The performance of Large Language Models (LLMs) on multiple-choice question (MCQ) benchmarks is frequently cited as proof of their medical capabilities. We hypothesized that LLM performance on medical MCQs may in part be illusory and driven…

Large language models (LLMs) suffer from the hallucination problem and face significant challenges when applied to knowledge-intensive tasks. A promising approach is to leverage evidence documents as extra supporting knowledge, which can be…

计算与语言 · 计算机科学 2024-04-25 Xinxin Zheng , Feihu Che , Jinyang Wu , Shuai Zhang , Shuai Nie , Kang Liu , Jianhua Tao

Recent studies in medical question answering (Medical QA) have actively explored the integration of large language models (LLMs) with biomedical knowledge graphs (KGs) to improve factual accuracy. However, most existing approaches still…

计算与语言 · 计算机科学 2026-01-15 Chaerin Lee , Sohee Park , Hyunsik Na , Daseon Choi

Methods to ensure factual accuracy of text generated by large language models (LLM) in clinical medicine are lacking. VeriFact is an artificial intelligence system that combines retrieval-augmented generation and LLM-as-a-Judge to verify…

Interpretation is critical for disease diagnosis, but existing models struggle to balance predictive accuracy with human-understandable rationales. While large language models (LLMs) offer strong reasoning abilities, their clinical use is…

计算与语言 · 计算机科学 2025-07-15 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Yida Xu , Yunya Song , Xian Yang

Large language models often expose their brittleness in reasoning tasks, especially while executing long chains of reasoning over context. We propose MemReasoner, a new and simple memory-augmented LLM architecture, in which the memory…

计算与语言 · 计算机科学 2025-03-12 Payel Das , Ching-Yun Ko , Sihui Dai , Georgios Kollias , Subhajit Chaudhury , Aurelie Lozano

Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains a key research area.…

计算与语言 · 计算机科学 2024-08-07 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Jacopo Staiano , Andrea Passerini