中文
相关论文

相关论文: Assessing Automated Fact-Checking for Medical LLM …

200 篇论文

Knowledge graphs (KGs) are large datasets with specific structures representing large knowledge bases (KB) where each node represents a key entity and relations amongst them are typed edges. Natural language queries formed to extract…

人工智能 · 计算机科学 2024-05-01 Abir Chakraborty

We introduce fs1, a simple yet effective method that improves the factuality of reasoning traces by collecting them from large reasoning models and grounding them in knowledge graph (KG) paths. We fine-tune eight instruction-tuned Large…

计算与语言 · 计算机科学 2026-04-21 Mike Zhang , Johannes Bjerva , Russa Biswas

We present LinkQ, a system that leverages a large language model (LLM) to facilitate knowledge graph (KG) query construction through natural language question-answering. Traditional approaches often require detailed knowledge of a graph…

计算与语言 · 计算机科学 2025-02-11 Harry Li , Gabriel Appleby , Ashley Suh

Large Language Models (LLMs) succeed in many natural language processing tasks. However, their tendency to hallucinate - generate plausible but inconsistent or factually incorrect text - can cause significant problems in certain tasks,…

计算与语言 · 计算机科学 2025-08-08 Xiangyan Chen , Yujian Gan , Yimeng Gu , Matthew Purver

Large Language Models (LLMs) might hallucinate facts, while curated Knowledge Graph (KGs) are typically factually reliable especially with domain-specific knowledge. Measuring the alignment between KGs and LLMs can effectively probe the…

人工智能 · 计算机科学 2024-08-02 Shangshang Zheng , He Bai , Yizhe Zhang , Yi Su , Xiaochuan Niu , Navdeep Jaitly

Evaluating large language models (LLMs) for tasks like fact extraction in support of knowledge graph construction frequently involves computing accuracy metrics using a ground truth benchmark based on a knowledge graph (KG). These…

计算与语言 · 计算机科学 2025-02-06 Bradley P. Allen , Paul T. Groth

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

人工智能 · 计算机科学 2023-09-12 Chang Liu , Bo Wu

Medical question-answering (QA) is a critical task for evaluating how effectively large language models (LLMs) encode clinical knowledge and assessing their potential applications in medicine. Despite showing promise on multiple-choice…

计算与语言 · 计算机科学 2025-03-06 Guangfu Guo , Kai Zhang , Bryan Hoo , Yujun Cai , Xiaoqian Lu , Nanyun Peng , Yiwei Wang

Causal reasoning capabilities are essential for large language models (LLMs) in a wide range of applications, such as education and healthcare. But there is still a lack of benchmarks for a better understanding of such capabilities. Current…

计算与语言 · 计算机科学 2024-12-25 Ruibo Tu , Hedvig Kjellström , Gustav Eje Henter , Cheng Zhang

When we integrate factual knowledge from knowledge graphs (KGs) into large language models (LLMs) to enhance their performance, the cost of injection through training increases with the scale of the models. Consequently, there is…

计算与语言 · 计算机科学 2025-01-24 Xinbang Dai , Yuncheng Hua , Tongtong Wu , Yang Sheng , Qiu Ji , Guilin Qi

Question answering is a natural language understanding task that involves reasoning over both explicit context, and unstated relevant domain knowledge. Despite the high cost of training, large language models (LLMs) -- the backbone of most…

计算与语言 · 计算机科学 2025-04-24 Laura Cabello , Carmen Martin-Turrero , Uchenna Akujuobi , Anders Søgaard , Carlos Bobed

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-checkers with their…

计算与语言 · 计算机科学 2024-10-31 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Marián Šimko

An effective and efficient review of construction contracts is essential for minimizing construction projects losses, but current methods are time-consuming and error-prone. Studies using methods based on Natural Language Processing (NLP)…

人工智能 · 计算机科学 2025-05-20 Chunmo Zheng , Saika Wong , Xing Su , Yinqiu Tang , Ahsan Nawaz , Mohamad Kassem

Knowledge graph (KG) embedding has been used to benefit the diagnosis of animal diseases by analyzing electronic medical records (EMRs), such as notes and veterinary records. However, learning representations to capture entities and…

人工智能 · 计算机科学 2023-09-08 Van Thuy Hoang , Sang Thanh Nguyen , Sangmyeong Lee , Jooho Lee , Luong Vuong Nguyen , O-Joun Lee

Knowledge graphs (KGs) are the cornerstone of the semantic web, offering up-to-date representations of real-world entities and relations. Yet large language models (LLMs) remain largely static after pre-training, causing their internal…

计算与语言 · 计算机科学 2026-03-24 Songlin Zhai , Guilin Qi , Yue Wang , Yuan Meng

In recent years, the introduction of knowledge graphs (KGs) has significantly advanced recommender systems by facilitating the discovery of potential associations between items. However, existing methods still face several limitations.…

信息检索 · 计算机科学 2025-04-18 Ziqiang Cui , Yunpeng Weng , Xing Tang , Fuyuan Lyu , Dugang Liu , Xiuqiang He , Chen Ma

Knowledge Graphs (KGs) can serve as reliable knowledge sources for question answering (QA) due to their structured representation of knowledge. Existing research on the utilization of KG for large language models (LLMs) prevalently relies…

计算与语言 · 计算机科学 2024-10-25 Kun Li , Tianhua Zhang , Xixin Wu , Hongyin Luo , James Glass , Helen Meng

Recent advances in Large Language Models (LLMs) have positioned them as a prominent solution for Natural Language Processing tasks. Notably, they can approach these problems in a zero or few-shot manner, thereby eliminating the need for…

机器学习 · 计算机科学 2025-05-07 Gerard Pons , Besim Bilalli , Anna Queralt

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

计算与语言 · 计算机科学 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are…