English
Related papers

Related papers: Brittleness and Promise: Knowledge Graph Based Rew…

200 papers

Knowledge Graph Retrieval-Augmented Generation (KG-RAG) extends the RAG paradigm by incorporating structured knowledge from knowledge graphs, enabling Large Language Models (LLMs) to perform more precise and explainable reasoning. While…

Computation and Language · Computer Science 2026-02-04 Jing Ren , Bowen Li , Ziqi Xu , Xikun Zhang , Haytham Fayek , Xiaodong Li

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

Computation and Language · Computer Science 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng

Knowledge-intensive tasks pose a significant challenge for Machine Learning (ML) techniques. Commonly adopted methods, such as Large Language Models (LLMs), often exhibit limitations when applied to such tasks. Nevertheless, there have been…

Machine Learning · Computer Science 2024-05-20 Albert Sawczyn , Jakub Binkowski , Piotr Bielak , Tomasz Kajdanowicz

Understanding the uncertainty in large language model (LLM) explanations is important for evaluating their faithfulness and reasoning consistency, and thus provides insights into the reliability of LLM's output regarding a question. In this…

Computation and Language · Computer Science 2025-09-16 Longchao Da , Xiaoou Liu , Jiaxin Dai , Lu Cheng , Yaqing Wang , Hua Wei

Evaluating the open-form textual responses generated by Large Language Models (LLMs) typically requires measuring the semantic similarity of the response to a (human generated) reference. However, there is evidence that current semantic…

Artificial Intelligence · Computer Science 2025-11-26 Qiyao Wei , Edward Morrell , Lea Goetz , Mihaela van der Schaar

Large language models (LLMs) have demonstrated remarkable performance on various medical benchmarks, but their capabilities across different cognitive levels remain underexplored. Inspired by Bloom's Taxonomy, we propose a…

Computation and Language · Computer Science 2025-06-11 Yuxuan Zhou , Xien Liu , Chenwei Yan , Chen Ning , Xiao Zhang , Boxun Li , Xiangling Fu , Shijin Wang , Guoping Hu , Yu Wang , Ji Wu

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others. However, they face a significant challenge: hallucinations,…

Computation and Language · Computer Science 2024-11-22 Ernests Lavrinovics , Russa Biswas , Johannes Bjerva , Katja Hose

Due to the remarkable reasoning ability, Large language models (LLMs) have demonstrated impressive performance in knowledge graph question answering (KGQA) tasks, which find answers to natural language questions over knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-02-25 Xiao Long , Liansheng Zhuang , Aodi Li , Minghong Yao , Shafei Wang

Current Large Language Models (LLMs) can assist developing program code beside many other things, but can they support working with Knowledge Graphs (KGs) as well? Which LLM is offering the best capabilities in the field of Semantic Web and…

Artificial Intelligence · Computer Science 2025-06-03 Lars-Peter Meyer , Johannes Frey , Desiree Heim , Felix Brei , Claus Stadler , Kurt Junghanns , Michael Martin

The automatic construction of knowledge graphs (KGs) is an important research area in medicine, with far-reaching applications spanning drug discovery and clinical trial design. These applications hinge on the accurate identification of…

Computation and Language · Computer Science 2025-01-30 Vahan Arsenyan , Spartak Bughdaryan , Fadi Shaya , Kent Small , Davit Shahnazaryan

Large Language Models (LLMs) have achieved impressive results in various tasks but struggle with hallucination problems and lack of relevant knowledge, especially in deep complex reasoning and knowledge-intensive tasks. Knowledge Graphs…

Computation and Language · Computer Science 2025-03-14 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Wenjie Zhang

Reasoning over knowledge graphs (KGs) with first-order logic (FOL) queries is challenging due to the inherent incompleteness of real-world KGs and the compositional complexity of logical query structures. Most existing methods rely on…

Computation and Language · Computer Science 2025-12-23 Ziyan Zhang , Chao Wang , Zhuo Chen , Lei Chen , Chiyi Li , Kai Song

Recent advancements have witnessed the ascension of Large Language Models (LLMs), endowed with prodigious linguistic capabilities, albeit marred by shortcomings including factual inconsistencies and opacity. Conversely, Knowledge Graphs…

Information Retrieval · Computer Science 2024-07-29 DaiFeng Li , Fan Xu

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

Knowledge graphs (KGs) are the cornerstone of the semantic web, offering up-to-date representations of real-world entities and relations. Yet large language models (LLMs) remain largely static after pre-training, causing their internal…

Computation and Language · Computer Science 2026-03-24 Songlin Zhai , Guilin Qi , Yue Wang , Yuan Meng

Adversarial attacks on knowledge graph embeddings (KGE) aim to disrupt the model's ability of link prediction by removing or inserting triples. A recent black-box method has attempted to incorporate textual and structural information to…

Computation and Language · Computer Science 2025-10-15 Ting Li , Yang Yang , Yipeng Yu , Liang Yao , Guoqing Chao , Ruifeng Xu

Interpretation is critical for disease diagnosis, but existing models struggle to balance predictive accuracy with human-understandable rationales. While large language models (LLMs) offer strong reasoning abilities, their clinical use is…

Computation and Language · Computer Science 2025-07-15 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Yida Xu , Yunya Song , Xian Yang

Despite significant advancements in Large Language Models (LLMs), developing advanced reasoning capabilities in LLMs remains a key challenge. Process Reward Models (PRMs) have demonstrated exceptional promise in enhancing reasoning by…

Computation and Language · Computer Science 2025-06-26 Miao Peng , Nuo Chen , Zongrui Suo , Jia Li

Reward model (RM) plays a pivotal role in reinforcement learning with human feedback (RLHF) for aligning large language models (LLMs). However, classical RMs trained on human preferences are vulnerable to reward hacking and generalize…

Machine Learning · Computer Science 2025-10-24 Zhenghao Xu , Qin Lu , Qingru Zhang , Liang Qiu , Ilgee Hong , Changlong Yu , Wenlin Yao , Yao Liu , Haoming Jiang , Lihong Li , Hyokun Yun , Tuo Zhao

Large Language Models (LLMs) have been extensively adopted in Knowledge Graph Completion (KGC), showcasing significant research advancements. However, as black-box models driven by deep neural architectures, current LLM-based KGC methods…

Computation and Language · Computer Science 2025-10-22 Wenbin Guo , Xin Wang , Jiaoyan Chen , Zhao Li , Zirui Chen