English
Related papers

Related papers: A Benchmark to Understand the Role of Knowledge Gr…

200 papers

Large Language Models (LLMs) are increasingly used for tasks involving Knowledge Graphs (KGs), whose evaluation typically focuses on accuracy and output correctness. We propose a complementary task characterization approach using three…

Computation and Language · Computer Science 2025-09-25 Sara Todorovikj , Lars-Peter Meyer , Michael Martin

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

Computation and Language · Computer Science 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan

Improving the performance of large language models (LLMs) in complex question-answering (QA) scenarios has always been a research focal point. Recent studies have attempted to enhance LLMs' performance by combining step-wise planning with…

Computation and Language · Computer Science 2024-10-24 Junjie Wang , Mingyang Chen , Binbin Hu , Dan Yang , Ziqi Liu , Yue Shen , Peng Wei , Zhiqiang Zhang , Jinjie Gu , Jun Zhou , Jeff Z. Pan , Wen Zhang , Huajun Chen

Zero-shot visual question answering (ZS-VQA), an emerged critical research area, intends to answer visual questions without providing training samples. Existing research in ZS-VQA has proposed to leverage knowledge graphs or large language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Tao , Xiaoyang Fan , Yong Xu , Xingquan Zhu , Yufei Tang

While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored. Particularly, using LLMs for complex reasoning tasks on…

Computation and Language · Computer Science 2023-10-18 Jiho Kim , Yeonsu Kwon , Yohan Jo , Edward Choi

Schema matching is a critical task in data integration, particularly in the medical domain where disparate Electronic Health Record (EHR) systems must be aligned to standard models like OMOP CDM. While Large Language Models (LLMs) have…

Artificial Intelligence · Computer Science 2025-12-02 Mingyu Jeon , Jaeyoung Suh , Suwan Cho

Large language models like GPT-4, Gemini, and Claude have transformed natural language processing (NLP) tasks such as question answering, dialogue generation, summarization, and so forth; yet their susceptibility to hallucination stands as…

Computation and Language · Computer Science 2025-07-21 Nur A Zarin Nishat , Andrea Coletta , Luigi Bellomarini , Kossi Amouzouvi , Jens Lehmann , Sahar Vahdati

LLM-based agents for industrial asset operations show limited accuracy when reasoning over flat document stores. AssetOpsBench (KDD 2026) establishes that GPT-4 agents achieve 65% on 139 industrial maintenance scenarios backed by CouchDB,…

Databases · Computer Science 2026-05-27 Madhulatha Mandarapu , Sandeep Kunkunuru

Large Language Models are now key assistants in human decision-making processes. However, a common note always seems to follow: "LLMs can make mistakes. Be careful with important info." This points to the reality that not all outputs from…

Computation and Language · Computer Science 2025-05-16 Longchao Da , Parth Mitesh Shah , Kuan-Ru Liou , Jiaxing Zhang , Hua Wei

The recent success of Large Language Models (LLM) in a wide range of Natural Language Processing applications opens the path towards novel Question Answering Systems over Knowledge Graphs leveraging LLMs. However, one of the main obstacles…

Artificial Intelligence · Computer Science 2025-08-26 Julio C. Rangel , Tarcisio Mendes de Farias , Ana Claudia Sima , Norio Kobayashi

Disconnected data silos within enterprises obstruct the extraction of actionable insights, diminishing efficiency in areas such as product development, client engagement, meeting preparation, and analytics-driven decision-making. This paper…

Artificial Intelligence · Computer Science 2025-03-12 Rajeev Kumar , Kumar Ishan , Harishankar Kumar , Abhinandan Singla

Electronic Health Records (EHRs) and routine documentation practices play a vital role in patients' daily care, providing a holistic record of health, diagnoses, and treatment. However, complex and verbose EHR narratives overload healthcare…

Computation and Language · Computer Science 2025-02-26 Yanjun Gao , Ruizhe Li , Emma Croxford , John Caskey , Brian W Patterson , Matthew Churpek , Timothy Miller , Dmitriy Dligach , Majid Afshar

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on…

Computation and Language · Computer Science 2025-09-03 Yu Liu , Yanan Cao , Xixun Lin , Yanmin Shang , Shi Wang , Shirui Pan

Current Large Language Models (LLMs) can assist developing program code beside many other things, but can they support working with Knowledge Graphs (KGs) as well? Which LLM is offering the best capabilities in the field of Semantic Web and…

Artificial Intelligence · Computer Science 2025-06-03 Lars-Peter Meyer , Johannes Frey , Desiree Heim , Felix Brei , Claus Stadler , Kurt Junghanns , Michael Martin

Question answering is a natural language understanding task that involves reasoning over both explicit context, and unstated relevant domain knowledge. Despite the high cost of training, large language models (LLMs) -- the backbone of most…

Computation and Language · Computer Science 2025-04-24 Laura Cabello , Carmen Martin-Turrero , Uchenna Akujuobi , Anders Søgaard , Carlos Bobed

With the recent spike in the number and availability of Large Language Models (LLMs), it has become increasingly important to provide large and realistic benchmarks for evaluating Knowledge Graph Question Answering (KGQA) systems. So far…

Computation and Language · Computer Science 2024-02-08 Catherine Kosten , Philippe Cudré-Mauroux , Kurt Stockinger

Large language models (LLMs) are increasingly used in the mental health domain, yet it remains unclear how well they capture related biomedical knowledge and how reliably they apply it to clinically salient structured judgments. Here, we…

Computation and Language · Computer Science 2026-05-18 Weixin Liu , Congning Ni , Shelagh A. Mulvaney , Susannah L. Rose , Murat Kantarcioglu , Bradley A. Malin , Zhijun Yin

The recent proliferation of large language models (LLMs) holds the potential to revolutionize healthcare, with strong capabilities in diverse medical tasks. Yet, deploying LLMs in high-stakes healthcare settings requires rigorous…

Machine Learning · Computer Science 2025-12-22 Shasha Zhou , Mingyu Huang , Jack Cole , Charles Britton , Ming Yin , Jan Wolber , Ke Li

This survey investigates the synergistic relationship between Large Language Models (LLMs) and Knowledge Graphs (KGs), which is crucial for advancing AI's capabilities in understanding, reasoning, and language processing. It aims to address…

Large Language Models (LLMs) have shown remarkable progress in medical question answering (QA), yet their effectiveness remains predominantly limited to English due to imbalanced multilingual training data and scarce medical resources for…