English
Related papers

Related papers: Evaluating Large Language Models for Structured Sc…

200 papers

In recent years, the rapid advancement of Large Language Models (LLMs) has transformed the landscape of scientific research, offering unprecedented support across various stages of the research cycle. This paper presents the first…

Computation and Language · Computer Science 2025-01-09 Ziming Luo , Zonglin Yang , Zexin Xu , Wei Yang , Xinya Du

Ontologies are essential for structuring domain knowledge, improving accessibility, sharing, and reuse. However, traditional ontology construction relies on manual annotation and conventional natural language processing (NLP) techniques,…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Ziyu Li , Mu He , Ziyang Ma , Xiaoxu Wu , Gizem Yilmaz , Yiyuan Xia , Bingbing Li , He Tan , Jerry Ying Hsi Fuh , Wen Feng Lu , Anders E. W. Jarfors , Per Jansson

Current Large Language Models (LLMs) can assist developing program code beside many other things, but can they support working with Knowledge Graphs (KGs) as well? Which LLM is offering the best capabilities in the field of Semantic Web and…

Artificial Intelligence · Computer Science 2025-06-03 Lars-Peter Meyer , Johannes Frey , Desiree Heim , Felix Brei , Claus Stadler , Kurt Junghanns , Michael Martin

Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works…

Computation and Language · Computer Science 2024-10-18 Humza Naveed , Asad Ullah Khan , Shi Qiu , Muhammad Saqib , Saeed Anwar , Muhammad Usman , Naveed Akhtar , Nick Barnes , Ajmal Mian

In recent years, knowledge graphs have been integrated into recommender systems as item-side auxiliary information, enhancing recommendation accuracy. However, constructing and integrating structural user-side knowledge remains a…

Information Retrieval · Computer Science 2024-12-19 Zheng Hu , Zhe Li , Ziyun Jiao , Satoshi Nakagawa , Jiawen Deng , Shimin Cai , Tao Zhou , Fuji Ren

The ability to summarize and organize knowledge into abstract concepts is key to learning and reasoning. Many industrial applications rely on the consistent and systematic use of concepts, especially when dealing with decision-critical…

Computation and Language · Computer Science 2024-05-31 Rosario Uceda-Sosa , Karthikeyan Natesan Ramamurthy , Maria Chang , Moninder Singh

With the advent of large language models (LLMs), there is a growing interest in applying LLMs to scientific tasks. In this work, we conduct an experimental study to explore applicability of LLMs for configuring, annotating, translating,…

Human-Computer Interaction · Computer Science 2025-10-13 Orcun Yildiz , Tom Peterka

Metadata play a crucial role in ensuring the findability, accessibility, interoperability, and reusability of datasets. This paper investigates the potential of large language models (LLMs), specifically GPT-4, to improve adherence to…

Artificial Intelligence · Computer Science 2025-02-24 Sowmya S. Sundaram , Benjamin Solomon , Avani Khatri , Anisha Laumas , Purvesh Khatri , Mark A. Musen

Large Language Models (LLMs) are versatile, yet they often falter in tasks requiring deep and reliable reasoning due to issues like hallucinations, limiting their applicability in critical scenarios. This paper introduces a rigorously…

Computation and Language · Computer Science 2023-11-21 Saizhuo Wang , Zhihan Liu , Zhaoran Wang , Jian Guo

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

Large Language Models (LLMs) are increasingly used for tasks involving Knowledge Graphs (KGs), whose evaluation typically focuses on accuracy and output correctness. We propose a complementary task characterization approach using three…

Computation and Language · Computer Science 2025-09-25 Sara Todorovikj , Lars-Peter Meyer , Michael Martin

Given that substantial amounts of domain-specific knowledge are stored in structured formats, such as web data organized through HTML, Large Language Models (LLMs) are expected to fully comprehend this structured information to broaden…

Information Retrieval · Computer Science 2025-02-26 Sirui Huang , Hanqian Li , Yanggan Gu , Xuming Hu , Qing Li , Guandong Xu

The ability of Large Language Models (LLMs) to perform reasoning tasks such as deduction has been widely investigated in recent years. Yet, their capacity to generate proofs-faithful, human-readable explanations of why conclusions…

Artificial Intelligence · Computer Science 2026-01-21 Hui Yang , Jiaoyan Chen , Uli Sattler

As multiple crises threaten the sustainability of our societies and pose at risk the planetary boundaries, complex challenges require timely, updated, and usable information. Natural-language processing (NLP) tools enhance and expand data…

Computers and Society · Computer Science 2025-02-05 Francesca Larosa , Sergio Hoyas , H. Alberto Conejero , Javier Garcia-Martinez , Francesco Fuso Nerini , Ricardo Vinuesa

The conventional process of building Ontologies and Knowledge Graphs (KGs) heavily relies on human domain experts to define entities and relationship types, establish hierarchies, maintain relevance to the domain, fill the ABox (or populate…

Computation and Language · Computer Science 2024-03-14 Vamsi Krishna Kommineni , Birgitta König-Ries , Sheeba Samuel

The recent success of Large Language Models (LLM) in a wide range of Natural Language Processing applications opens the path towards novel Question Answering Systems over Knowledge Graphs leveraging LLMs. However, one of the main obstacles…

Artificial Intelligence · Computer Science 2025-08-26 Julio C. Rangel , Tarcisio Mendes de Farias , Ana Claudia Sima , Norio Kobayashi

Large Language Models (LLMs) have significantly advanced natural language processing (NLP) with their impressive language understanding and generation capabilities. However, their performance may be suboptimal for domain-specific tasks that…

Computation and Language · Computer Science 2023-05-19 Ziyang Luo , Can Xu , Pu Zhao , Xiubo Geng , Chongyang Tao , Jing Ma , Qingwei Lin , Daxin Jiang

Ontology, and more broadly, Knowledge Graph Matching is a challenging task in which expressiveness has not been fully addressed. Despite the increasing use of embeddings and language models for this task, approaches for generating…

Computation and Language · Computer Science 2025-02-20 Guilherme Sousa , Rinaldo Lima , Cassia Trojahn

We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted…

Robotics · Computer Science 2024-05-28 Emily Jensen , Sriram Sankaranarayanan , Bradley Hayes

Large language models (LLMs) have been used to generate query expansions augmenting original queries for improving information search. Recent studies also explore providing LLMs with initial retrieval results to generate query expansions…

Computation and Language · Computer Science 2025-02-07 Yu Xia , Junda Wu , Sungchul Kim , Tong Yu , Ryan A. Rossi , Haoliang Wang , Julian McAuley