English
Related papers

Related papers: Large Language Models Assisting Ontology Evaluatio…

200 papers

Background. Endowing intelligent systems with semantic data commonly requires designing and instantiating ontologies with domain-specific knowledge. Especially in the early phases, those activities are typically performed manually by human…

Artificial Intelligence · Computer Science 2025-01-24 Giovanni Ciatto , Andrea Agiollo , Matteo Magnini , Andrea Omicini

Ontology (and more generally: Knowledge Graph) Matching is a challenging task where information in natural language is one of the most important signals to process. With the rise of Large Language Models, it is possible to incorporate this…

Information Retrieval · Computer Science 2023-11-08 Sven Hertling , Heiko Paulheim

Ontology matching (OM) plays a key role in enabling data interoperability and knowledge sharing, but it remains challenging due to the need for large training datasets and limited vocabulary processing in machine learning approaches.…

Information Retrieval · Computer Science 2025-03-28 Maria Taboada , Diego Martinez , Mohammed Arideh , Rosa Mosquera

Large Language Models (LLMs) have garnered considerable attention owing to their remarkable capabilities, leading to an increasing number of companies offering LLMs as services. Different LLMs achieve different performance at different…

Software Engineering · Computer Science 2024-05-27 Yueyue Liu , Hongyu Zhang , Yuantian Miao , Van-Hoang Le , Zhiqiang Li

The National Vulnerability Database (NVD) publishes over a thousand new vulnerabilities monthly, with a projected 25 percent increase in 2024, highlighting the crucial need for rapid vulnerability identification to mitigate cybersecurity…

Computation and Language · Computer Science 2025-02-25 Rikhiya Ghosh , Hans-Martin von Stockhausen , Martin Schmitt , George Marica Vasile , Sanjeev Kumar Karn , Oladimeji Farri

Ontologies provide formal representation of knowledge shared within Semantic Web applications. Ontology learning involves the construction of ontologies from a given corpus. In the past years, ontology learning has traversed through shallow…

Information Retrieval · Computer Science 2024-06-18 Rick Du , Huilong An , Keyu Wang , Weidong Liu

Large Language Models (LLMs) increasingly support culturally sensitive decision making, yet often exhibit misalignment due to skewed pretraining data and the absence of structured value representations. Existing methods can steer outputs,…

Computation and Language · Computer Science 2026-02-02 Wonduk Seo , Wonseok Choi , Junseo Koh , Juhyeon Lee , Hyunjin An , Minhyeong Yu , Jian Park , Qingshan Zhou , Seunghyun Lee , Yi Bu

Qualitative analysis of textual contents unpacks rich and valuable information by assigning labels to the data. However, this process is often labor-intensive, particularly when working with large datasets. While recent AI-based tools…

Computation and Language · Computer Science 2023-04-24 Ziang Xiao , Xingdi Yuan , Q. Vera Liao , Rania Abdelghani , Pierre-Yves Oudeyer

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

Computation and Language · Computer Science 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

The rapid evolution of large language models (LLMs) has pushed their boundaries to many applications in various domains. Recently, the research community has started to evaluate their potential adoption in autonomous vehicles and especially…

Robotics · Computer Science 2025-09-09 Petros Loukas , David Bassir , Savvas Chatzichristofis , Angelos Amanatiadis

Computerized Evaluation of English Essays is performed using Machine learning techniques like Latent Semantic Analysis (LSA), Generalized LSA, Bilingual Evaluation Understudy and Maximum Entropy. Ontology, a concept map of domain knowledge,…

Artificial Intelligence · Computer Science 2016-05-10 M. Syamala Devi , Himani Mittal

Progress in AI is often demonstrated by new models claiming improved performance on tasks measuring model capabilities. Evaluating language models can be particularly challenging, as choices of how a model is evaluated on a task can lead to…

Computation and Language · Computer Science 2025-02-12 Yuling Gu , Oyvind Tafjord , Bailey Kuehl , Dany Haddad , Jesse Dodge , Hannaneh Hajishirzi

Large Language Models bear the promise of significant acceleration of key Knowledge Graph and Ontology Engineering tasks, including ontology modeling, extension, modification, population, alignment, as well as entity disambiguation. We lay…

Artificial Intelligence · Computer Science 2024-11-15 Cogan Shimizu , Pascal Hitzler

Conversational agents based on Large Language Models (LLMs) have recently emerged as powerful tools for human-computer interaction. Nevertheless, their black-box nature implies challenges in predictability and a lack of personalization,…

Computation and Language · Computer Science 2026-04-07 Barbara Gendron , Gaël Guibon , Mathieu d'Aquin

Large language models (LLMs) can potentially help with verification using proof assistants by automating proofs. However, it is unclear how effective LLMs are in this task. In this paper, we perform a case study based on two mature Rocq…

Programming Languages · Computer Science 2025-08-27 Barış Bayazıt , Yao Li , Xujie Si

Query understanding is essential in modern relevance systems, where user queries are often short, ambiguous, and highly context-dependent. Traditional approaches often rely on multiple task-specific Named Entity Recognition models to…

Information Retrieval · Computer Science 2025-09-15 Ping Liu , Jianqiang Shen , Qianqi Shen , Chunnan Yao , Kevin Kao , Dan Xu , Rajat Arora , Baofen Zheng , Caleb Johnson , Liangjie Hong , Jingwei Wu , Wenjing Zhang

This article analyzes the use of Large Language Models (LLMs) as support for the conceptual modeling of relational databases through the automatic generation of Entity-Relationship (ER) diagrams from natural language requirements. The…

Artificial Intelligence · Computer Science 2026-05-13 Arthur F. Siqueira , Carlos D. S. Nogueira , Eduarda Farias , Claudio E. C. Campelo , Júlia Menezes

Ontologies have become essential in today's digital age as a way of organising the vast amount of readily available unstructured text. In providing formal structure to this information, ontologies have immense value and application across…

Computation and Language · Computer Science 2025-11-11 Dekai Zhang , Simone Conia , Antonio Rago

Ontology engineering (OE) in large projects poses a number of challenges arising from the heterogeneous backgrounds of the various stakeholders, domain experts, and their complex interactions with ontology designers. This multi-party…

The conventional process of building Ontologies and Knowledge Graphs (KGs) heavily relies on human domain experts to define entities and relationship types, establish hierarchies, maintain relevance to the domain, fill the ABox (or populate…

Computation and Language · Computer Science 2024-03-14 Vamsi Krishna Kommineni , Birgitta König-Ries , Sheeba Samuel