English
Related papers

Related papers: Towards Ontology-Enhanced Representation Learning …

200 papers

Knowledge sharing is crucial in healthcare, especially when leveraging data from multiple clinical sites to address data scarcity, reduce costs, and enable timely interventions. Transfer learning can facilitate cross-site knowledge…

Computation and Language · Computer Science 2024-09-24 Yuhe Gao , Runxue Bao , Yuelyu Ji , Yiming Sun , Chenxi Song , Jeffrey P. Ferraro , Ye Ye

Word embeddings have been shown adept at capturing the semantic and syntactic regularities of the natural language text, as a result of which these representations have found their utility in a wide variety of downstream content analysis…

Computation and Language · Computer Science 2021-03-02 Kishlay Jha

This paper investigates techniques for knowledge injection into word embeddings learned from large corpora of unannotated data. These representations are trained with word cooccurrence statistics and do not commonly exploit syntactic and…

Computation and Language · Computer Science 2020-10-06 Diego Ramirez-Echavarria , Antonis Bikakis , Luke Dickens , Rob Miller , Andreas Vlachidis

Ontology Matching (OM) is a cornerstone task of semantic interoperability, yet existing systems often rely on handcrafted rules or specialized models with limited adaptability. We present KROMA, a novel OM framework that harnesses Large…

Artificial Intelligence · Computer Science 2025-09-12 Lam Nguyen , Erika Barcelos , Roger French , Yinghui Wu

We tackle the task of enriching ontologies by automatically translating natural language sentences into Description Logic. Since Large Language Models (LLMs) are the best tools for translations, we fine-tuned a GPT-3 model to convert…

Artificial Intelligence · Computer Science 2023-08-01 Patricia Mateiu , Adrian Groza

Ontological Knowledge Bases (OKBs) play a vital role in structuring domain-specific knowledge and serve as a foundation for effective knowledge management systems. However, their traditional manual development poses significant challenges…

Information Retrieval · Computer Science 2026-03-16 Le Ngoc Luyen , Marie-Hélène Abel , Philippe Gouspillou

Pre-trained language models (PLMs) have proven to be effective for document re-ranking task. However, they lack the ability to fully interpret the semantics of biomedical and health-care queries and often rely on simplistic patterns for…

Computation and Language · Computer Science 2023-05-09 Deepak Gupta , Dina Demner-Fushman

Knowledge infusion is a promising method for enhancing Large Language Models for domain-specific NLP tasks rather than pre-training models over large data from scratch. These augmented LLMs typically depend on additional pre-training or…

Computation and Language · Computer Science 2024-03-05 Kinshuk Vasisht , Balaji Ganesan , Vikas Kumar , Vasudha Bhatnagar

Pre-trained language models (PLMs) were considered to be able to store relational knowledge present in the training data. However, some relational knowledge seems to be discarded unsafely in PLMs due to \textbf{report bias}: low-frequency…

Computation and Language · Computer Science 2023-05-25 Hongbo Zhang , Xiang Wan , Benyou Wang

Lifestyle support through robotics is an increasingly promising field, with expectations for robots to take over or assist with chores like floor cleaning, table setting and clearing, and fetching items. The growth of AI, particularly…

Robotics · Computer Science 2024-10-23 Haru Nakajima , Jun Miura

Large Language Models (LLMs) have shown remarkable capabilities across various domains, yet they struggle with knowledge-intensive tasks in areas that demand factual accuracy, e.g. industrial automation and healthcare. Key limitations…

Machine Learning · Computer Science 2025-09-10 Michael Banf , Johannes Kuhn

Large Language Models bear the promise of significant acceleration of key Knowledge Graph and Ontology Engineering tasks, including ontology modeling, extension, modification, population, alignment, as well as entity disambiguation. We lay…

Artificial Intelligence · Computer Science 2024-11-15 Cogan Shimizu , Pascal Hitzler

Ontologies often lack explicit disjointness declarations between classes, despite their usefulness for sophisticated reasoning and consistency checking in Knowledge Graphs. In this study, we explore the potential of Large Language Models…

Artificial Intelligence · Computer Science 2024-12-03 Elias Crum , Antonio De Santis , Manon Ovide , Jiaxin Pan , Alessia Pisu , Nicolas Lazzari , Sebastian Rudolph

Tools to explore scientific literature are essential for scientists, especially in biomedicine, where about a million new papers are published every year. Many such tools provide users the ability to search for specific entities (e.g.…

Computation and Language · Computer Science 2021-07-05 Sunil Mohan , Rico Angell , Nick Monath , Andrew McCallum

Ontology alignment, a critical process in the Semantic Web for detecting relationships between different ontologies, has traditionally focused on identifying so-called "simple" 1-to-1 relationships through class labels and properties…

Artificial Intelligence · Computer Science 2024-07-24 Reihaneh Amini , Sanaz Saki Norouzi , Pascal Hitzler , Reza Amini

Having a unified, coherent taxonomy is essential for effective knowledge representation in domain-specific applications as diverse terminologies need to be mapped to underlying concepts. Traditional manual approaches to taxonomy alignment…

Large Language Models (LLMs) have shown significant potential for ontology engineering. However, it is still unclear to what extent they are applicable to the task of domain-specific ontology generation. In this study, we explore the…

Large Language Models (LLMs) exploit fine-tuning as a technique to adapt to diverse goals, thanks to task-specific training data. Task specificity should go hand in hand with domain orientation, that is, the specialization of an LLM to…

Computation and Language · Computer Science 2023-09-20 Teodoro Baldazzi , Luigi Bellomarini , Stefano Ceri , Andrea Colombo , Andrea Gentili , Emanuel Sallinger

Background. Endowing intelligent systems with semantic data commonly requires designing and instantiating ontologies with domain-specific knowledge. Especially in the early phases, those activities are typically performed manually by human…

Artificial Intelligence · Computer Science 2025-01-24 Giovanni Ciatto , Andrea Agiollo , Matteo Magnini , Andrea Omicini

Large Language Models (LLMs) have demonstrated remarkable performance across diverse natural language processing tasks, yet their ability to memorize structured knowledge remains underexplored. In this paper, we investigate the extent to…

Computation and Language · Computer Science 2025-04-02 Marco Bombieri , Paolo Fiorini , Simone Paolo Ponzetto , Marco Rospocher