English
Related papers

Related papers: GraphMERT: Efficient and Scalable Distillation of …

200 papers

Knowledge representation learning has been commonly adopted to incorporate knowledge graph (KG) into various online services. Although existing knowledge representation learning methods have achieved considerable performance improvement,…

Machine Learning · Computer Science 2022-05-18 Binbin Hu , Zhiyang Hu , Zhiqiang Zhang , Jun Zhou , Chuan Shi

Large language models (LLMs) have demonstrated impressive reasoning abilities in complex tasks. However, they lack up-to-date knowledge and experience hallucinations during reasoning, which can lead to incorrect reasoning processes and…

Computation and Language · Computer Science 2024-02-27 Linhao Luo , Yuan-Fang Li , Gholamreza Haffari , Shirui Pan

This chapter delves into the emerging field of neuro-symbolic query optimization for knowledge graphs (KGs), presenting a comprehensive exploration of how neural and symbolic techniques can be integrated to enhance query processing.…

Databases · Computer Science 2024-11-22 Maribel Acosta , Chang Qin , Tim Schwabe

Foundation models excel at language, where sentences become tokens, and vision, where images become pixels, because both reduce to discrete symbols on a shared, fixed grid. Knowledge Graphs share the discreteness, but not the geometry.…

Artificial Intelligence · Computer Science 2026-05-08 Kossi Amouzouvi , Robert Wardenga , Jens Lehmann , Sahar Vahdati

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

We challenge black-box purely deep neural approaches for molecules and graph generation, which are limited in controllability and lack formal guarantees. We introduce Neuro-Symbolic Graph Generative Modeling (NSGGM), a neurosymbolic…

Machine Learning · Computer Science 2026-02-25 Chuqin Geng , Li Zhang , Mark Zhang , Haolin Ye , Ziyu Zhao , Xujie Si

Large language models (LLMs) are increasingly used in the mental health domain, yet it remains unclear how well they capture related biomedical knowledge and how reliably they apply it to clinically salient structured judgments. Here, we…

Computation and Language · Computer Science 2026-05-18 Weixin Liu , Congning Ni , Shelagh A. Mulvaney , Susannah L. Rose , Murat Kantarcioglu , Bradley A. Malin , Zhijun Yin

Large language models (LLMs) have demonstrated impressive reasoning abilities, but they still struggle with faithful reasoning due to knowledge gaps and hallucinations. To address these issues, knowledge graphs (KGs) have been utilized to…

Computation and Language · Computer Science 2025-05-29 Linhao Luo , Zicheng Zhao , Gholamreza Haffari , Yuan-Fang Li , Chen Gong , Shirui Pan

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

Machine Learning · Computer Science 2025-05-13 Erica Coppolillo

Large Language Models (LLMs) provide flexible natural language processing capabilities, while knowledge graphs (KGs) offer explicit and structured knowledge. Integrating these two in a complementary manner enables the development of…

Computation and Language · Computer Science 2026-05-12 Shusaku Egami , Aoi Ohta , Tomoki Tsujimura , Masaki Asada , Tatsuya Ishigaki , Ken Fukuda , Masahiro Hamasaki , Hiroya Takamura

Evaluating the open-form textual responses generated by Large Language Models (LLMs) typically requires measuring the semantic similarity of the response to a (human generated) reference. However, there is evidence that current semantic…

Artificial Intelligence · Computer Science 2025-11-26 Qiyao Wei , Edward Morrell , Lea Goetz , Mihaela van der Schaar

Humankind's understanding of the world is fundamentally linked to our perception and cognition, with \emph{human languages} serving as one of the major carriers of \emph{world knowledge}. In this vein, \emph{Large Language Models} (LLMs)…

Artificial Intelligence · Computer Science 2024-06-27 Huajun Chen

Currently, the main approach for Large Language Models (LLMs) to tackle the hallucination issue is incorporating Knowledge Graphs(KGs).However, LLMs typically treat KGs as plain text, extracting only semantic information and limiting their…

Computation and Language · Computer Science 2025-09-29 Yifang Zhang , Pengfei Duan , Yiwen Yang , Shengwu Xiong

Knowledge graphs (KGs) have recently been used for many tools and applications, making them rich resources in structured format. However, in the real world, KGs grow due to the additions of new knowledge in the form of entities and…

Artificial Intelligence · Computer Science 2024-09-10 Mehwish Alam , Genet Asefa Gesese , Pierre-Henri Paris

In recent years, Natural Language Processing (NLP) has played a significant role in various Artificial Intelligence (AI) applications such as chatbots, text generation, and language translation. The emergence of large language models (LLMs)…

Computation and Language · Computer Science 2024-07-10 Amanda Kau , Xuzeng He , Aishwarya Nambissan , Aland Astudillo , Hui Yin , Amir Aryani

Large language models (LLMs) have achieved remarkable performance in natural language understanding and generation tasks. However, they often suffer from limitations such as difficulty in incorporating new knowledge, generating…

Artificial Intelligence · Computer Science 2024-03-05 Yilin Wen , Zifeng Wang , Jimeng Sun

The rapid expansion of medical literature presents growing challenges for structuring and integrating domain knowledge at scale. Knowledge Graphs (KGs) offer a promising solution by enabling efficient retrieval, automated reasoning, and…

Computation and Language · Computer Science 2025-08-20 Duzhen Zhang , Zixiao Wang , Zhong-Zhi Li , Yahan Yu , Shuncheng Jia , Jiahua Dong , Haotian Xu , Xing Wu , Yingying Zhang , Tielin Zhang , Jie Yang , Xiuying Chen , Le Song

Knowledge Graphs (KGs) have proven essential in information processing and reasoning applications because they link related entities and give context-rich information, supporting efficient information retrieval and knowledge discovery;…

Computation and Language · Computer Science 2024-06-06 Azmine Toushik Wasi , Taki Hasan Rafi , Raima Islam , Dong-Kyu Chae

Reasoning over temporal knowledge graphs (TKGs) is fundamental to improving the efficiency and reliability of intelligent decision-making systems and has become a key technological foundation for future artificial intelligence applications.…

Computation and Language · Computer Science 2026-01-05 Wang Xing , Wei Song , Siyu Lin , Chen Wu , Zhesi Li , Man Wang

Knowledge graphs (KGs), as structured representations of real world facts, are intelligent databases incorporating human knowledge that can help machine imitate the way of human problem solving. However, KGs are usually huge and there are…

Machine Learning · Computer Science 2023-06-27 Haotian Li , Hongri Liu , Yao Wang , Guodong Xin , Yuliang Wei