English
Related papers

Related papers: Contextualization Distillation from Large Language…

200 papers

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

Computation and Language · Computer Science 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Knowledge graphs (KGs) serve as fundamental structures for organizing interconnected data across diverse domains. However, most KGs remain incomplete, limiting their effectiveness in downstream applications. Knowledge graph completion (KGC)…

Artificial Intelligence · Computer Science 2025-05-20 Lingzhi Wang , Pengcheng Huang , Haotian Li , Yuliang Wei , Guodong Xin , Rui Zhang , Donglin Zhang , Zhenzhou Ji , Wei Wang

Knowledge infusion is a promising method for enhancing Large Language Models for domain-specific NLP tasks rather than pre-training models over large data from scratch. These augmented LLMs typically depend on additional pre-training or…

Computation and Language · Computer Science 2024-03-05 Kinshuk Vasisht , Balaji Ganesan , Vikas Kumar , Vasudha Bhatnagar

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on…

Computation and Language · Computer Science 2025-09-03 Yu Liu , Yanan Cao , Xixun Lin , Yanmin Shang , Shi Wang , Shirui Pan

In recent years, efforts have been made to use text information for better user profiling and item characterization in recommendations. However, text information can sometimes be of low quality, hindering its effectiveness for real-world…

Artificial Intelligence · Computer Science 2024-02-15 Yingpeng Du , Ziyan Wang , Zhu Sun , Haoyan Chua , Hongzhi Liu , Zhonghai Wu , Yining Ma , Jie Zhang , Youchen Sun

Traditional knowledge graph completion (KGC) methods rely solely on structural information and struggle with sparsity, while Large Language Models (LLMs) address these limitations through rich world knowledge and strong context modeling.…

Computation and Language · Computer Science 2026-01-30 Bo Xue , Yi Xu , Bolei Ma , Yunchong Song , Jiaxin Ding , Luoyi Fu , Xinbing Wang

This paper presents an exhaustive quantitative and qualitative evaluation of Large Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We engage in experiments across eight diverse datasets, focusing on four…

Computation and Language · Computer Science 2024-12-30 Yuqi Zhu , Xiaohan Wang , Jing Chen , Shuofei Qiao , Yixin Ou , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

Knowledge Graphs (KGs) structure real-world entities and their relationships into triples, enhancing machine reasoning for various tasks. While domain-specific KGs offer substantial benefits, their manual construction is often inefficient…

Computation and Language · Computer Science 2025-06-02 Jiaqi Sun , Shiyou Qian , Zhangchi Han , Wei Li , Zelin Qian , Dingyu Yang , Jian Cao , Guangtao Xue

Knowledge graphs (KGs) are the cornerstone of the semantic web, offering up-to-date representations of real-world entities and relations. Yet large language models (LLMs) remain largely static after pre-training, causing their internal…

Computation and Language · Computer Science 2026-03-24 Songlin Zhai , Guilin Qi , Yue Wang , Yuan Meng

In this work, we are interested in automated methods for knowledge graph creation (KGC) from input text. Progress on large language models (LLMs) has prompted a series of recent works applying them to KGC, e.g., via zero/few-shot prompting.…

Computation and Language · Computer Science 2024-10-03 Bowen Zhang , Harold Soh

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Large Language Models (LLMs) have showcased exceptional capabilities in various domains, attracting significant interest from both academia and industry. Despite their impressive performance, the substantial size and computational demands…

Computation and Language · Computer Science 2024-07-03 Chuanpeng Yang , Wang Lu , Yao Zhu , Yidong Wang , Qian Chen , Chenlong Gao , Bingjie Yan , Yiqiang Chen

Both graph structures and textual information play a critical role in Knowledge Graph Completion (KGC). With the success of Pre-trained Language Models (PLMs) such as BERT, they have been applied for text encoding for KGC. However, the…

Computation and Language · Computer Science 2025-01-06 Yuxia Geng , Jiaoyan Chen , Yuhang Zeng , Zhuo Chen , Wen Zhang , Jeff Z. Pan , Yuxiang Wang , Xiaoliang Xu

Modern text-to-vision generative models often hallucinate when the prompt describing the scene to be generated is underspecified. In large language models (LLMs), a prevalent strategy to reduce hallucinations is to retrieve factual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Jinqi Luo , Kwan Ho Ryan Chan , Dimitris Dimos , René Vidal

Post-training endows pretrained LLMs with a variety of desirable skills, including instruction-following, reasoning, and others. However, these post-trained LLMs only encode knowledge up to a cut-off date, necessitating continual…

Computation and Language · Computer Science 2026-02-19 Shankar Padmanabhan , Mustafa Omer Gul , Tanya Goyal

Combining multiple knowledge graphs (KGs) across linguistic boundaries is a persistent challenge due to semantic heterogeneity and the complexity of graph environments. We propose a framework for cross-lingual graph fusion, leveraging the…

Computation and Language · Computer Science 2026-03-24 Kaung Myat Kyaw , Khush Agarwal , Jonathan Chan

The rapid expansion of publicly-available medical data presents a challenge for clinicians and researchers alike, increasing the gap between the volume of scientific literature and its applications. The steady growth of studies and findings…

Artificial Intelligence · Computer Science 2025-08-06 Taine J. Elliott , Stephen P. Levitt , Ken Nixon , Martin Bekker

Pre-trained language models (PLMs) have emerged as powerful tools for code understanding. However, deploying these PLMs in large-scale applications faces practical challenges due to their computational intensity and inference latency.…

Software Engineering · Computer Science 2025-08-22 Ruiqi Wang , Zezhou Yang , Cuiyun Gao , Xin Xia , Qing Liao