English
Related papers

Related papers: What Has Been Enhanced in my Knowledge-Enhanced La…

200 papers

Humankind's understanding of the world is fundamentally linked to our perception and cognition, with \emph{human languages} serving as one of the major carriers of \emph{world knowledge}. In this vein, \emph{Large Language Models} (LLMs)…

Artificial Intelligence · Computer Science 2024-06-27 Huajun Chen

Knowledge graphs (KGs) play a crucial role in many applications, such as question answering, but incompleteness is an urgent issue for their broad application. Much research in knowledge graph completion (KGC) has been performed to resolve…

Artificial Intelligence · Computer Science 2023-01-10 Yinyu Lan , Shizhu He , Kang Liu , Jun Zhao

Recent research demonstrates that external knowledge injection can advance pre-trained language models (PLMs) in a variety of downstream NLP tasks. However, existing knowledge injection methods are either applicable to structured knowledge…

Computation and Language · Computer Science 2023-05-08 Deming Ye , Yankai Lin , Zhengyan Zhang , Maosong Sun

Knowledge representation learning has been commonly adopted to incorporate knowledge graph (KG) into various online services. Although existing knowledge representation learning methods have achieved considerable performance improvement,…

Machine Learning · Computer Science 2022-05-18 Binbin Hu , Zhiyang Hu , Zhiqiang Zhang , Jun Zhou , Chuan Shi

Current language models have a significant limitation in the ability to encode and decode factual knowledge. This is mainly because they acquire such knowledge from statistical co-occurrences although most of the knowledge words are rarely…

Computation and Language · Computer Science 2017-03-03 Sungjin Ahn , Heeyoul Choi , Tanel Pärnamaa , Yoshua Bengio

We present a mixed-methods study to explore how large language models (LLMs) can assist users in the visual exploration and analysis of knowledge graphs (KGs). We surveyed and interviewed 20 professionals from industry, government…

Human-Computer Interaction · Computer Science 2024-04-03 Harry Li , Gabriel Appleby , Ashley Suh

In recent years, there has been a resurgence in methods that use distributed (neural) representations to represent and reason about semantic knowledge for robotics applications. However, while robots often observe previously unknown…

Robotics · Computer Science 2021-05-11 Angel Daruna , Mehul Gupta , Mohan Sridharan , Sonia Chernova

Knowledge Graph Completion (KGC) aims at automatically predicting missing links for large-scale knowledge graphs. A vast number of state-of-the-art KGC techniques have got published at top conferences in several research fields, including…

Computation and Language · Computer Science 2020-07-10 Zhiqing Sun , Shikhar Vashishth , Soumya Sanyal , Partha Talukdar , Yiming Yang

Large language models (LLMs) have demonstrated human-level performance on a vast spectrum of natural language tasks. However, it is largely unexplored whether they can better internalize knowledge from a structured data, such as a knowledge…

Computation and Language · Computer Science 2022-05-18 Fedor Moiseev , Zhe Dong , Enrique Alfonseca , Martin Jaggi

Intelligent systems designed using machine learning algorithms require a large number of labeled data. Background knowledge provides complementary, real world factual information that can augment the limited labeled data to train a machine…

Artificial Intelligence · Computer Science 2020-05-12 Shreyansh Bhatt , Amit Sheth , Valerie Shalin , Jinjin Zhao

Recently, commonsense knowledge models - pretrained language models (LM) fine-tuned on knowledge graph (KG) tuples - showed that considerable amounts of commonsense knowledge can be encoded in the parameters of large language models.…

Computation and Language · Computer Science 2021-09-13 Jeff Da , Ronan Le Bras , Ximing Lu , Yejin Choi , Antoine Bosselut

Knowledge Graph Completion (KGC) is crucial for addressing knowledge graph incompleteness and supporting downstream applications. Many models have been proposed for KGC. They can be categorized into two main classes: triple-based and…

Computation and Language · Computer Science 2024-02-26 Yanbin Wei , Qiushi Huang , James T. Kwok , Yu Zhang

Recently, context reasoning using image regions beyond local convolution has shown great potential for scene parsing. In this work, we explore how to incorporate the linguistic knowledge to promote context reasoning over image regions by…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Tianyi Wu , Yu Lu , Yu Zhu , Chuang Zhang , Ming Wu , Zhanyu Ma , Guodong Guo

The goal of representation learning of knowledge graph is to encode both entities and relations into a low-dimensional embedding spaces. Many recent works have demonstrated the benefits of knowledge graph embedding on knowledge graph…

Artificial Intelligence · Computer Science 2019-10-11 Wenqiang Liu , Hongyun Cai , Xu Cheng , Sifa Xie , Yipeng Yu , Hanyu Zhang

Large Language Models (LLMs) demonstrate remarkable capabilities, yet struggle with hallucination and outdated knowledge when tasked with complex knowledge reasoning, resulting in factually incorrect outputs. Previous studies have attempted…

Computation and Language · Computer Science 2025-01-07 Derong Xu , Xinhang Li , Ziheng Zhang , Zhenxi Lin , Zhihong Zhu , Zhi Zheng , Xian Wu , Xiangyu Zhao , Tong Xu , Enhong Chen

Though linguistic knowledge emerges during large-scale language model pretraining, recent work attempt to explicitly incorporate human-defined linguistic priors into task-specific fine-tuning. Infusing language models with syntactic or…

Computation and Language · Computer Science 2022-10-25 Changlong Yu , Tianyi Xiao , Lingpeng Kong , Yangqiu Song , Wilfred Ng

Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider…

Computation and Language · Computer Science 2025-02-14 Liang Yao , Jiazhen Peng , Chengsheng Mao , Yuan Luo

Large Language Models (LLMs) exhibit strong abilities in natural language understanding and generation, yet they struggle with knowledge-intensive reasoning. Structured Knowledge Graphs (KGs) provide an effective form of external knowledge…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Yinan Yu

Knowledge graphs (KGs), as structured representations of real world facts, are intelligent databases incorporating human knowledge that can help machine imitate the way of human problem solving. However, KGs are usually huge and there are…

Machine Learning · Computer Science 2023-06-27 Haotian Li , Hongri Liu , Yao Wang , Guodong Xin , Yuliang Wei

Large language models (LLMs) have demonstrated remarkable proficiency in a range of natural language processing tasks. Once deployed, LLMs encounter users with personalized factual knowledge, and such personalized knowledge is consistently…

Artificial Intelligence · Computer Science 2024-05-31 Jingwei Sun , Zhixu Du , Yiran Chen