English
Related papers

Related papers: HOLMES: Hyper-Relational Knowledge Graphs for Mult…

200 papers

Knowledge infusion is a promising method for enhancing Large Language Models for domain-specific NLP tasks rather than pre-training models over large data from scratch. These augmented LLMs typically depend on additional pre-training or…

Computation and Language · Computer Science 2024-03-05 Kinshuk Vasisht , Balaji Ganesan , Vikas Kumar , Vasudha Bhatnagar

Large language models appear to learn facts from the large text corpora they are trained on. Such facts are encoded implicitly within their many parameters, making it difficult to verify or manipulate what knowledge has been learned.…

Computation and Language · Computer Science 2022-10-27 Yifan Hou , Wenxiang Jiao , Meizhen Liu , Carl Allen , Zhaopeng Tu , Mrinmaya Sachan

Retrieval-Augmented Generation (RAG) has significantly mitigated the hallucinations of Large Language Models (LLMs) by grounding the generation with external knowledge. Recent extensions of RAG to graph-based retrieval offer a promising…

Machine Learning · Computer Science 2025-09-23 Jialin Chen , Houyu Zhang , Seongjun Yun , Alejandro Mottini , Rex Ying , Xiang Song , Vassilis N. Ioannidis , Zheng Li , Qingjun Cui

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

Computation and Language · Computer Science 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan

Recent advancements in Large Language Models (LLMs) have showcased their proficiency in answering natural language queries. However, their effectiveness is hindered by limited domain-specific knowledge, raising concerns about the…

Recent work has shown the capability of Large Language Models (LLMs) to solve tasks related to Knowledge Graphs, such as Knowledge Graph Completion, even in Zero- or Few-Shot paradigms. However, they are known to hallucinate answers, or…

Computation and Language · Computer Science 2024-07-19 Vasile Ionut Remus Iga , Gheorghe Cosmin Silaghi

LLM post-training has primarily relied on large text corpora and human feedback, without capturing the structure of domain knowledge. This has caused models to struggle dealing with complex reasoning tasks, especially for high-stakes…

Computation and Language · Computer Science 2026-01-21 Dezhao Song , Guglielmo Bonifazi , Frank Schilder , Jonathan Richard Schwarz

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others. However, they face a significant challenge: hallucinations,…

Computation and Language · Computer Science 2024-11-22 Ernests Lavrinovics , Russa Biswas , Johannes Bjerva , Katja Hose

Recent advances in retrieval-augmented generation (RAG) furnish large language models (LLMs) with iterative retrievals of relevant information to handle complex multi-hop questions. These methods typically alternate between LLM reasoning…

Computation and Language · Computer Science 2025-05-27 Rui Li , Quanyu Dai , Zeyu Zhang , Xu Chen , Zhenhua Dong , Ji-Rong Wen

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Autoregressive large language models (LLMs) pre-trained by next token prediction are inherently proficient in generative tasks. However, their performance on knowledge-driven tasks such as factual knowledge querying remains unsatisfactory.…

Computation and Language · Computer Science 2026-01-14 Peng Yu , Cheng Deng , Beiya Dai , Xinbing Wang , Ying Wen

Disconnected data silos within enterprises obstruct the extraction of actionable insights, diminishing efficiency in areas such as product development, client engagement, meeting preparation, and analytics-driven decision-making. This paper…

Artificial Intelligence · Computer Science 2025-03-12 Rajeev Kumar , Kumar Ishan , Harishankar Kumar , Abhinandan Singla

Large Language Models (LLMs) have achieved impressive results in various tasks but struggle with hallucination problems and lack of relevant knowledge, especially in deep complex reasoning and knowledge-intensive tasks. Knowledge Graphs…

Computation and Language · Computer Science 2025-03-14 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Wenjie Zhang

The ability to summarize and organize knowledge into abstract concepts is key to learning and reasoning. Many industrial applications rely on the consistent and systematic use of concepts, especially when dealing with decision-critical…

Computation and Language · Computer Science 2024-05-31 Rosario Uceda-Sosa , Karthikeyan Natesan Ramamurthy , Maria Chang , Moninder Singh

Multi-hop question answering (MHQA) poses a significant challenge for large language models (LLMs) due to the extensive knowledge demands involved. Knowledge editing, which aims to precisely modify the LLMs to incorporate specific knowledge…

Computation and Language · Computer Science 2024-12-30 Yifan Lu , Yigeng Zhou , Jing Li , Yequan Wang , Xuebo Liu , Daojing He , Fangming Liu , Min Zhang

In real-world scenarios, most of the data obtained from the information retrieval (IR) system is unstructured. Converting natural language sentences into structured Knowledge Graphs (KGs) remains a critical challenge. We identified three…

Computation and Language · Computer Science 2025-09-29 Haoyu Huang , Chong Chen , Zeang Sheng , Yang Li , Wentao Zhang

Conversational question answering (convQA) over knowledge graphs (KGs) involves answering multi-turn natural language questions about information contained in a KG. State-of-the-art methods of ConvQA often struggle with inexplicit…

Computation and Language · Computer Science 2024-04-01 Lihui Liu , Blaine Hill , Boxin Du , Fei Wang , Hanghang Tong

Retrieval-Augmented Generation (RAG) systems enable large language models (LLMs) instant access to relevant information for the generative process, demonstrating their superior performance in addressing common LLM challenges such as…

Computation and Language · Computer Science 2025-10-17 Yilun Zheng , Dan Yang , Jie Li , Lin Shang , Lihui Chen , Jiahao Xu , Sitao Luan

Knowledge Graph Question Answering (KGQA) aims to answer user-questions from a knowledge graph (KG) by identifying the reasoning relations between topic entity and answer. As a complex branch task of KGQA, multi-hop KGQA requires reasoning…

Computation and Language · Computer Science 2022-11-15 Weiqiang Jin , Biao Zhao , Hang Yu , Xi Tao , Ruiping Yin , Guizhong Liu

Knowledge Graphs (KGs) have long served as a fundamental infrastructure for structured knowledge representation and reasoning. With the advent of Large Language Models (LLMs), the construction of KGs has entered a new paradigm-shifting from…

Artificial Intelligence · Computer Science 2025-10-24 Haonan Bian