English
Related papers

Related papers: Developing a Scalable Benchmark for Assessing Larg…

200 papers

In this paper, we investigate the retrieval-augmented generation (RAG) based on Knowledge Graphs (KGs) to improve the accuracy and reliability of Large Language Models (LLMs). Recent approaches suffer from insufficient and repetitive…

Computation and Language · Computer Science 2024-04-22 Xinke Jiang , Ruizhe Zhang , Yongxin Xu , Rihong Qiu , Yue Fang , Zhiyuan Wang , Jinyi Tang , Hongxin Ding , Xu Chu , Junfeng Zhao , Yasha Wang

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n…

Computation and Language · Computer Science 2023-11-17 Tilahun Abedissa Taffa , Ricardo Usbeck

Large Language Models (LLMs) are rapidly becoming ubiquitous both as stand-alone tools and as components of current and future software systems. To enable usage of LLMs in the high-stake or safety-critical systems of 2030, they need to…

Software Engineering · Computer Science 2024-06-13 Sinclair Hudson , Sophia Jit , Boyue Caroline Hu , Marsha Chechik

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Zhao Li , Xiao Ding , Xindong Wu

Developments in Graph-Language Models (GLMs) aim to integrate the structural reasoning capabilities of Graph Neural Networks (GNNs) with the semantic understanding of Large Language Models (LLMs). However, we demonstrate that current…

Computation and Language · Computer Science 2025-08-29 Soham Petkar , Hari Aakash K , Anirudh Vempati , Akshit Sinha , Ponnurangam Kumarauguru , Chirag Agarwal

Benchmarking the capabilities and limitations of large language models (LLMs) in graph-related tasks is becoming an increasingly popular and crucial area of research. Recent studies have shown that LLMs exhibit a preliminary ability to…

Machine Learning · Computer Science 2025-04-22 Xinnan Dai , Haohao Qu , Yifen Shen , Bohang Zhang , Qihao Wen , Wenqi Fan , Dongsheng Li , Jiliang Tang , Caihua Shan

Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches. However, existing…

Computation and Language · Computer Science 2025-10-14 Wenbin Guo , Xin Wang , Jiaoyan Chen , Lingbing Guo , Zhao Li , Zirui Chen

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others. However, they face a significant challenge: hallucinations,…

Computation and Language · Computer Science 2024-11-22 Ernests Lavrinovics , Russa Biswas , Johannes Bjerva , Katja Hose

Traditional knowledge graph completion (KGC) methods rely solely on structural information and struggle with sparsity, while Large Language Models (LLMs) address these limitations through rich world knowledge and strong context modeling.…

Computation and Language · Computer Science 2026-01-30 Bo Xue , Yi Xu , Bolei Ma , Yunchong Song , Jiaxin Ding , Luoyi Fu , Xinbing Wang

Recent advancements in Large Language Models (LLMs) have showcased their proficiency in answering natural language queries. However, their effectiveness is hindered by limited domain-specific knowledge, raising concerns about the…

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

The increasing complexity of large language models (LLMs) raises concerns about their ability to "cheat" on standard Question Answering (QA) benchmarks by memorizing task-specific data. This undermines the validity of benchmark evaluations,…

Computation and Language · Computer Science 2025-09-16 Yixiong Fang , Tianran Sun , Yuling Shi , Min Wang , Xiaodong Gu

Large Language Models (LLMs) have shown impressive performance in various tasks, including knowledge graph completion (KGC). However, current studies mostly apply LLMs to classification tasks, like identifying missing triplets, rather than…

Artificial Intelligence · Computer Science 2025-01-07 Zaiyi Zheng , Yushun Dong , Song Wang , Haochen Liu , Qi Wang , Jundong Li

Large-scale pre-trained language models (PLMs) such as BERT have recently achieved great success and become a milestone in natural language processing (NLP). It is now the consensus of the NLP community to adopt PLMs as the backbone for…

Computation and Language · Computer Science 2023-03-21 Nan Hu , Yike Wu , Guilin Qi , Dehai Min , Jiaoyan Chen , Jeff Z. Pan , Zafar Ali

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

The emergence of large language models (LLMs) has revolutionized the way we interact with graphs, leading to a new paradigm called GraphLLM. Despite the rapid development of GraphLLM methods in recent years, the progress and understanding…

Machine Learning · Computer Science 2024-10-30 Yuhan Li , Peisong Wang , Xiao Zhu , Aochuan Chen , Haiyun Jiang , Deng Cai , Victor Wai Kin Chan , Jia Li

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

Computation and Language · Computer Science 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

Large language models (LLMs) have demonstrated impressive reasoning abilities yet remain unreliable on knowledge-intensive, multi-hop questions -- they miss long-tail facts, hallucinate when uncertain, and their internal knowledge lags…

Computation and Language · Computer Science 2025-10-13 Jia Ao Sun , Hao Yu , Fabrizio Gotti , Fengran Mo , Yihong Wu , Yuchen Hui , Jian-Yun Nie

Optimization benchmarks play a fundamental role in assessing algorithm performance; however, existing artificial benchmarks often fail to capture the diversity and irregularity of real-world problem structures, while benchmarks derived from…

Neural and Evolutionary Computing · Computer Science 2026-01-26 Yuhiro Ono , Tomohiro Harada , Yukiya Miura

Reasoning over knowledge graphs (KGs) is a challenging task that requires a deep understanding of the complex relationships between entities and the underlying logic of their relations. Current approaches rely on learning geometries to…

Logic in Computer Science · Computer Science 2024-04-02 Nurendra Choudhary , Chandan K. Reddy