English
Related papers

Related papers: Assessing Knowledge Editing in Language Models via…

200 papers

Recent advances in fake news detection have exploited the success of large-scale pre-trained language models (PLMs). The predominant state-of-the-art approaches are based on fine-tuning PLMs on labelled fake news datasets. However,…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Tillman Weyde , Pranava Madhyastha , Nikos Komninos

Large Language Models (LLMs) have been increasingly studied as neural knowledge bases for supporting knowledge-intensive applications such as question answering and fact checking. However, the structural organization of their knowledge…

Machine Learning · Computer Science 2026-01-16 Utkarsh Sahu , Zhisheng Qi , Mahantesh Halappanavar , Nedim Lipka , Ryan A. Rossi , Franck Dernoncourt , Yu Zhang , Yao Ma , Yu Wang

In this paper, we focus on the challenging task of reliably estimating factual knowledge that is embedded inside large language models (LLMs). To avoid reliability concerns with prior approaches, we propose to eliminate prompt engineering…

Text matching is the task of matching two texts and determining the relationship between them, which has extensive applications in natural language processing tasks such as reading comprehension, and Question-Answering systems. The…

Computation and Language · Computer Science 2023-08-14 Kexin Jiang , Yahui Zhao , Guozhe Jin , Zhenguo Zhang , Rongyi Cui

Current approaches of knowledge editing struggle to effectively propagate updates to interconnected facts. In this work, we delve into the barriers that hinder the appropriate propagation of updated knowledge within these models for…

Computation and Language · Computer Science 2024-02-01 Wenyue Hua , Jiang Guo , Mingwen Dong , Henghui Zhu , Patrick Ng , Zhiguo Wang

Large language models (LLMs) have shown remarkable capabilities in various natural language processing tasks, yet they often struggle with maintaining factual accuracy, particularly in knowledge-intensive domains like healthcare. This study…

Computation and Language · Computer Science 2024-11-01 Hieu Tran , Junda Wang , Yujan Ting , Weijing Huang , Terrence Chen

Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider…

Computation and Language · Computer Science 2025-02-14 Liang Yao , Jiazhen Peng , Chengsheng Mao , Yuan Luo

As Federated Learning (FL) has gained increasing attention, it has become widely acknowledged that straightforwardly applying stochastic gradient descent (SGD) on the overall framework when learning over a sequence of tasks results in the…

Machine Learning · Computer Science 2023-06-05 Leijie Wu , Song Guo , Junxiao Wang , Zicong Hong , Jie Zhang , Jingren Zhou

Given varying prompts regarding a factoid question, can a large language model (LLM) reliably generate factually correct answers? Existing LLMs may generate distinct responses for different prompts. In this paper, we study the problem of…

Computation and Language · Computer Science 2023-10-31 Qingxiu Dong , Jingjing Xu , Lingpeng Kong , Zhifang Sui , Lei Li

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

Multi-hop question answering (MQA) is one of the challenging tasks to evaluate machine's comprehension and reasoning abilities, where large language models (LLMs) have widely achieved the human-comparable performance. Due to the dynamics of…

Computation and Language · Computer Science 2024-02-16 Hengrui Gu , Kaixiong Zhou , Xiaotian Han , Ninghao Liu , Ruobing Wang , Xin Wang

Large language models (LLMs) have been used to generate query expansions augmenting original queries for improving information search. Recent studies also explore providing LLMs with initial retrieval results to generate query expansions…

Computation and Language · Computer Science 2025-02-07 Yu Xia , Junda Wu , Sungchul Kim , Tong Yu , Ryan A. Rossi , Haoliang Wang , Julian McAuley

Recently decades have witnessed the empirical success of framing Knowledge Graph (KG) embeddings via language models. However, language model-based KG embeddings are usually deployed as static artifacts, making them difficult to modify…

Computation and Language · Computer Science 2023-12-29 Siyuan Cheng , Ningyu Zhang , Bozhong Tian , Xi Chen , Qingbing Liu , Huajun Chen

The training of large language models (LLMs) necessitates substantial data and computational resources, and updating outdated LLMs entails significant efforts and resources. While numerous model editing techniques (METs) have emerged to…

Computation and Language · Computer Science 2024-02-06 Himanshu Beniwal , Kowsik Nandagopan D , Mayank Singh

Humans excel in analogical learning and knowledge transfer and, more importantly, possess a unique understanding of identifying appropriate sources of knowledge. From a model's perspective, this presents an interesting challenge. If models…

Machine Learning · Computer Science 2026-01-12 Xinhao Zhang , Jinghan Zhang , Fengran Mo , Dongjie Wang , Yanjie Fu , Kunpeng Liu

Robust model-editing techniques are essential for deploying large language models (LLMs) in practical applications, as they enable cost-effective ways to deal with challenges such as privacy breaches, bias mitigation and misinformation…

Machine Learning · Computer Science 2026-01-19 Manit Baser , Dinil Mon Divakaran , Mohan Gurusamy

Knowledge graph embedding (KGE) models are extensively studied for knowledge graph completion, yet their evaluation remains constrained by unrealistic benchmarks. Standard evaluation metrics rely on the closed-world assumption, which…

Machine Learning · Computer Science 2025-06-11 Nasim Shirvani-Mahdavi , Farahnaz Akrami , Chengkai Li

Model editing is a technique that edits the large language models (LLMs) with updated knowledge to alleviate hallucinations without resource-intensive retraining. While current model editing methods can effectively modify a model's behavior…

Computation and Language · Computer Science 2024-10-08 Jia-Chen Gu , Hao-Xiang Xu , Jun-Yu Ma , Pan Lu , Zhen-Hua Ling , Kai-Wei Chang , Nanyun Peng

Recent research has explored methods for updating and modifying factual knowledge in large language models, often focusing on specific multi-layer perceptron blocks. This study expands on this work by examining the effectiveness of existing…

Computation and Language · Computer Science 2025-02-05 Daniel Tamayo , Aitor Gonzalez-Agirre , Javier Hernando , Marta Villegas

Real-world data, such as news articles, social media posts, and chatbot conversations, is inherently dynamic and non-stationary, presenting significant challenges for constructing real-time structured representations through knowledge…

Computation and Language · Computer Science 2025-08-26 Sefika Efeoglu , Adrian Paschke , Sonja Schimmler