English
Related papers

Related papers: Towards Effective Evaluations and Comparisons for …

200 papers

Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in knowledge unlearning involve updating LLM parameters to erase…

Computation and Language · Computer Science 2024-10-08 Bozhong Tian , Xiaozhuan Liang , Siyuan Cheng , Qingbin Liu , Mengru Wang , Dianbo Sui , Xi Chen , Huajun Chen , Ningyu Zhang

While Large Language Models (LLMs) have demonstrated impressive performance in various domains and tasks, concerns about their safety are becoming increasingly severe. In particular, since models may store unsafe knowledge internally,…

Machine Learning · Computer Science 2025-08-22 Chengcan Wu , Zeming Wei , Huanran Chen , Yinpeng Dong , Meng Sun

There have been a couple of studies showing that attempting to erase multilingual knowledge using only English data is insufficient for multilingual LLMs. However, their analyses remain highly performance-oriented. In this paper, we switch…

Computation and Language · Computer Science 2025-10-29 Kyomin Hwang , Hyeonjin Kim , Seungyeon Kim , Sunghyun Wee , Nojun Kwak

The proliferation of open-source Large Language Models (LLMs) from various institutions has highlighted the urgent need for comprehensive evaluation methods. However, current evaluation platforms, such as the widely recognized HuggingFace…

Computation and Language · Computer Science 2024-11-01 Fanghua Ye , Mingming Yang , Jianhui Pang , Longyue Wang , Derek F. Wong , Emine Yilmaz , Shuming Shi , Zhaopeng Tu

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. Although extensive research has focused on developing efficient machine…

Machine Learning · Computer Science 2026-01-13 Heng Xu , Tianqing Zhu , Dayong Ye , Lefeng Zhang , Le Wang , Wanlei Zhou

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

Human-Computer Interaction · Computer Science 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

As privacy concerns escalate in the realm of machine learning, data owners now have the option to utilize machine unlearning to remove their data from machine learning models, following recent legislation. To enhance transparency in machine…

Machine Learning · Computer Science 2026-04-23 Binchi Zhang , Zihan Chen , Cong Shen , Jundong Li

Machine unlearning aims to selectively remove targeted knowledge from Large Language Models (LLMs), ensuring they forget specified content while retaining essential information. Existing unlearning metrics assess whether a model correctly…

Computation and Language · Computer Science 2025-05-28 Wonje Jeung , Sangyeon Yoon , Albert No

As the Large Language Model (LLM) gains widespread adoption, increasing attention has been given to the challenge of making LLM forget non-compliant data memorized during its pre-training. Machine Unlearning focuses on efficiently erasing…

Computation and Language · Computer Science 2025-08-19 Yujian Sun , Tian Li

As large language models (LLMs) are increasingly deployed across various applications, privacy and copyright concerns have heightened the need for more effective LLM unlearning techniques. Many existing unlearning methods aim to suppress…

Computation and Language · Computer Science 2025-09-22 Tomoya Yamashita , Akira Ito , Yuuki Yamanaka , Masanori Yamada , Takayuki Miura , Toshiki Shibahara

Machine learning components are now central to AI-infused software systems, from recommendations and code assistants to clinical decision support. As regulations and governance frameworks increasingly require deleting sensitive data from…

Machine Learning · Computer Science 2026-04-21 Anna Mazhar , Sainyam Galhotra

Large language Models (LLMs) have demonstrated remarkable skills across various domains. Understanding the mechanisms behind their abilities and implementing controls over them is becoming increasingly important for developing better…

Computation and Language · Computer Science 2025-04-01 Yongce Li , Chung-En Sun , Tsui-Wei Weng

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Cryptography and Security · Computer Science 2025-06-03 Jie Ren , Zhenwei Dai , Xianfeng Tang , Yue Xing , Shenglai Zeng , Hui Liu , Jingying Zeng , Qiankun Peng , Samarth Varshney , Suhang Wang , Qi He , Charu C. Aggarwal , Hui Liu

Machine unlearning aims to remove the influence of specific training data from pre-trained models without retraining from scratch, and is increasingly important for large language models (LLMs) due to safety, privacy, and legal concerns.…

Computation and Language · Computer Science 2026-03-17 Ruihao Pan , Suhang Wang

Large language model (LLM) unlearning has demonstrated effectiveness in removing the influence of undesirable data (also known as forget data). Existing approaches typically assume full access to the forget dataset, overlooking two key…

Computation and Language · Computer Science 2025-09-19 Linxi Xie , Xin Teng , Shichang Ke , Hongyi Wen , Shengjie Wang

Large Language Models (LLMs) have recently gained significant attention due to their remarkable capabilities in performing diverse tasks across various domains. However, a thorough evaluation of these models is crucial before deploying them…

Machine unlearning (MU) is gaining increasing attention due to the need to remove or modify predictions made by machine learning (ML) models. While training models have become more efficient and accurate, the importance of unlearning…

Machine Learning · Computer Science 2024-10-28 Thanveer Shaik , Xiaohui Tao , Haoran Xie , Lin Li , Xiaofeng Zhu , Qing Li

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

Computation and Language · Computer Science 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

Existing benchmarks for evaluating mathematical reasoning in large language models (LLMs) rely primarily on competition problems, formal proofs, or artificially challenging questions -- failing to capture the nature of mathematics…

Artificial Intelligence · Computer Science 2025-10-21 Jie Zhang , Cezara Petrui , Kristina Nikolić , Florian Tramèr

The rapid advancement of Large Language Models (LLMs) has opened new avenues in education. This study examines the use of LLMs in supporting learning in machine learning education; in particular, it focuses on the ability of LLMs to…

Computers and Society · Computer Science 2025-05-27 Smitha Kumar , Michael A. Lones , Manuel Maarek , Hind Zantout