English
Related papers

Related papers: Easy Data Unlearning Bench

200 papers

Machine unlearning offers effective solutions for revoking the influence of specific training data on pre-trained model parameters. While existing approaches address unlearning for classification and generative models, they overlook an…

Machine Learning · Computer Science 2025-08-19 Yihan Wang , Yiwei Lu , Guojun Zhang , Franziska Boenisch , Adam Dziedzic , Yaoliang Yu , Xiao-Shan Gao

Large language models (LLMs) have advanced to encompass extensive knowledge across diverse domains. Yet controlling what a large language model should not know is important for ensuring alignment and thus safe use. However, accurately and…

Computation and Language · Computer Science 2024-11-01 Chris Yuhao Liu , Yaxuan Wang , Jeffrey Flanigan , Yang Liu

The growing enforcement of the right to be forgotten regulations has propelled recent advances in certified (graph) unlearning strategies to comply with data removal requests from deployed machine learning (ML) models. Motivated by the…

Machine Learning · Computer Science 2025-05-22 O. Deniz Kose , Gonzalo Mateos , Yanning Shen

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

Large language models (LLMs) are increasingly deployed in real-world applications, raising concerns about the unauthorized use of copyrighted or sensitive data. Machine unlearning aims to remove such 'forget' data while preserving utility…

Computation and Language · Computer Science 2025-06-03 Wonje Jeung , Sangyeon Yoon , Hyesoo Hong , Soeun Kim , Seungju Han , Youngjae Yu , Albert No

Benchmarking and establishing proper statistical validation metrics for reinforcement learning (RL) remain ongoing challenges, where no consensus has been established yet. The emergence of quantum computing and its potential applications in…

Large language models (LLMs) are prone to hallucination stemming from misaligned self-awareness, particularly when processing queries exceeding their knowledge boundaries. While existing mitigation strategies employ uncertainty estimation…

Computation and Language · Computer Science 2025-10-10 Hang Zheng , Hongshen Xu , Yuncong Liu , Lu Chen , Pascale Fung , Kai Yu

With the passage of the Right to Be Forgotten (RTBF) regulations and the scaling up of language model training datasets, research on model unlearning in large language models (LLMs) has become more crucial. Before the era of LLMs, machine…

Computation and Language · Computer Science 2024-06-05 Bichen Wang , Yuzhe Zi , Yixin Sun , Yanyan Zhao , Bing Qin

Current techniques for post-training Large Language Models (LLMs) rely either on costly human supervision or on external verifiers to boost performance on tasks such as mathematical reasoning and code generation. However, as LLMs improve…

Computation and Language · Computer Science 2026-01-21 Mukesh Ghimire , Aosong Feng , Liwen You , Youzhi Luo , Fang Liu , Xuan Zhu

The rapid proliferation of benchmarks for evaluating large language models (LLMs) has created an urgent need for systematic methods to assess benchmark quality itself. We propose Benchmark^2, a comprehensive framework comprising three…

Machine unlearning poses challenges in removing mislabeled, contaminated, or problematic data from a pretrained model. Current unlearning approaches and evaluation metrics are solely focused on model predictions, which limits insight into…

Machine Learning · Computer Science 2026-04-13 Khoa Tran , Simon S. Woo

This paper presents an online learning with regularized kernel based one-class extreme learning machine (ELM) classifier and is referred as online RK-OC-ELM. The baseline kernel hyperplane model considers whole data in a single chunk with…

Machine Learning · Computer Science 2018-04-10 Chandan Gautam , Aruna Tiwari , Sundaram Suresh , Kapil Ahuja

As large language models (LLMs) continue to advance, the need for up-to-date and well-organized benchmarks becomes increasingly critical. However, many existing datasets are scattered, difficult to manage, and make it challenging to perform…

Machine Learning · Computer Science 2025-06-03 Eunsu Kim , Haneul Yoo , Guijin Son , Hitesh Patel , Amit Agarwal , Alice Oh

Large language models deployed in sensitive applications increasingly require the ability to unlearn specific knowledge, such as user requests, copyrighted materials, or outdated information, without retraining from scratch to ensure…

Machine Learning · Computer Science 2026-05-05 Sadia Asif , Mohammad Mohammadi Amiri

Real-world categorization is severely hampered by class imbalance because traditional ensembles favor majority classes, which lowers minority performance and overall F1-score. We provide a unique ensemble technique for imbalanced problems…

Computation and Language · Computer Science 2026-04-14 Mohamed Ehab , Ali Hamdi , Khaled Shaban

Recent advancements in deep models have highlighted the need for intelligent systems that combine continual learning (CL) for knowledge acquisition with machine unlearning (MU) for data removal, forming the Continual Learning-Unlearning…

Machine Learning · Computer Science 2025-05-22 Zhehao Huang , Xinwen Cheng , Jie Zhang , Jinghao Zheng , Haoran Wang , Zhengbao He , Tao Li , Xiaolin Huang

When introducing Large Language Models (LLMs) into industrial applications, such as healthcare and education, the risk of generating harmful content becomes a significant challenge. While existing machine unlearning methods can erase…

Computation and Language · Computer Science 2026-04-08 Mutsumi Sasaki , Kouta Nakayama , Yusuke Miyao , Yohei Oseki , Masaru Isonuma

Recent advancements in LLMs unlearning have shown remarkable success in removing unwanted data-model influences while preserving the model's utility for legitimate knowledge. Despite these strides, sparse Mixture-of-Experts (MoE) LLMs--a…

Machine Learning · Computer Science 2025-07-01 Haomin Zhuang , Yihua Zhang , Kehan Guo , Jinghan Jia , Gaowen Liu , Sijia Liu , Xiangliang Zhang

The emergence of large language models (LLMs) has sparked enormous interest due to their potential application across a range of educational tasks. For example, recent work in programming education has used LLMs to generate learning…

Software Engineering · Computer Science 2024-05-10 Charles Koutcheme , Nicola Dainese , Sami Sarsa , Juho Leinonen , Arto Hellas , Paul Denny

Machine Unlearning is an emerging paradigm for selectively removing the impact of training datapoints from a network. Unlike existing methods that target a limited subset or a single class, our framework unlearns all classes in a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Samuele Poppi , Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara