English
Related papers

Related papers: Curriculum Approximate Unlearning for Session-base…

200 papers

Large Language Models (LLMs) have demonstrated strong reasoning and memorization capabilities via pretraining on massive textual corpora. However, this poses risk of privacy and copyright violations, highlighting the need for efficient…

Machine Learning · Computer Science 2025-04-28 Sungmin Cha , Sungjun Cho , Dasol Hwang , Moontae Lee

Graph Machine Learning is essential for understanding and analyzing relational data. However, privacy-sensitive applications demand the ability to efficiently remove sensitive information from trained graph neural networks (GNNs), avoiding…

Machine Learning · Computer Science 2025-01-07 Bowen Fan , Yuming Ai , Xunkai Li , Zhilin Guo , Rong-Hua Li , Guoren Wang

Small data learning problems are characterized by a significant discrepancy between the limited amount of response variable observations and the large feature space dimension. In this setting, the common learning tools struggle to identify…

Machine Learning · Computer Science 2023-10-31 Edoardo Vecchi , Davide Bassetti , Fabio Graziato , Lukas Pospisil , Illia Horenko

Large language models (LLMs) trained on unfiltered corpora inherently risk retaining sensitive information, necessitating selective knowledge unlearning for regulatory compliance and ethical safety. However, existing parameter-modifying…

Machine Learning · Computer Science 2026-05-18 Zhaokun Wang , Jinyu Guo , Jingwen Pu , Hongli Pu , Meng Yang , Xunlei Chen , Jie Ou , Wenyi Li , Guangchun Luo , Wenhong Tian

By leveraging data from a fully labeled source domain, unsupervised domain adaptation (UDA) improves classification performance on an unlabeled target domain through explicit discrepancy minimization of data distribution or adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Shengjia Zhang , Tiancheng Lin , Yi Xu

LLM unlearning has emerged as a promising approach, aiming to enable models to forget hazardous/undesired knowledge at low cost while preserving as much model utility as possible. Among existing techniques, the most straightforward method…

Machine Learning · Computer Science 2025-10-28 Zirui Pang , Hao Zheng , Zhijie Deng , Ling Li , Zixin Zhong , Jiaheng Wei

Machine unlearning (MU) enables the removal of selected training data from trained models, to address privacy compliance, security, and liability issues in recommender systems. Existing MU benchmarks poorly reflect real-world recommender…

Information Retrieval · Computer Science 2026-03-10 Pierre Lubitzsch , Maarten de Rijke , Sebastian Schelter

A curriculum is a planned sequence of learning materials and an effective one can make learning efficient and effective for both humans and machines. Recent studies developed effective data-driven curriculum learning approaches for training…

Machine Learning · Computer Science 2023-07-19 Nidhi Vakil , Hadi Amiri

Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techniques like Membership Inference Attacks (MIAs) are widely…

Machine Learning · Computer Science 2025-06-09 Cheng-Long Wang , Qi Li , Zihang Xiang , Yinzhi Cao , Di Wang

Approximate machine unlearning (AMU) enables models to `forget' specific training data through specialized fine-tuning on a retained (and forget) subset of training set. However, processing this large retained subset still dominates…

Machine Learning · Computer Science 2025-08-06 Junaid Iqbal Khan

Unlearning has been proposed to remove copyrighted and privacy-sensitive data from Large Language Models (LLMs). Existing approaches primarily rely on fine-tuning-based methods, which can be categorized into gradient ascent-based (GA-based)…

Machine Learning · Computer Science 2025-03-25 Jie Ren , Zhenwei Dai , Xianfeng Tang , Hui Liu , Jingying Zeng , Zhen Li , Rahul Goutam , Suhang Wang , Yue Xing , Qi He , Hui Liu

Class-incremental learning deals with sequential data streams composed of batches of classes. Various algorithms have been proposed to address the challenging case where samples from past classes cannot be stored. However, selecting an…

Machine Learning · Computer Science 2024-03-28 Eva Feillet , Adrian Popescu , Céline Hudelot

With growing demands for data privacy and model robustness, graph unlearning (GU), which erases the influence of specific data on trained GNN models, has gained significant attention. However, existing exact unlearning methods suffer from…

Machine Learning · Computer Science 2024-10-10 Fan Li , Xiaoyang Wang , Dawei Cheng , Wenjie Zhang , Ying Zhang , Xuemin Lin

Curriculum learning needs example difficulty to proceed from easy to hard. However, the credibility of image difficulty is rarely investigated, which can seriously affect the effectiveness of curricula. In this work, we propose Angular Gap,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Bohua Peng , Mobarakol Islam , Mei Tu

Curriculum learning--ordering training examples in a sequence to aid machine learning--takes inspiration from human learning, but has not gained widespread acceptance. Static strategies for scoring item difficulty rely on indirect proxy…

Machine Learning · Computer Science 2026-03-17 Zhenwei Tang , Amogh Inamdar , Ashton Anderson , Richard Zemel

Graph-based and sequential methods are two popular recommendation paradigms, each excelling in its domain but lacking the ability to leverage signals from the other. To address this, we propose a novel method that integrates both approaches…

Information Retrieval · Computer Science 2025-01-30 Yuwei Cao , Liangwei Yang , Zhiwei Liu , Yuqing Liu , Chen Wang , Yueqing Liang , Hao Peng , Philip S. Yu

LLM have achieved success in many fields but still troubled by problematic content in the training corpora. LLM unlearning aims at reducing their influence and avoid undesirable behaviours. However, existing unlearning methods remain…

Computation and Language · Computer Science 2024-08-21 Hongbang Yuan , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Recent advancements in deep models have highlighted the need for intelligent systems that combine continual learning (CL) for knowledge acquisition with machine unlearning (MU) for data removal, forming the Continual Learning-Unlearning…

Machine Learning · Computer Science 2025-05-22 Zhehao Huang , Xinwen Cheng , Jie Zhang , Jinghao Zheng , Haoran Wang , Zhengbao He , Tao Li , Xiaolin Huang

We propose an adaptation of the curriculum training framework, applicable to state-of-the-art meta learning techniques for few-shot classification. Curriculum-based training popularly attempts to mimic human learning by progressively…

Machine Learning · Computer Science 2021-12-07 Emmanouil Stergiadis , Priyanka Agrawal , Oliver Squire

As large language models (LLMs) are increasingly deployed in real-world systems, they must support post-hoc removal of specific content to meet privacy and governance requirements. This motivates selective unlearning, which suppresses…

Computation and Language · Computer Science 2026-05-28 Chenchen Tan , Xinghao Li , Shujie Cui , Youyang Qu , Cunjian Chen , Longxiang Gao