中文
相关论文

相关论文: Continual Forgetting for Pre-trained Vision Models

200 篇论文

As large language models (LLMs) are increasingly deployed across various applications, privacy and copyright concerns have heightened the need for more effective LLM unlearning techniques. Many existing unlearning methods aim to suppress…

计算与语言 · 计算机科学 2025-09-22 Tomoya Yamashita , Akira Ito , Yuuki Yamanaka , Masanori Yamada , Takayuki Miura , Toshiki Shibahara

Machine unlearning in foundation models (e.g., language and vision transformers) is essential for privacy and safety; however, existing approaches are unstable and unreliable. A widely used strategy, the gradient difference method, applies…

机器学习 · 计算机科学 2026-03-19 Arpit Garg , Hemanth Saratchandran , Ravi Garg , Simon Lucey

Large Language Model (LLM) unlearning has recently gained significant attention, driven by the need to remove unwanted information, such as private, sensitive, or copyrighted content, from LLMs. However, conventional unlearning approaches…

计算与语言 · 计算机科学 2025-06-03 Yixin Wan , Anil Ramakrishna , Kai-Wei Chang , Volkan Cevher , Rahul Gupta

The availability of large amounts of user-provided data has been key to the success of machine learning for many real-world tasks. Recently, an increasing awareness has emerged that users should be given more control about how their data is…

机器学习 · 计算机科学 2021-07-09 Alexandra Peste , Dan Alistarh , Christoph H. Lampert

The rapid proliferation of image generation models and other artificial intelligence (AI) systems has intensified concerns regarding data privacy and user consent. As the availability of public datasets declines, major technology companies…

The inability to filter out in advance all potentially problematic data from the pre-training of large language models has given rise to the need for methods for unlearning specific pieces of knowledge after training. Existing techniques…

计算与语言 · 计算机科学 2026-04-17 Seyun Bae , Seokhan Lee , Eunho Yang

Vision-Language-Action~(VLA) models have shown strong potential for general-purpose robotic manipulation, yet they still struggle to generalize to unseen tasks that necessitate transferring relevant experience across objects, scenes, and…

机器人学 · 计算机科学 2026-05-29 Shengyu Si , Yuanzhuo Lu , Ruimeng Yang , Ziyi Ye , Zuxuan Wu , Yu-Gang Jiang

State-of-the-art diffusion models often rely on parameter-efficient fine-tuning to perform specialized image editing tasks. However, real-world applications require continual adaptation to new tasks while preserving previously learned…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Yuehao Liu , Weijia Zhang , Xuanming Shang , Zhizhou Chen , Yanhao Ge , Shanyan Guan , Chao Ma

During pretraining, LLMs inadvertently memorize sensitive or copyrighted data, posing significant compliance challenges under legal frameworks like the GDPR and the EU AI Act. Fulfilling these mandates demands techniques that can remove…

机器学习 · 计算机科学 2026-03-23 Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

Large Language Models (LLMs) often suffer from catastrophic forgetting and collapse during sequential knowledge editing. This vulnerability stems from the prevailing dense editing paradigm, which treats models as black boxes and relies on…

人工智能 · 计算机科学 2026-03-17 Yuhuan Liu , Haitian Zhong , Xinyuan Xia , Qiang Liu , Shu Wu , Liang Wang

Person re-identification is best known as the problem of associating a single person that is observed from one or more disjoint cameras. The existing literature has mainly addressed such an issue, neglecting the fact that people usually…

计算机视觉与模式识别 · 计算机科学 2017-07-31 Giuseppe Lisanti , Niki Martinel , Alberto Del Bimbo , Gian Luca Foresti

Users have the right to have their data deleted by third-party learned systems, as codified by recent legislation such as the General Data Protection Regulation (GDPR) and the California Consumer Privacy Act (CCPA). Such data deletion can…

机器学习 · 计算机科学 2022-06-30 Zhifeng Kong , Scott Alfeld

Continual Reinforcement Learning (CRL) for Vision-Language-Action (VLA) models is a promising direction toward self-improving embodied agents that can adapt in openended, evolving environments. However, conventional wisdom from continual…

机器学习 · 计算机科学 2026-03-13 Jiaheng Hu , Jay Shim , Chen Tang , Yoonchang Sung , Bo Liu , Peter Stone , Roberto Martin-Martin

Machine unlearning is an emerging technology that has come to attract widespread attention. A number of factors, including regulations and laws, privacy, and usability concerns, have resulted in this need to allow a trained model to forget…

机器学习 · 计算机科学 2024-06-18 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Wei Zhao

Large language models (LLMs) increasingly require mechanisms for continual adaptation without full retraining. However, sequential updates can lead to catastrophic forgetting, where new edits degrade previously acquired knowledge. This work…

机器学习 · 计算机科学 2025-10-21 William Hoy , Nurcin Celik

Large-scale pre-trained models (PTMs) provide remarkable zero-shot classification capability covering a wide variety of object classes. However, practical applications do not always require the classification of all kinds of objects, and…

机器学习 · 计算机科学 2024-11-04 Yusuke Kuwana , Yuta Goto , Takashi Shibata , Go Irie

Language Models (LMs) are prone to ''memorizing'' training data, including substantial sensitive user information. To mitigate privacy risks and safeguard the right to be forgotten, machine unlearning has emerged as a promising approach for…

密码学与安全 · 计算机科学 2025-06-11 Jiacheng Du , Zhibo Wang , Jie Zhang , Xiaoyi Pang , Jiahui Hu , Kui Ren

Machine unlearning allows data owners to erase the impact of their specified data from trained models. Unfortunately, recent studies have shown that adversaries can recover the erased data, posing serious threats to user privacy. An…

密码学与安全 · 计算机科学 2025-03-04 Weiqi Wang , Chenhan Zhang , Zhiyi Tian , Shushu Liu , Shui Yu

Recently, serious concerns have been raised about the privacy issues related to training datasets in machine learning algorithms when including personal data. Various regulations in different countries, including the GDPR grant individuals…

机器学习 · 计算机科学 2023-12-29 Hyunjune Kim , Sangyong Lee , Simon S. Woo

Privacy regulations require the erasure of data from deep learning models. This is a significant challenge that is amplified in Federated Learning, where data remains on clients, making full retraining or coordinated updates often…

机器学习 · 计算机科学 2026-01-27 Antonio Balordi , Lorenzo Manini , Fabio Stella , Alessio Merlo