中文
相关论文

相关论文: A Unified Framework for Diffusion Model Unlearning…

200 篇论文

Diffusion generative models have achieved remarkable success in generating images with a fixed resolution. However, existing models have limited ability to generalize to different resolutions when training data at those resolutions are not…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Alex Havrilla , Kevin Rojas , Wenjing Liao , Molei Tao

Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept-layer topological alignment, under which…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yiwei Xie , Ping Liu , Zheng Zhang

Privacy concerns associated with machine learning models have driven research into machine unlearning, which aims to erase the memory of specific target training data from already trained models. This issue also arises in federated…

机器学习 · 计算机科学 2025-03-14 Yuyuan Li , Jiaming Zhang , Yixiu Liu , Chaochao Chen

Federated learning aims at training models collaboratively across participants while protecting privacy. However, one major challenge for this paradigm is the data heterogeneity issue, where biased data preferences across multiple clients,…

机器学习 · 计算机科学 2025-07-21 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen

The Unconstrained Feature Model (UFM) is a mathematical framework that enables closed-form approximations for minimal training loss and related performance measures in deep neural networks (DNNs). This paper leverages the UFM to provide…

机器学习 · 计算机科学 2025-10-01 George Andriopoulos , Soyuj Jung Basnet , Juan Guevara , Li Guo , Keith Ross

Unlearning the data observed during the training of a machine learning (ML) model is an important task that can play a pivotal role in fortifying the privacy and security of ML-based applications. This paper raises the following questions:…

机器学习 · 计算机科学 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Federated Unlearning (FU) is emerging as a powerful tool that enables the selective removal of client data to effectively address data contamination and meet strict privacy regulations in mobile edge computing (MEC) systems. Although FU has…

网络与互联网体系结构 · 计算机科学 2026-05-22 Zihao Ding , Beining Wu , Jun Huang

The decentralized gradient descent (DGD) algorithm, and its sibling, diffusion, are workhorses in decentralized machine learning, distributed inference and estimation, and multi-agent coordination. We propose a novel, principled framework…

信号处理 · 电气工程与系统科学 2025-06-04 Erik G. Larsson , Nicolo Michelusi

Large language models deployed in sensitive applications increasingly require the ability to unlearn specific knowledge, such as user requests, copyrighted materials, or outdated information, without retraining from scratch to ensure…

机器学习 · 计算机科学 2026-05-05 Sadia Asif , Mohammad Mohammadi Amiri

Text-to-image diffusion models (DMs) are frequently abused to produce harmful or copyrighted content, violating public interests. Concept erasure (unlearning) is a promising paradigm to alleviate this issue. However, there exists a peculiar…

机器学习 · 计算机科学 2026-05-08 Manyi Li , Yufan Liu , Lai Jiang , Bing Li , Yuming Li , Weiming Hu

Multimodal sensing reduces beam training overhead but is constrained by machine learning complexity and dataset demands. To address this, we propose a data-free (DF) knowledge distillation (KD) framework for efficient LiDAR-aided mmWave…

信号处理 · 电气工程与系统科学 2025-09-24 Abolfazl Zakeri , Nhan Thanh Nguyen , Ahmed Alkhateeb , Markku Juntti

Copyright law confers upon creators the exclusive rights to reproduce, distribute, and monetize their creative works. However, recent progress in text-to-image generation has introduced formidable challenges to copyright enforcement. These…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Rui Ma , Qiang Zhou , Yizhu Jin , Daquan Zhou , Bangjun Xiao , Xiuyu Li , Yi Qu , Aishani Singh , Kurt Keutzer , Jingtong Hu , Xiaodong Xie , Zhen Dong , Shanghang Zhang , Shiji Zhou

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

机器学习 · 计算机科学 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

Motivated by privacy regulations and the need to mitigate the effects of harmful data, machine unlearning seeks to modify trained models so that they effectively ``forget'' designated data. A key challenge in verifying unlearning is…

机器学习 · 计算机科学 2026-05-05 Rishabh Dixit , Yuan Hui , Rayan Saab

Unlearning has emerged as a critical capability for large language models (LLMs) to support data privacy, regulatory compliance, and ethical AI deployment. Recent techniques often rely on obfuscation by injecting incorrect or irrelevant…

机器学习 · 计算机科学 2025-09-10 Guangzhi Sun , Potsawee Manakul , Xiao Zhan , Mark Gales

Unlearning in large language models (LLMs) aims to remove specified data, but its efficacy is typically assessed with task-level metrics like accuracy and perplexity. We show that these metrics can be misleading, as models can appear to…

计算与语言 · 计算机科学 2026-05-19 Xiaoyu Xu , Xiang Yue , Yang Liu , Qingqing Ye , Huadi Zheng , Peizhao Hu , Minxin Du , Haibo Hu

We present UniFluid, a unified autoregressive framework for joint visual generation and understanding leveraging continuous visual tokens. Our unified autoregressive architecture processes multimodal image and text inputs, generating…

Knowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by the demands of compressing ever-growing…

计算与语言 · 计算机科学 2023-07-31 Yuqiao Wen , Zichao Li , Wenyu Du , Lili Mou

Deep learning is an increasingly popular approach for inverting surface wave dispersion curves to obtain Vs profiles. However, its generalizability is constrained by the depth and velocity scales of training data. We propose a unified deep…

地球物理 · 物理学 2025-09-30 Tianjian Cheng , Hongrui Xu , Jiayu Feng , Xiongyu Hu , Chaofan Yao

Recent advances in multimodal large language models (MLLMs) have enabled image-based question-answering capabilities. However, a key limitation is the use of CLIP as the visual encoder; while it can capture coarse global information, it…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Vatsal Agarwal , Matthew Gwilliam , Gefen Kohavi , Eshan Verma , Daniel Ulbricht , Abhinav Shrivastava