中文
相关论文

相关论文: Concept Unlearning in Large Language Models via Se…

200 篇论文

The widespread deployment of Large Language Models (LLMs) trained on massive, uncurated corpora has raised growing concerns about the inclusion of sensitive, copyrighted, or illegal content. This has led to increasing interest in LLM…

计算与语言 · 计算机科学 2025-06-10 Chenlong Zhang , Zhuoran Jin , Hongbang Yuan , Jiaheng Wei , Tong Zhou , Kang Liu , Jun Zhao , Yubo Chen

Machine Unlearning (MU) technology facilitates the removal of the influence of specific data instances from trained models on request. Despite rapid advancements in MU technology, its vulnerabilities are still underexplored, posing…

机器学习 · 计算机科学 2025-06-25 Zhihao Sui , Liang Hu , Jian Cao , Dora D. Liu , Usman Naseem , Zhongyuan Lai , Qi Zhang

Federated Learning (FL) offers a promising paradigm for training Large Language Models (LLMs) in a decentralized manner while preserving data privacy and minimizing communication overhead. This survey examines recent advancements in…

机器学习 · 计算机科学 2025-05-12 Youyang Qu , Ming Liu , Tianqing Zhu , Longxiang Gao , Shui Yu , Wanlei Zhou

Pre-trained Vision-Language Models (VLMs) exhibit strong generalization capabilities, enabling them to recognize a wide range of objects across diverse domains without additional training. However, they often retain irrelevant information…

机器学习 · 计算机科学 2025-10-10 Kodai Kawamura , Yuta Goto , Rintaro Yanagi , Hirokatsu Kataoka , Go Irie

Large language models (LLMs) risk retaining sensitive, copyrighted, or harmful information from their training data. Entity-level unlearning addresses this issue by removing all knowledge of a specific entity while preserving the model's…

计算与语言 · 计算机科学 2026-01-15 Xiaoqi Han , Víctor Gutiérrez-Basulto , Ru Li , Xiaoli Li , Jiye Liang , Jeff Z. Pan

Pretrained Language Models (LMs) memorize a vast amount of knowledge during initial pretraining, including information that may violate the privacy of personal lives and identities. Previous work addressing privacy issues for language…

计算与语言 · 计算机科学 2022-12-20 Joel Jang , Dongkeun Yoon , Sohee Yang , Sungmin Cha , Moontae Lee , Lajanugen Logeswaran , Minjoon Seo

Large Vision-Language Models (LVLMs) can recognize individuals in images and disclose sensitive personal information about them, raising critical privacy concerns. Machine unlearning aims to remove such knowledge from the model. However,…

机器学习 · 计算机科学 2026-04-21 Minsung Kim , Nakyeong Yang , Kyomin Jung

Large language models (LLMs) trained on unfiltered corpora inherently risk retaining sensitive information, necessitating selective knowledge unlearning for regulatory compliance and ethical safety. However, existing parameter-modifying…

机器学习 · 计算机科学 2026-05-18 Zhaokun Wang , Jinyu Guo , Jingwen Pu , Hongli Pu , Meng Yang , Xunlei Chen , Jie Ou , Wenyi Li , Guangchun Luo , Wenhong Tian

Users may inadvertently upload personally identifiable information (PII) to Machine Learning as a Service (MLaaS) providers. When users no longer want their PII on these services, regulations like GDPR and COPPA mandate a right to forget…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Chenhan Zhang , Benjamin Zi Hao Zhao , Hassan Asghar , Dali Kaafar

Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider…

计算与语言 · 计算机科学 2025-02-14 Liang Yao , Jiazhen Peng , Chengsheng Mao , Yuan Luo

Modern privacy regulations have spurred the evolution of machine unlearning, a technique enabling a trained model to efficiently forget specific training data. In prior unlearning methods, the concept of "data forgetting" is often…

机器学习 · 计算机科学 2025-01-24 Zhenxing Niu , Haoxuan Ji , Yuyao Sun , Zheng Lin , Fei Gao , Yuhang Wang , Haichao Gao

LLM unlearning is a technique to remove the impacts of undesirable knowledge from the model without retraining from scratch, which is indispensable towards trustworthy AI. Existing unlearning methods face significant limitations:…

机器学习 · 计算机科学 2026-03-02 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Due to an exponential increase in published research articles, it is impossible for individual scientists to read all publications, even within their own research field. In this work, we investigate the use of large language models (LLMs)…

Document understanding models have recently demonstrated remarkable performance by leveraging extensive collections of user documents. However, since documents often contain large amounts of personal data, their usage can pose a threat to…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Lei Kang , Mohamed Ali Souibgui , Fei Yang , Lluis Gomez , Ernest Valveny , Dimosthenis Karatzas

Machine unlearning as an emerging research topic for data regulations, aims to adjust a trained model to approximate a retrained one that excludes a portion of training data. Previous studies showed that class-wise unlearning is successful…

机器学习 · 计算机科学 2024-06-18 Jianing Zhu , Bo Han , Jiangchao Yao , Jianliang Xu , Gang Niu , Masashi Sugiyama

Machine unlearning aims to remove specific information, e.g. sensitive or undesirable content, from large language models (LLMs) while preserving overall performance. We propose an inference-time unlearning algorithm that uses contrastive…

计算与语言 · 计算机科学 2025-06-17 Vinith M. Suriyakumar , Ayush Sekhari , Ashia Wilson

Spoken language understanding (SLU) tasks involve diverse skills that probe the information extraction, classification and/or generation capabilities of models. In this setting, task-specific training data may not always be available. While…

计算与语言 · 计算机科学 2025-10-06 Neeraj Agrawal , Sriram Ganapathy

Vision-language models (VLMs) have shown remarkable ability in aligning visual and textual representations, enabling a wide range of multimodal applications. However, their large-scale training data inevitably raises concerns about privacy,…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Shen Lin , Junhao Dong , Rongjie Chen , Xiaoyu Zhang , Li Xu , Xiaofeng Chen

Machine Unlearning (MU) is critical for removing private or hazardous information from deep learning models. While MU has advanced significantly in unimodal (text or vision) settings, multimodal unlearning (MMU) remains underexplored due to…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Alexey Dontsov , Dmitrii Korzh , Alexey Zhavoronkin , Boris Mikheev , Denis Bobkov , Aibek Alanov , Oleg Y. Rogov , Ivan Oseledets , Elena Tutubalina

Large language models (LLMs) may memorize sensitive or copyrighted content, raising significant privacy and legal concerns. While machine unlearning has emerged as a potential remedy, prevailing paradigms rely on user-provided forget sets,…

计算与语言 · 计算机科学 2026-04-16 Wenxuan Li , Zhenfei Zhang , Mi Zhang , Geng Hong , Mi Wen , Xiaoyu You , Min Yang