English
Related papers

Related papers: SUV: Scalable Large Language Model Copyright Compl…

200 papers

Pre-trained Large Language Models (LLMs) have demonstrated remarkable capabilities but also pose risks by learning and generating copyrighted material, leading to significant legal and ethical concerns. In real-world scenarios, model owners…

Computation and Language · Computer Science 2025-02-12 Guangyao Dou , Zheyuan Liu , Qing Lyu , Kaize Ding , Eric Wong

Pre-trained Large Language Models (LLMs) have demonstrated remarkable capabilities but also pose risks by learning and generating copyrighted material, leading to significant legal and ethical concerns. In a potential real-world scenario,…

Computation and Language · Computer Science 2025-02-12 Guangyao Dou

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Cryptography and Security · Computer Science 2025-06-03 Jie Ren , Zhenwei Dai , Xianfeng Tang , Yue Xing , Shenglai Zeng , Hui Liu , Jingying Zeng , Qiankun Peng , Samarth Varshney , Suhang Wang , Qi He , Charu C. Aggarwal , Hui Liu

The widespread popularity of Large Language Models (LLMs), partly due to their unique ability to perform in-context learning, has also brought to light the importance of ethical and safety considerations when deploying these pre-trained…

Computation and Language · Computer Science 2024-08-07 Karuna Bhaila , Minh-Hao Van , Xintao Wu

While Large Language Models (LLMs) excel at code generation, their inherent tendency toward verbatim memorization of training data introduces critical risks like copyright infringement, insecure emission, and deprecated API utilization,…

Software Engineering · Computer Science 2025-11-25 Xue Jiang , Yihong Dong , Huangzhao Zhang , Tangxinyu Wang , Zheng Fang , Yingwei Ma , Rongyu Cao , Binhua Li , Zhi Jin , Wenpin Jiao , Yongbin Li , Ge Li

Large Language Model (LLM) unlearning has recently gained significant attention, driven by the need to remove unwanted information, such as private, sensitive, or copyrighted content, from LLMs. However, conventional unlearning approaches…

Computation and Language · Computer Science 2025-06-03 Yixin Wan , Anil Ramakrishna , Kai-Wei Chang , Volkan Cevher , Rahul Gupta

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

Computation and Language · Computer Science 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

Large language models (LLMs) trained over extensive corpora risk memorizing sensitive, copyrighted, or toxic content. To address this, we propose \textbf{OBLIVIATE}, a robust unlearning framework that removes targeted data while preserving…

Computation and Language · Computer Science 2025-09-10 Xiaoyu Xu , Minxin Du , Qingqing Ye , Haibo Hu

As large language models (LLMs) are increasingly adopted in safety-critical and regulated sectors, the retention of sensitive or prohibited knowledge introduces escalating risks, ranging from privacy leakage to regulatory non-compliance to…

Machine Learning · Computer Science 2025-12-19 Taozhao Chen , Linghan Huang , Kim-Kwang Raymond Choo , Huaming Chen

Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in knowledge unlearning involve updating LLM parameters to erase…

Computation and Language · Computer Science 2024-10-08 Bozhong Tian , Xiaozhuan Liang , Siyuan Cheng , Qingbin Liu , Mengru Wang , Dianbo Sui , Xi Chen , Huajun Chen , Ningyu Zhang

The past a few years have witnessed the great success of large language models, demonstrating powerful capabilities in comprehending textual data and generating human-like languages. Large language models achieve success by being trained on…

Computation and Language · Computer Science 2025-03-20 Estrid He , Tabinda Sarwar , Ibrahim Khalil , Xun Yi , Ke Wang

Large language models (LLMs) store vast amounts of information, making them powerful yet raising privacy and safety concerns when selective knowledge removal is required. Existing unlearning strategies, ranging from gradient-based…

Computation and Language · Computer Science 2025-06-02 Xu Wang , Zihao Li , Benyou Wang , Yan Hu , Difan Zou

Large Vision-Language Models (LVLMs), trained on web-scale data, risk memorizing and regenerating copyrighted visual content such as characters and logos, creating significant challenges. Machine unlearning offers a path to mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 JuneHyoung Kwon , JungMin Yun , YoungBin Kim

Machine unlearning aims to remove specific data influences from trained models, a capability essential for adhering to copyright laws and ensuring AI safety. Current unlearning metrics typically measure success by monitoring the model's…

Cryptography and Security · Computer Science 2025-12-24 Hengrui Jia , Taoran Li , Jonas Guan , Varun Chandrasekaran

Machine unlearning, a novel area within artificial intelligence, focuses on addressing the challenge of selectively forgetting or reducing undesirable knowledge or behaviors in machine learning models, particularly in the context of large…

Computation and Language · Computer Science 2024-05-27 Saaketh Koundinya Gundavarapu , Shreya Agarwal , Arushi Arora , Chandana Thimmalapura Jagadeeshaiah

Questions of fair use of copyright-protected content to train Large Language Models (LLMs) are being actively debated. Document-level inference has been proposed as a new task: inferring from black-box access to the trained model whether a…

Computation and Language · Computer Science 2024-06-06 Matthieu Meeus , Igor Shilov , Manuel Faysse , Yves-Alexandre de Montjoye

The rapid advancement of Large Language Models (LLMs) has demonstrated their vast potential across various domains, attributed to their extensive pretraining knowledge and exceptional generalizability. However, LLMs often encounter…

Computation and Language · Computer Science 2024-06-06 Zheyuan Liu , Guangyao Dou , Zhaoxuan Tan , Yijun Tian , Meng Jiang

Language models (LMs) are trained on vast amounts of text data, which may include private and copyrighted content. Data owners may request the removal of their data from a trained model due to privacy or copyright concerns. However, exactly…

Computation and Language · Computer Science 2024-07-16 Weijia Shi , Jaechan Lee , Yangsibo Huang , Sadhika Malladi , Jieyu Zhao , Ari Holtzman , Daogao Liu , Luke Zettlemoyer , Noah A. Smith , Chiyuan Zhang

The undesired memorization of sensitive information by Large Language Models (LLMs) has emphasized the need for safety mechanisms that can regulate model behavior. This has led to the development of machine unlearning techniques that enable…

Machine Learning · Computer Science 2025-10-10 Anu Agarwal , Mihir Pamnani , Dilek Hakkani-Tur

Large language models (LLMs) may memorize sensitive or copyrighted content, raising privacy and legal concerns. Due to the high cost of retraining from scratch, researchers attempt to employ machine unlearning to remove specific content…

Computation and Language · Computer Science 2025-08-12 Xiaojian Yuan , Tianyu Pang , Chao Du , Kejiang Chen , Weiming Zhang , Min Lin
‹ Prev 1 2 3 10 Next ›