English
Related papers

Related papers: We Should Separate Memorization from Copyright

200 papers

Recent works have shown that diffusion models are able to memorize training images and emit them at generation time. However, the metrics used to evaluate memorization and its mitigation techniques suffer from dataset-dependent biases and…

Machine Learning · Computer Science 2025-03-04 Nicky Kriplani , Minh Pham , Gowthami Somepalli , Chinmay Hegde , Niv Cohen

CONTEXT: There is growing interest in establishing software engineering as an evidence-based discipline. To that end, replication is often used to gain confidence in empirical findings, as opposed to reproduction where the goal is showing…

Software Engineering · Computer Science 2018-02-14 Martin Shepperd

Rote learning is a memorization technique based on repetition. Many researchers argue that rote learning hinders generalization because it encourages verbatim memorization rather than deeper understanding. This concern extends even to…

Computation and Language · Computer Science 2026-03-03 Qinyuan Wu , Soumi Das , Mahsa Amani , Bishwamittra Ghosh , Mohammad Aflah Khan , Krishna P. Gummadi , Muhammad Bilal Zafar

Questions of fair use of copyright-protected content to train Large Language Models (LLMs) are being actively debated. Document-level inference has been proposed as a new task: inferring from black-box access to the trained model whether a…

Computation and Language · Computer Science 2024-06-06 Matthieu Meeus , Igor Shilov , Manuel Faysse , Yves-Alexandre de Montjoye

Generative AI is becoming increasingly prevalent in creative fields, sparking urgent debates over how current copyright laws can keep pace with technological innovation. Recent controversies of AI models generating near-replicas of…

Machine Learning · Computer Science 2025-07-01 Archer Amon , Zhipeng Yin , Zichong Wang , Avash Palikhe , Wenbin Zhang

As reproducibility becomes a greater concern, conferences have largely converged to a strategy of asking reviewers to indicate whether code was attached to a submission. This is part of a larger trend of taking action based on assumed…

Machine Learning · Computer Science 2022-04-12 Edward Raff , Andrew L. Farris

Recent research demonstrated that training large language models involves memorization of a significant fraction of training data. Such memorization can lead to privacy violations when training on sensitive user data and thus motivates the…

Machine Learning · Computer Science 2025-10-29 Vitaly Feldman , Guy Kornowski , Xin Lyu

Recent advancements in text-to-image diffusion models have demonstrated their remarkable capability to generate high-quality images from textual prompts. However, increasing research indicates that these models memorize and replicate images…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jie Ren , Yaxin Li , Shenglai Zeng , Han Xu , Lingjuan Lyu , Yue Xing , Jiliang Tang

Memorization in large language models poses critical risks for privacy and fairness as these systems scale to billions of parameters. While previous studies established correlations between memorization and factors like token frequency and…

Machine Learning · Computer Science 2025-09-01 Jie Zhang , Qinghua Zhao , Chi-ho Lin , Zhongfeng Kang , Lei Li

As AI advances, copyrighted content faces growing risk of unauthorized use, whether through model training or direct misuse. Building upon invisible adversarial perturbation, recent works developed copyright protections against specific AI…

Machine Learning · Computer Science 2025-06-04 Tianci Liu , Tong Yang , Quan Zhang , Qi Lei

Visual diffusion models have revolutionized the field of creative AI, producing high-quality and diverse content. However, they inevitably memorize training images or videos, subsequently replicating their concepts, content, or styles…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Wenhao Wang , Yifan Sun , Zongxin Yang , Zhengdong Hu , Zhentao Tan , Yi Yang

Plagiarism is an act of using someone else's work without proper acknowledgment, and this sin is seen to cut across various arenas including the academy, publishing, and other similar arenas. The traditional methods of plagiarism detection…

Emerging Technologies · Computer Science 2024-12-10 Omraj Kamat , Tridib Ghosh , Kalaivani J , Angayarkanni V , Rama P

Concerned with privacy threats, memorization in LLMs is often seen as undesirable, specifically for learning. In this paper, we study whether memorization can be avoided when optimally learning a language, and whether the privacy threat…

Machine Learning · Computer Science 2025-07-22 Bishwamittra Ghosh , Soumi Das , Qinyuan Wu , Mohammad Aflah Khan , Krishna P. Gummadi , Evimaria Terzi , Deepak Garg

Many generative foundation models (or GFMs) are trained on publicly available data and use public infrastructure, but 1) may degrade the "digital commons" that they depend on, and 2) do not have processes in place to return value captured…

Computers and Society · Computer Science 2023-03-21 Saffron Huang , Divya Siddarth

The availability of large-scale datasets, advanced architectures, and powerful computational resources have led to effective code models that automate diverse software engineering activities. The datasets usually consist of billions of…

Software Engineering · Computer Science 2024-01-15 Zhou Yang , Zhipeng Zhao , Chenyu Wang , Jieke Shi , Dongsun Kim , DongGyun Han , David Lo

Generative models are increasingly used in 3D vision to synthesize novel shapes, yet it remains unclear whether their generation relies on memorizing training shapes. Understanding their memorization could help prevent training data leakage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shu Pu , Boya Zeng , Kaichen Zhou , Mengyu Wang , Zhuang Liu

Today, Plagiarism has become a menace. Every journal editor or conference organizers has to deal with this problem. Simply Copying or rephrasing of text without giving due credit to the original author has become more common. This is…

Other Computer Science · Computer Science 2012-10-30 Iti Mathur , Nisheeth Joshi

Diffusion models have attracted significant attention due to its exceptional data generation capabilities in fields such as image synthesis. However, recent studies have shown that diffusion models are vulnerable to copyright infringement…

Artificial Intelligence · Computer Science 2025-08-22 Zhixiang Guo , Siyuan Liang , Aishan Liu , Dacheng Tao

With increasingly more data and computation involved in their training, machine learning models constitute valuable intellectual property. This has spurred interest in model stealing, which is made more practical by advances in learning…

Machine Learning · Statistics 2021-04-23 Pratyush Maini , Mohammad Yaghini , Nicolas Papernot

Language models (LMs) derive their capabilities from extensive training on diverse data, including potentially copyrighted material. These models can memorize and generate content similar to their training data, posing potential concerns.…

Computation and Language · Computer Science 2024-10-14 Boyi Wei , Weijia Shi , Yangsibo Huang , Noah A. Smith , Chiyuan Zhang , Luke Zettlemoyer , Kai Li , Peter Henderson