English
Related papers

Related papers: We Should Separate Memorization from Copyright

200 papers

In this paper, we investigate potential randomization approaches that can complement current practices of input-based methods (such as licensing data and prompt filtering) and output-based methods (such as recitation checker, license…

Cryptography and Security · Computer Science 2024-08-27 Wei-Ning Chen , Peter Kairouz , Sewoong Oh , Zheng Xu

Quantifying the impact of individual data samples on machine learning models is an open research problem. This is particularly relevant when complex and high-dimensional relationships have to be learned from a limited sample of the data…

Machine Learning · Computer Science 2023-11-07 Dmitrii Usynin , Moritz Knolle , Georgios Kaissis

Training generative AI models requires extensive amounts of data. A common practice is to collect such data through web scraping. Yet, much of what has been and is collected is copyright protected. Its use may be copyright infringement. In…

Computers and Society · Computer Science 2026-03-18 Sebastian Stober , Tim W. Dornis

Large language models, trained on massive corpora, are prone to verbatim memorization of training data, creating significant privacy and copyright risks. While previous works have proposed various definitions for memorization, many exhibit…

Computation and Language · Computer Science 2025-11-27 Trung Cuong Dang , David Mohaisen

Diffusion models have achieved remarkable success across diverse domains, but they remain vulnerable to memorization -- reproducing training data rather than generating novel outputs. This not only limits their creative potential but also…

Machine Learning · Statistics 2025-11-10 Zeqi Ye , Qijie Zhu , Molei Tao , Minshuo Chen

We study model-agnostic copies of machine learning classifiers. We develop the theory behind the problem of copying, highlighting its differences with that of learning, and propose a framework to copy the functionality of any classifier…

Machine Learning · Computer Science 2020-01-13 Irene Unceta , Jordi Nin , Oriol Pujol

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet they also exhibit memorization of their training data. This phenomenon raises critical questions about model behavior, privacy risks,…

Machine Learning · Computer Science 2025-12-15 Alexander Xiong , Xuandong Zhao , Aneesh Pappu , Dawn Song

Copyright and computer science continue to intersect and clash, but they can coexist. The advent of new technologies such as digitization of visual and aural creations, sharing technologies, search engines, social media offerings, and more…

Computers and Society · Computer Science 2024-09-09 Deven R. Desai , Mark Riedl

The discourse on privacy risks in Large Language Models (LLMs) has disproportionately focused on verbatim memorization of training data, while a constellation of more immediate and scalable privacy threats remain underexplored. This…

Cryptography and Security · Computer Science 2025-10-03 Niloofar Mireshghallah , Tianshi Li

Plagiarism detection in programming education faces growing challenges due to increasingly sophisticated obfuscation techniques, particularly automated refactoring-based attacks. While code plagiarism detection systems used in education…

Software Engineering · Computer Science 2025-10-30 Robin Maisch , Larissa Schmid , Timur Sağlam , Nils Niehues

Artificial Intelligence (AI), and in particular generative models, are transformative tools for knowledge work. They problematise notions of creativity, originality, plagiarism, the attribution of credit, and copyright ownership. Critics of…

Human-Computer Interaction · Computer Science 2023-07-21 Advait Sarkar

Large language models are known to memorize parts of their training data, posing risk of copyright violations. To systematically examine this risk, we pretrain language models (1B/3B/8B) from scratch on 83B tokens, mixing web-scale data…

Computation and Language · Computer Science 2025-05-29 Yixuan Xu , Antoni-Joan Solergibert i Llaquet , Antoine Bosselut , Imanol Schlag

Images generated by diffusion models like Stable Diffusion are increasingly widespread. Recent works and even lawsuits have shown that these models are prone to replicating their training data, unbeknownst to the user. In this paper, we…

Machine Learning · Computer Science 2023-06-01 Gowthami Somepalli , Vasu Singla , Micah Goldblum , Jonas Geiping , Tom Goldstein

Large language models (LLMs) have shown great capabilities in various tasks but also exhibited memorization of training data, raising tremendous privacy and copyright concerns. While prior works have studied memorization during…

Artificial Intelligence · Computer Science 2024-02-26 Shenglai Zeng , Yaxin Li , Jie Ren , Yiding Liu , Han Xu , Pengfei He , Yue Xing , Shuaiqiang Wang , Jiliang Tang , Dawei Yin

Modern neural language models that are widely used in various NLP tasks risk memorizing sensitive information from their training data. Understanding this memorization is important in real world applications and also from a…

Computation and Language · Computer Science 2023-10-17 Chiyuan Zhang , Daphne Ippolito , Katherine Lee , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

Memorization impacts the performance of deep learning algorithms. Prior works have studied memorization primarily in the context of generalization and privacy. This work studies the memorization effect on incremental learning scenarios.…

Machine Learning · Computer Science 2025-05-26 Jędrzej Kozal , Jan Wasilewski , Alif Ashrafee , Bartosz Krawczyk , Michał Woźniak

Plagiarism is the practice of claiming to be someone else content, thoughts or ideas as one own without any proper credit and citations. This paper is a survey paper that, represent the some of the great research paper and its comparison…

Computation and Language · Computer Science 2022-07-01 Jabir Al Nahian , Abu Kaisar Mohammad Masum

This article reviews the empirical evidence on the use of patent citations as a proxy for invention importance. It distinguishes between technical merit, private economic value, and social value, and surveys validation studies using expert…

General Economics · Economics 2025-09-01 Gaetan de Rassenfosse

Many recent developments on generative models for natural images have relied on heuristically-motivated metrics that can be easily gamed by memorizing a small sample from the true distribution or training a model directly to improve the…

Machine Learning · Computer Science 2021-06-08 Ching-Yuan Bai , Hsuan-Tien Lin , Colin Raffel , Wendy Chih-wen Kan

In the rapidly evolving field of machine learning, training models with datasets from various locations and organizations presents significant challenges due to privacy and legal concerns. The exploration of effective collaborative training…

Software Engineering · Computer Science 2024-09-19 Zhi Chen , Lingxiao Jiang