English
Related papers

Related papers: Training Data Attribution: Was Your Model Secretly…

200 papers

Substantial research works have shown that deep models, e.g., pre-trained models, on the large corpus can learn universal language representations, which are beneficial for downstream NLP tasks. However, these powerful models are also…

Cryptography and Security · Computer Science 2024-07-16 Yixin Liu , Hongsheng Hu , Xun Chen , Xuyun Zhang , Lichao Sun

Code datasets are of immense value for training neural-network-based code completion models, where companies or organizations have made substantial investments to establish and process these datasets. Unluckily, these datasets, either built…

Software Engineering · Computer Science 2023-08-29 Zhensu Sun , Xiaoning Du , Fu Song , Li Li

Recent advances in score-based generative models have led to a huge spike in the development of downstream applications using generative models ranging from data augmentation over image and video generation to anomaly detection. Despite…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Mischa Dombrowski , Bernhard Kainz

Removing information from a machine learning model is a non-trivial task that requires to partially revert the training process. This task is unavoidable when sensitive data, such as credit card numbers or passwords, accidentally enter the…

Machine Learning · Computer Science 2023-08-08 Alexander Warnecke , Lukas Pirch , Christian Wressnegger , Konrad Rieck

Deep neural networks have had enormous impact on various domains of computer science, considerably outperforming previous state of the art machine learning techniques. To achieve this performance, neural networks need large quantities of…

Cryptography and Security · Computer Science 2018-09-05 Dorjan Hitaj , Luigi V. Mancini

Despite the tremendous success, deep neural networks are exposed to serious IP infringement risks. Given a target deep model, if the attacker knows its full information, it can be easily stolen by fine-tuning. Even if only its output is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Jie Zhang , Dongdong Chen , Jing Liao , Weiming Zhang , Huamin Feng , Gang Hua , Nenghai Yu

It is important that consumers and regulators can verify the provenance of large neural models to evaluate their capabilities and risks. We introduce the concept of a "Proof-of-Training-Data": any protocol that allows a model trainer to…

Machine Learning · Computer Science 2023-07-04 Dami Choi , Yonadav Shavit , David Duvenaud

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

Generative models, especially text-to-image diffusion models, have significantly advanced in their ability to generate images, benefiting from enhanced architectures, increased computational power, and large-scale datasets. While the…

Cryptography and Security · Computer Science 2025-11-27 Jie Ren , Yingqian Cui , Chen Chen , Yue Xing , Hui Liu , Lingjuan Lyu

Watermarking of language model outputs enables statistical detection of model-generated text, which can mitigate harms and misuses of language models. Existing watermarking strategies operate by altering the decoder of an existing language…

Machine Learning · Computer Science 2024-05-03 Chenchen Gu , Xiang Lisa Li , Percy Liang , Tatsunori Hashimoto

Text-to-image diffusion models are pushing the boundaries of what generative AI can achieve in our lives. Beyond their ability to generate general images, new personalization techniques have been proposed to customize the pre-trained base…

Computers and Society · Computer Science 2024-10-15 Boheng Li , Yanhao Wei , Yankai Fu , Zhenting Wang , Yiming Li , Jie Zhang , Run Wang , Tianwei Zhang

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values…

Cryptography and Security · Computer Science 2022-09-07 Bargav Jayaraman , David Evans

By now there is substantial evidence that deep learning models learn certain human-interpretable features as part of their internal representations of data. As having the right (or wrong) concepts is critical to trustworthy machine learning…

Machine Learning · Computer Science 2023-12-29 Nicholas Konz , Charles Godfrey , Madelyn Shapiro , Jonathan Tu , Henry Kvinge , Davis Brown

The impressive performances of Large Language Models (LLMs) and their immense potential for commercialization have given rise to serious concerns over the Intellectual Property (IP) of their training data. In particular, the synthetic texts…

Machine Learning · Computer Science 2024-09-26 Jingtan Wang , Xinyang Lu , Zitong Zhao , Zhongxiang Dai , Chuan-Sheng Foo , See-Kiong Ng , Bryan Kian Hsiang Low

Text-to-image diffusion models have achieved remarkable success in generating high-quality contents from text prompts. However, their reliance on publicly available data and the growing trend of data sharing for fine-tuning make these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Sangwon Jang , June Suk Choi , Jaehyeong Jo , Kimin Lee , Sung Ju Hwang

Text-to-image diffusion models, such as Stable Diffusion, have shown exceptional potential in generating high-quality images. However, recent studies highlight concerns over the use of unauthorized data in training these models, which may…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Soumil Datta , Shih-Chieh Dai , Leo Yu , Guanhong Tao

With the advent of personalized generation models, users can more readily create images resembling existing content, heightening the risk of violating portrait rights and intellectual property (IP). Traditional post-hoc detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Runyi Li , Xuanyu Zhang , Zhipei Xu , Yongbing Zhang , Jian Zhang

As machine learning becomes more pervasive and data privacy regulations evolve, the ability to remove private or copyrighted information from trained models is becoming an increasingly critical requirement. Existing unlearning methods often…

Generative AI models pose a significant challenge to intellectual property (IP), as they can replicate unique artistic styles and concepts without attribution. While watermarking offers a potential solution, existing methods often fail in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Li Zhang , Shruti Agarwal , John Collomosse , Pengtao Xie , Vishal Asnani