English
Related papers

Related papers: SSLGuard: A Watermarking Scheme for Self-supervise…

200 papers

The rapid advancement of deep neural networks (DNNs) heavily relies on large-scale, high-quality datasets. However, unauthorized commercial use of these datasets severely violates the intellectual property rights of dataset owners. Existing…

Cryptography and Security · Computer Science 2025-10-31 Yingjia Wang , Ting Qiao , Xing Liu , Chongzuo Li , Sixing Wu , Jianbin Li

Large language models (LLMs) are pre-trained and post-trained on vast amounts of loosely curated data, raising the possibility that these models may have been trained on proprietary datasets or the same benchmarks used for evaluation. This…

Machine Learning · Computer Science 2026-05-11 Pengrun Huang , Kamalika Chaudhuri , Yu-Xiang Wang

The rapid advancement of customized Large Language Models (LLMs) offers considerable convenience. However, it also intensifies concerns regarding the protection of copyright/confidential information. With the extensive adoption of private…

Cryptography and Security · Computer Science 2024-12-18 Yuehan Zhang , Peizhuo Lv , Yinpeng Liu , Yongqiang Ma , Wei Lu , Xiaofeng Wang , Xiaozhong Liu , Jiawei Liu

Can pretrained models generalize to new datasets without any retraining? We deploy pretrained image models on datasets they were not trained for, and investigate whether their embeddings form meaningful clusters. Our suite of benchmarking…

Machine Learning · Computer Science 2024-06-05 Scott C. Lowe , Joakim Bruslund Haurum , Sageev Oore , Thomas B. Moeslund , Graham W. Taylor

In the rapidly evolving domain of artificial intelligence, safeguarding the intellectual property of Large Language Models (LLMs) is increasingly crucial. Current watermarking techniques against model extraction attacks, which rely on…

Cryptography and Security · Computer Science 2024-05-03 Minhao Bai , Kaiyi Pang , Yongfeng Huang

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

Sound · Computer Science 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

Self-supervised learning in computer vision trains on unlabeled data, such as images or (image, text) pairs, to obtain an image encoder that learns high-quality embeddings for input data. Emerging backdoor attacks towards encoders expose…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Shiwei Feng , Guanhong Tao , Siyuan Cheng , Guangyu Shen , Xiangzhe Xu , Yingqi Liu , Kaiyuan Zhang , Shiqing Ma , Xiangyu Zhang

The rapid advancement of large language models (LLMs) has raised concerns regarding their potential misuse, particularly in generating fake news and misinformation. To address these risks, watermarking techniques for autoregressive language…

Cryptography and Security · Computer Science 2025-06-24 Koichi Nagatsuka , Terufumi Morishita , Yasuhiro Sogawa

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Deep learning techniques are one of the most significant elements of any Artificial Intelligence (AI) services. Recently, these Machine Learning (ML) methods, such as Deep Neural Networks (DNNs), presented exceptional achievement in…

Cryptography and Security · Computer Science 2021-03-10 Mohammad Mehdi Yadollahi , Farzaneh Shoeleh , Sajjad Dadkhah , Ali A. Ghorbani

The intellectual property (IP) of Deep neural networks (DNNs) can be easily ``stolen'' by surrogate model attack. There has been significant progress in solutions to protect the IP of DNN models in classification tasks. However, little…

Cryptography and Security · Computer Science 2021-08-06 Jie Zhang , Dongdong Chen , Jing Liao , Han Fang , Zehua Ma , Weiming Zhang , Gang Hua , Nenghai Yu

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

We study protecting a user's data (images in this work) against a learner's unauthorized use in training neural networks. It is especially challenging when the user's data is only a tiny percentage of the learner's complete training set. We…

Cryptography and Security · Computer Science 2022-08-03 Zihang Zou , Boqing Gong , Liqiang Wang

We study how to watermark LLM outputs, i.e. embedding algorithmically detectable signals into LLM-generated text to track misuse. Unlike the current mainstream methods that work with a fixed LLM, we expand the watermark design space by…

Machine Learning · Computer Science 2024-03-19 Xiaojun Xu , Yuanshun Yao , Yang Liu

Copyright protection for large language models is of critical importance, given their substantial development costs, proprietary value, and potential for misuse. Existing surveys have predominantly focused on techniques for tracing…

Cryptography and Security · Computer Science 2026-04-08 Zhenhua Xu , Xubin Yue , Zhebo Wang , Haobo Zhang , Qichen Liu , Xixiang Zhao , Jingxuan Zhang , Wenjun Zeng , Wengpeng Xing , Dezhang Kong , Changting Lin , Meng Han

Currently, deep learning models are easily exposed to data leakage risks. As a distributed model, Split Learning thus emerged as a solution to address this issue. The model is splitted to avoid data uploading to the server and reduce…

Cryptography and Security · Computer Science 2025-03-10 Zhangting Lin , Mingfu Xue , Kewei Chen , Wenmao Liu , Xiang Gao , Leo Yu Zhang , Jian Wang , Yushu Zhang

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

Computation and Language · Computer Science 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

A deep neural network (DNN) classifier represents a model owner's intellectual property as training a DNN classifier often requires lots of resource. Watermarking was recently proposed to protect the intellectual property of DNN…

Cryptography and Security · Computer Science 2020-11-03 Xiaoyu Cao , Jinyuan Jia , Neil Zhenqiang Gong

Recently, there has been a vast interest in self-supervised learning (SSL) where the model is pre-trained on large scale unlabeled data and then fine-tuned on a small labeled dataset. The common wisdom is that SSL helps resource-limited…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-13 Chengyi Wang , Yu Wu , Shujie Liu , Jinyu Li , Yao Qian , Kenichi Kumatani , Furu Wei