English
Related papers

Related papers: Stealix: Model Stealing via Prompt Evolution

200 papers

Foundational image-language models have generated considerable interest due to their efficient adaptation to downstream tasks by prompt learning. Prompt learning treats part of the language model input as trainable while freezing the rest,…

Recent data-extraction attacks have exposed that language models can memorize some training samples verbatim. This is a vulnerability that can compromise the privacy of the model's training data. In this work, we introduce SubMix: a…

Machine Learning · Computer Science 2022-01-05 Antonio Ginart , Laurens van der Maaten , James Zou , Chuan Guo

In this work, we initiate the idea of using denoising diffusion models to learn priors for online decision making problems. Our special focus is on the meta-learning for bandit framework, with the goal of learning a strategy that performs…

Machine Learning · Computer Science 2023-01-31 Yu-Guan Hsieh , Shiva Prasad Kasiviswanathan , Branislav Kveton , Patrick Blöbaum

We propose a novel method for protecting trained models with a secret key so that unauthorized users without the correct key cannot get the correct inference. By taking advantage of transfer learning, the proposed method enables us to train…

Machine Learning · Computer Science 2021-03-08 MaungMaung AprilPyone , Hitoshi Kiya

We investigate an attack on a machine learning model that predicts whether a person or household will relocate in the next two years, i.e., a propensity-to-move classifier. The attack assumes that the attacker can query the model to obtain…

Machine Learning · Computer Science 2024-05-21 Manel Slokom , Peter-Paul de Wolf , Martha Larson

Recent studies have discovered that large language models (LLM) may be ``fooled'' to output private information, including training data, system prompts, and personally identifiable information, under carefully crafted adversarial prompts.…

Cryptography and Security · Computer Science 2025-08-11 Yuzhou Nie , Zhun Wang , Ye Yu , Xian Wu , Xuandong Zhao , Wenbo Guo , Dawn Song

While recent code-specific large language models (LLMs) have greatly enhanced their code generation capabilities, the safety of these models remains under-explored, posing potential risks as insecure code generated by these models may…

Cryptography and Security · Computer Science 2025-06-09 Xiangzhe Xu , Zian Su , Jinyao Guo , Kaiyuan Zhang , Zhenting Wang , Xiangyu Zhang

The performance of computer vision models in certain real-world applications (e.g., rare wildlife observation) is limited by the small number of available images. Expanding datasets using pre-trained generative models is an effective way to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Changjian Chen , Fei Lv , Yalong Guan , Pengcheng Wang , Shengjie Yu , Yifan Zhang , Zhuo Tang

Large language models (LLMs) are excellent in-context learners. However, the sensitivity of data contained in prompts raises privacy concerns. Our work first shows that these concerns are valid: we instantiate a simple but highly effective…

Machine Learning · Computer Science 2023-05-26 Haonan Duan , Adam Dziedzic , Nicolas Papernot , Franziska Boenisch

Model compression is crucial for minimizing memory storage and accelerating inference in deep learning (DL) models, including recent foundation models like large language models (LLMs). Users can access different compressed model versions…

Cryptography and Security · Computer Science 2025-07-24 Na Li , Yansong Gao , Hongsheng Hu , Boyu Kuang , Anmin Fu

Explainable Artificial Intelligence (XAI) aims to uncover the decision-making processes of AI models. However, the data used for such explanations can pose security and privacy risks. Existing literature identifies attacks on machine…

Machine Learning · Computer Science 2024-07-10 Abdullah Caglar Oksuz , Anisa Halimi , Erman Ayday

Deep learning methods have impacted almost every research field, demonstrating notable successes in medical imaging tasks such as denoising and super-resolution. However, the prerequisite for deep learning is data at scale, but data sharing…

Medical Physics · Physics 2024-02-16 Yongyi Shi , Wenjun Xia , Chuang Niu , Christopher Wiedeman , Ge Wang

Distribution inference, sometimes called property inference, infers statistical properties about a training set from access to a model trained on that data. Distribution inference attacks can pose serious risks when models are trained on…

Machine Learning · Computer Science 2022-07-06 Anshuman Suri , David Evans

The rise of Machine Learning as a Service (MLaaS) has led to the widespread deployment of machine learning models trained on diverse datasets. These models are employed for predictive services through APIs, raising concerns about the…

Cryptography and Security · Computer Science 2024-03-28 Mahendra Gurve , Sankar Behera , Satyadev Ahlawat , Yamuna Prasad

Prompt engineering is an effective but labor-intensive way to control text-to-image (T2I) generative models. Its time-intensive nature and complexity have spurred the development of algorithms for automated prompt generation. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Yutong He , Alexander Robey , Naoki Murata , Yiding Jiang , Joshua Nathaniel Williams , George J. Pappas , Hamed Hassani , Yuki Mitsufuji , Ruslan Salakhutdinov , J. Zico Kolter

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the…

Machine Learning · Computer Science 2025-03-18 Lin-Chun Huang , Ching Chieh Tsao , Fang-Yi Su , Jung-Hsien Chiang

Text-to-image generative models such as Stable Diffusion and DALL$\cdot$E raise many ethical concerns due to the generation of harmful images such as Not-Safe-for-Work (NSFW) ones. To address these ethical concerns, safety filters are often…

Machine Learning · Computer Science 2023-11-14 Yuchen Yang , Bo Hui , Haolin Yuan , Neil Gong , Yinzhi Cao

The primary way of building AI applications is shifting from training specialist models to prompting generalist models. A common practice for prompting generalist models, often referred to as in-context learning, is to append a few examples…

Computation and Language · Computer Science 2023-05-19 Wangchunshu Zhou , Yuchen Eleanor Jiang , Ryan Cotterell , Mrinmaya Sachan

Transfer learning has become an increasingly popular technique in machine learning as a way to leverage a pretrained model trained for one task to assist with building a finetuned model for a related task. This paradigm has been especially…

Machine Learning · Computer Science 2024-10-18 John Abascal , Stanley Wu , Alina Oprea , Jonathan Ullman

Large Language Models (LLMs) are susceptible to generating harmful content when prompted with carefully crafted inputs, a vulnerability known as LLM jailbreaking. As LLMs become more powerful, studying jailbreak methods is critical to…

Computation and Language · Computer Science 2025-01-07 Hao Wang , Hao Li , Junda Zhu , Xinyuan Wang , Chengwei Pan , MinLie Huang , Lei Sha