English
Related papers

Related papers: DP-TabICL: In-Context Learning with Differentially…

200 papers

Many high-stakes applications require machine learning models that protect user privacy and provide well-calibrated, accurate predictions. While Differential Privacy (DP) is the gold standard for protecting user privacy, standard DP…

Machine Learning · Computer Science 2025-05-09 Ossi Räisä , Stratis Markou , Matthew Ashman , Wessel P. Bruinsma , Marlon Tobaben , Antti Honkela , Richard E. Turner

The surge in multimodal AI's success has sparked concerns over data privacy in vision-and-language tasks. While CLIP has revolutionized multimodal learning through joint training on images and text, its potential to unintentionally disclose…

Machine Learning · Computer Science 2024-03-04 Alyssa Huang , Peihan Liu , Ryumei Nakada , Linjun Zhang , Wanrong Zhang

Label differential privacy (DP) is a framework that protects the privacy of labels in training datasets, while the feature vectors are public. Existing approaches protect the privacy of labels by flipping them randomly, and then train a…

Machine Learning · Computer Science 2024-05-27 Puning Zhao , Rongfei Fan , Huiwen Wu , Qingming Li , Jiafei Wu , Zhe Liu

In-context learning (ICL) enables large language models (LLMs) to perform new tasks by prompting them with a sequence of training examples. However, it is known that ICL is very sensitive to the choice of training examples: randomly…

Computation and Language · Computer Science 2023-09-13 Ting-Yun Chang , Robin Jia

Large language models (LLMs) are increasingly deployed in high-stakes settings, yet they frequently violate contextual privacy by disclosing private information in situations where humans would exercise discretion. This raises a fundamental…

Computation and Language · Computer Science 2026-04-02 Haoran Wang , Li Xiong , Kai Shu

Large Language Models (LLMs) represent a significant advancement in artificial intelligence, finding applications across various domains. However, their reliance on massive internet-sourced datasets for training brings notable privacy…

Cryptography and Security · Computer Science 2025-02-11 Michele Miranda , Elena Sofia Ruzzetti , Andrea Santilli , Fabio Massimo Zanzotto , Sébastien Bratières , Emanuele Rodolà

Large Language Models (LLMs) have demonstrated remarkable capabilities in In-Context Learning (ICL). However, the fixed position length constraints in pre-trained models limit the number of demonstration examples. Recent efforts to extend…

Computation and Language · Computer Science 2025-05-05 Murtadha Ahmed , Wenbo , Liu yunfeng

Split learning (SL) aims to protect user data privacy by distributing deep models between client-server and keeping private data locally. Only processed or `smashed' data can be transmitted from the clients to the server during the SL…

Cryptography and Security · Computer Science 2024-10-17 Ngoc Duy Pham , Khoa Tran Phan , Naveen Chilamkurti

Decentralized Federated Learning (DFL) enables collaborative model training without a central server, but it remains vulnerable to privacy leakage because shared model updates can expose sensitive information through inversion,…

Cryptography and Security · Computer Science 2025-12-09 Fardin Jalil Piran , Zhiling Chen , Yang Zhang , Qianyu Zhou , Jiong Tang , Farhad Imani

Large Language Models (LLMs) are powerful tools for natural language processing, enabling novel applications and user experiences. However, to achieve optimal performance, LLMs often require adaptation with private data, which poses privacy…

Cryptography and Security · Computer Science 2023-10-18 Rui Wen , Tianhao Wang , Michael Backes , Yang Zhang , Ahmed Salem

In-context learning (ICL) refers to the ability of a model to condition on a few in-context demonstrations (input-output examples of the underlying task) to generate the answer for a new query input, without updating parameters. Despite the…

Machine Learning · Computer Science 2023-12-01 Yongqiang Chen , Binghui Xie , Kaiwen Zhou , Bo Han , Yatao Bian , James Cheng

Nowadays, machine learning models and applications have become increasingly pervasive. With this rapid increase in the development and employment of machine learning models, a concern regarding privacy has risen. Thus, there is a legitimate…

Machine Learning · Computer Science 2022-11-22 Samah Baraheem , Zhongmei Yao

The superior performance of large foundation models relies on the use of massive amounts of high-quality data, which often contain sensitive, private and copyrighted material that requires formal protection. While differential privacy (DP)…

Machine Learning · Computer Science 2024-10-30 Zhiqi Bu , Xinwei Zhang , Mingyi Hong , Sheng Zha , George Karypis

In-context Learning (ICL) is an emerging few-shot learning paradigm on Language Models (LMs) with inner mechanisms un-explored. There are already existing works describing the inner processing of ICL, while they struggle to capture all the…

Computation and Language · Computer Science 2025-02-21 Hakaze Cho , Mariko Kato , Yoshihiro Sakai , Naoya Inoue

Large language models (LLMs) like transformers demonstrate impressive in-context learning (ICL) capabilities, allowing them to make predictions for new tasks based on prompt exemplars without parameter updates. While existing ICL theories…

Machine Learning · Computer Science 2024-11-12 Kevin Christian Wibisono , Yixin Wang

Collecting and analyzing massive data generated from smart devices have become increasingly pervasive in crowdsensing, which are the building blocks for data-driven decision-making. However, extensive statistics and analysis of such data…

Cryptography and Security · Computer Science 2021-01-29 Teng Wang , Xuefeng Zhang , Jingyu Feng , Xinyu Yang

We study how in-context learning (ICL) in language models is affected by semantic priors versus input-label mappings. We investigate two setups-ICL with flipped labels and ICL with semantically-unrelated labels-across various model families…

Computation and Language · Computer Science 2023-03-09 Jerry Wei , Jason Wei , Yi Tay , Dustin Tran , Albert Webson , Yifeng Lu , Xinyun Chen , Hanxiao Liu , Da Huang , Denny Zhou , Tengyu Ma

Synthetic data from generative models emerges as the privacy-preserving data sharing solution. Such a synthetic data set shall resemble the original data without revealing identifiable private information. Till date, the prior focus on…

Machine Learning · Computer Science 2025-07-23 Chaoyi Zhu , Jiayi Tang , Juan F. Pérez , Marten van Dijk , Lydia Y. Chen

Differentially private (DP) contrastive learning aims to learn general-purpose representations from sensitive data, alleviating the privacy leakage concerns of organizations deploying or sharing embedding models trained on private user…

Cryptography and Security · Computer Science 2026-04-30 Kecen Li , Chen Gong , Zinan Lin , Tianhao Wang , Xiaokui Xiao

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex