English
Related papers

Related papers: Fair NLP Models with Differentially Private Text E…

200 papers

As the tide of Big Data continues to influence the landscape of Natural Language Processing (NLP), the utilization of modern NLP methods has grounded itself in this data, in order to tackle a variety of text-based tasks. These methods…

Computation and Language · Computer Science 2022-08-18 Oleksandra Klymenko , Stephen Meisenbacher , Florian Matthes

Federated learning (FL) is a distributed learning paradigm that allows multiple decentralized clients to collaboratively learn a common model without sharing local data. Although local data is not exposed directly, privacy concerns…

Machine Learning · Computer Science 2024-10-02 Tongxin Yin , Xuwei Tan , Xueru Zhang , Mohammad Mahdi Khalili , Mingyan Liu

An important problem in deep learning is the privacy and security of neural networks (NNs). Both aspects have long been considered separately. To date, it is still poorly understood how privacy enhancing training affects the robustness of…

Cryptography and Security · Computer Science 2021-05-18 Franziska Boenisch , Philip Sperl , Konstantin Böttinger

Federated learning (FL) is a heavily promoted approach for training ML models on sensitive data, e.g., text typed by users on their smartphones. FL is expressly designed for training on data that are unbalanced and non-iid across the…

Machine Learning · Computer Science 2022-03-07 Tao Yu , Eugene Bagdasaryan , Vitaly Shmatikov

The federated learning (FL) framework enables multiple clients to collaboratively train machine learning models without sharing their raw data, but it remains vulnerable to privacy attacks. One promising approach is to incorporate…

Machine Learning · Computer Science 2025-04-15 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

Increasing concerns and regulations about data privacy and sparsity necessitate the study of privacy-preserving, decentralized learning methods for natural language processing (NLP) tasks. Federated learning (FL) provides promising…

Many existing privacy-enhanced speech emotion recognition (SER) frameworks focus on perturbing the original speech data through adversarial training within a centralized machine learning setup. However, this privacy protection scheme can…

Cryptography and Security · Computer Science 2023-04-18 Tiantian Feng , Raghuveer Peri , Shrikanth Narayanan

In deep reinforcement learning, building policies of high-quality is challenging when the feature space of states is small and the training data is limited. Despite the success of previous transfer learning approaches in deep reinforcement…

Machine Learning · Computer Science 2020-02-11 Hankz Hankui Zhuo , Wenfeng Feng , Yufeng Lin , Qian Xu , Qiang Yang

Despite Federated Learning (FL) employing gradient aggregation at the server for distributed training to prevent the privacy leakage of raw data, private information can still be divulged through the analysis of uploaded gradients from…

Machine Learning · Computer Science 2025-05-09 Tianzhe Xiao , Yichen Li , Yu Zhou , Yining Qi , Yi Liu , Wei Wang , Haozhao Wang , Yi Wang , Ruixuan Li

Although deep learning has revolutionized domains such as natural language processing and computer vision, its dependence on centralized datasets raises serious privacy concerns. Federated learning addresses this issue by enabling multiple…

Machine Learning · Computer Science 2025-11-19 Andreas Lutz , Gabriele Steidl , Karsten Müller , Wojciech Samek

Language modeling is a keystone task in natural language processing. When training a language model on sensitive information, differential privacy (DP) allows us to quantify the degree to which our private data is protected. However,…

Machine Learning · Computer Science 2020-10-27 Gavin Kerrigan , Dylan Slack , Jens Tuyls

Decentralized learning is an efficient emerging paradigm for boosting the computing capability of multiple bounded computing agents. In the big data era, performing inference within the distributed and federated learning (DL and FL)…

Multiagent Systems · Computer Science 2022-05-11 Mohamed Ridha Znaidi , Gaurav Gupta , Paul Bogdan

Texts convey sophisticated knowledge. However, texts also convey sensitive information. Despite the success of general-purpose language models and domain-specific mechanisms with differential privacy (DP), existing text sanitization…

Computation and Language · Computer Science 2021-06-03 Xiang Yue , Minxin Du , Tianhao Wang , Yaliang Li , Huan Sun , Sherman S. M. Chow

In the era of big data, the need to expand the amount of data through data sharing to improve model performance has become increasingly compelling. As a result, effective collaborative learning models need to be developed with respect to…

Machine Learning · Computer Science 2020-11-17 Huiwen Wu , Cen Chen , Li Wang

Federated learning (FL) enables collaborative model training through model parameter exchanges instead of raw data. To avoid potential inference attacks from exchanged parameters, differential privacy (DP) offers rigorous guarantee against…

Cryptography and Security · Computer Science 2025-01-14 Shu Hong , Xiaojun Lin , Lingjie Duan

Speech data is expensive to collect, and incredibly sensitive to its sources. It is often the case that organizations independently collect small datasets for their own use, but often these are not performant for the demands of machine…

Cryptography and Security · Computer Science 2022-07-19 Michael Shoemate , Kevin Jett , Ethan Cowan , Sean Colbath , James Honaker , Prasanna Muthukumar

Federated learning (FL) enables participating parties to collaboratively build a global model with boosted utility without disclosing private data information. Appropriate protection mechanisms have to be adopted to fulfill the opposing…

Machine Learning · Computer Science 2023-07-24 Xiaojin Zhang , Yan Kang , Kai Chen , Lixin Fan , Qiang Yang

Large language models (LLMs) trained on web-scale corpora can memorize sensitive training data, posing significant privacy risks. Differential privacy (DP) has emerged as a principled framework that limits the influence of individual data…

Computation and Language · Computer Science 2026-05-13 Eduardo Tenorio , Karuna Bhaila , Xintao Wu

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information…

Machine Learning · Computer Science 2025-11-20 Bishnu Bhusal , Manoj Acharya , Ramneet Kaur , Colin Samplawski , Anirban Roy , Adam D. Cobb , Rohit Chadha , Susmit Jha

Language models increasingly appear to learn similar representations, despite differences in training objectives, architectures, and data modalities. This emerging compatibility between independently trained models introduces new…

Artificial Intelligence · Computer Science 2026-05-26 Matt Gorbett , Suman Jana