English
Related papers

Related papers: Investigating Privacy Attacks in the Gray-Box Sett…

200 papers

Federated learning (FL) offers a promising paradigm for collaborative model training while preserving data privacy. However, its susceptibility to gradient inversion attacks poses a significant challenge, necessitating robust privacy…

Cryptography and Security · Computer Science 2025-08-19 Xiaojin Zhang , Mingcong Xu , Yiming Li , Wei Chen , Qiang Yang

Deep learning has demonstrated state-of-the-art performance for a variety of challenging computer vision tasks. On one hand, this has enabled deep visual models to pave the way for a plethora of critical applications like disease…

Machine Learning · Computer Science 2020-06-29 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

Model stealing attacks have become a serious concern for deep learning models, where an attacker can steal a trained model by querying its black-box API. This can lead to intellectual property theft and other security and privacy risks. The…

Machine Learning · Computer Science 2023-09-12 Kacem Khaled , Mouna Dhaouadi , Felipe Gohring de Magalhães , Gabriela Nicolescu

Black-box finetuning is an emerging interface for adapting state-of-the-art language models to user needs. However, such access may also let malicious actors undermine model safety. To demonstrate the challenge of defending finetuning…

Cryptography and Security · Computer Science 2024-07-01 Danny Halawi , Alexander Wei , Eric Wallace , Tony T. Wang , Nika Haghtalab , Jacob Steinhardt

Multi-party machine learning is a paradigm in which multiple participants collaboratively train a machine learning model to achieve a common learning objective without sharing their privately owned data. The paradigm has recently received a…

Machine Learning · Computer Science 2021-07-26 Kennedy Edemacu , Beakcheol Jang , Jong Wook Kim

Deep learning systems, critical in domains like autonomous vehicles, are vulnerable to adversarial examples (crafted inputs designed to mislead classifiers). This study investigates black-box adversarial attacks in computer vision. This is…

Cryptography and Security · Computer Science 2025-06-09 Francesco Panebianco , Mario D'Onghia , Stefano Zanero aand Michele Carminati

The fast development of large language models (LLMs) and popularization of cloud computing have led to increasing concerns on privacy safeguarding and data security of cross-cloud model deployment and training as the key challenges. We…

Cryptography and Security · Computer Science 2025-03-18 Ze Yang , Yihong Jin , Yihan Zhang , Juntian Liu , Xinhe Xu

Federated learning is a machine learning paradigm that emerges as a solution to the privacy-preservation demands in artificial intelligence. As machine learning, federated learning is threatened by adversarial attacks against the integrity…

Cryptography and Security · Computer Science 2022-09-20 Nuria Rodríguez-Barroso , Daniel Jiménez López , M. Victoria Luzón , Francisco Herrera , Eugenio Martínez-Cámara

Federated Learning has rapidly expanded from its original inception to now have a large body of research, several frameworks, and sold in a variety of commercial offerings. Thus, its security and robustness is of significant importance.…

Cryptography and Security · Computer Science 2025-10-02 Simone Bottoni , Giulio Zizzo , Stefano Braghin , Alberto Trombetta

Federated learning allows multiple users to collaboratively train a shared classification model while preserving data privacy. This approach, where model updates are aggregated by a central server, was shown to be vulnerable to poisoning…

Machine Learning · Computer Science 2020-12-17 Chien-Lun Chen , Leana Golubchik , Marco Paolieri

Strict privacy is of paramount importance in distributed machine learning. Federated learning, with the main idea of communicating only what is needed for learning, has been recently introduced as a general approach for distributed learning…

Cryptography and Security · Computer Science 2020-07-14 Mikko A. Heikkilä , Antti Koskela , Kana Shimizu , Samuel Kaski , Antti Honkela

Federated learning has been proposed as a privacy-preserving machine learning framework that enables multiple clients to collaborate without sharing raw data. However, client privacy protection is not guaranteed by design in this framework.…

Cryptography and Security · Computer Science 2022-10-17 Kai Yue , Richeng Jin , Chau-Wai Wong , Dror Baron , Huaiyu Dai

Privacy and transparency are two key foundations of trustworthy machine learning. Model explanations offer insights into a model's decisions on input data, whereas privacy is primarily concerned with protecting information about the…

Machine Learning · Computer Science 2021-02-08 Reza Shokri , Martin Strobel , Yair Zick

Machine learning has been widely applied to various applications, some of which involve training with privacy-sensitive data. A modest number of data breaches have been studied, including credit card information in natural language data and…

Machine Learning · Computer Science 2019-04-26 Xinlei Pan , Weiyao Wang , Xiaoshuai Zhang , Bo Li , Jinfeng Yi , Dawn Song

Most machine learning applications rely on centralized learning processes, opening up the risk of exposure of their training datasets. While federated learning (FL) mitigates to some extent these privacy risks, it relies on a trusted…

Machine Learning · Computer Science 2024-09-18 Georgios Syros , Gokberk Yar , Simona Boboila , Cristina Nita-Rotaru , Alina Oprea

Federated Learning (FL) is a novel privacy-protection distributed machine learning paradigm that guarantees user privacy and prevents the risk of data leakage due to the advantage of the client's local training. Researchers have struggled…

Machine Learning · Computer Science 2023-12-01 Kangkang Sun , Xiaojin Zhang , Xi Lin , Gaolei Li , Jing Wang , Jianhua Li

Many deployed learned models are black boxes: given input, returns output. Internal information about the model, such as the architecture, optimisation procedure, or training data, is not disclosed explicitly as it might contain proprietary…

Machine Learning · Statistics 2018-02-15 Seong Joon Oh , Max Augustin , Bernt Schiele , Mario Fritz

Machine learning tools are becoming increasingly powerful and widely used. Unfortunately membership attacks, which seek to uncover information from data sets used in machine learning, have the potential to limit data sharing. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Dennis Conway , Loic Simon , Alexis Lechervy , Frederic Jurie

With the advent of machine learning in applications of critical infrastructure such as healthcare and energy, privacy is a growing concern in the minds of stakeholders. It is pivotal to ensure that neither the model nor the data can be used…

Machine Learning · Computer Science 2021-12-01 Dominique Mercier , Adriano Lucieri , Mohsin Munir , Andreas Dengel , Sheraz Ahmed

Deep learning has shown incredible potential across a wide array of tasks, and accompanied by this growth has been an insatiable appetite for data. However, a large amount of data needed for enabling deep learning is stored on personal…