English
Related papers

Related papers: Defending Our Privacy With Backdoors

200 papers

In today's data-driven analytics landscape, deep learning has become a powerful tool, with latent representations, known as embeddings, playing a central role in several applications. In the face analytics domain, such embeddings are…

Cryptography and Security · Computer Science 2025-05-20 Arjun Ramesh Kaushik , Bharat Chandra Yalavarthi , Arun Ross , Vishnu Boddeti , Nalini Ratha

Many computer vision systems require users to upload image features to the cloud for processing and storage. These features can be exploited to recover sensitive information about the scene or subjects, e.g., by reconstructing the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Mihai Dusmanu , Johannes L. Schönberger , Sudipta N. Sinha , Marc Pollefeys

Deep learning model developers often use cloud GPU resources to experiment with large data and models that need expensive setups. However, this practice raises privacy concerns. Adversaries may be interested in: 1) personally identifiable…

Machine Learning · Computer Science 2019-04-22 Sagar Sharma , Keke Chen

The widespread adoption of face recognition has led to increasing privacy concerns, as unauthorized access to face images can expose sensitive personal information. This paper explores face image protection against viewing and recovery…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yuxi Mi , Zhizhou Zhong , Yuge Huang , Jiazhen Ji , Jianqing Xu , Jun Wang , Shaoming Wang , Shouhong Ding , Shuigeng Zhou

As machine learning (ML) systems are being increasingly employed in the real world to handle sensitive tasks and make decisions in various fields, the security and privacy of those models have also become increasingly critical. In…

Cryptography and Security · Computer Science 2023-02-21 Marwan Omar

In the era of increasing concerns over cybersecurity threats, defending against backdoor attacks is paramount in ensuring the integrity and reliability of machine learning models. However, many existing approaches require substantial…

Machine Learning · Computer Science 2024-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

This article deals with adversarial attacks towards deep learning systems for Natural Language Processing (NLP), in the context of privacy protection. We study a specific type of attack: an attacker eavesdrops on the hidden representations…

Computation and Language · Computer Science 2018-08-29 Maximin Coavoux , Shashi Narayan , Shay B. Cohen

Deep learning has attracted broad interest in healthcare and medical communities. However, there has been little research into the privacy issues created by deep networks trained for medical applications. Recently developed inference attack…

Machine Learning · Computer Science 2020-11-03 Maoqiang Wu , Xinyue Zhang , Jiahao Ding , Hien Nguyen , Rong Yu , Miao Pan , Stephen T. Wong

Privacy-preserving computer vision is an important emerging problem in machine learning and artificial intelligence. Prevalent methods tackling this problem use differential privacy (DP) or obfuscation techniques to protect the privacy of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 David Schneider , Sina Sajadmanesh , Vikash Sehwag , Saquib Sarfraz , Rainer Stiefelhagen , Lingjuan Lyu , Vivek Sharma

Self-supervised and multimodal vision encoders learn strong visual representations that are widely adopted in downstream vision tasks and large vision-language models (LVLMs). However, downstream users often rely on third-party pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siquan Huang , Yijiang Li , Ningzhi Gao , Xingfu Yan , Leyu Shi , Ying Gao

Due to the increasing computational demand of Deep Neural Networks (DNNs), companies and organizations have begun to outsource the training process. However, the externally trained DNNs can potentially be backdoor attacked. It is crucial to…

Machine Learning · Computer Science 2023-07-04 Lu Pang , Tao Sun , Haibin Ling , Chao Chen

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these…

Computation and Language · Computer Science 2021-08-30 Richard Plant , Dimitra Gkatzia , Valerio Giuffrida

To gather a significant quantity of annotated training data for high-performance image classification models, numerous companies opt to enlist third-party providers to label their unlabeled data. This practice is widely regarded as secure,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Dazhong Rong , Guoyao Yu , Shuheng Shen , Xinyi Fu , Peng Qian , Jianhai Chen , Qinming He , Xing Fu , Weiqiang Wang

In a backdoor attack, an adversary inserts maliciously constructed backdoor examples into a training set to make the resulting model vulnerable to manipulation. Defending against such attacks typically involves viewing these inserted…

Cryptography and Security · Computer Science 2023-07-20 Alaa Khaddaj , Guillaume Leclerc , Aleksandar Makelov , Kristian Georgiev , Hadi Salman , Andrew Ilyas , Aleksander Madry

The rapid rise of IoT and Big Data has facilitated copious data driven applications to enhance our quality of life. However, the omnipresent and all-encompassing nature of the data collection can generate privacy concerns. Hence, there is a…

Machine Learning · Computer Science 2021-09-09 Mert Al , Semih Yagli , Sun-Yuan Kung

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

Computation and Language · Computer Science 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

Data privacy has emerged as an important issue as data-driven deep learning has been an essential component of modern machine learning systems. For instance, there could be a potential privacy risk of machine learning systems via the model…

Machine Learning · Computer Science 2019-11-25 Taihong Xiao , Yi-Hsuan Tsai , Kihyuk Sohn , Manmohan Chandraker , Ming-Hsuan Yang

With the growing adoption of privacy-preserving machine learning algorithms, such as Differentially Private Stochastic Gradient Descent (DP-SGD), training or fine-tuning models on private datasets has become increasingly prevalent. This…

Cryptography and Security · Computer Science 2025-03-05 Hong Guan , Lei Yu , Lixi Zhou , Li Xiong , Kanchan Chowdhury , Lulu Xie , Xusheng Xiao , Jia Zou

The widespread adoption of large language models (LLMs) has raised concerns regarding data privacy. This study aims to investigate the potential for privacy invasion through input reconstruction attacks, in which a malicious model provider…

Machine Learning · Computer Science 2024-05-24 Zhipeng Wan , Anda Cheng , Yinggui Wang , Lei Wang

Privacy becomes a crucial issue when outsourcing the training of machine learning (ML) models to cloud-based platforms offering machine-learning services. While solutions based on cryptographic primitives have been developed, they incur a…

Cryptography and Security · Computer Science 2020-10-21 Mathilde Raynal , Radhakrishna Achanta , Mathias Humbert