English
Related papers

Related papers: Testing the Robustness of Learned Index Structures

200 papers

We revisit the efficacy of several practical methods for approximate machine unlearning developed for large-scale deep learning. In addition to complying with data deletion requests, one often-cited potential application for unlearning…

Machine Learning · Computer Science 2026-01-16 Martin Pawelczyk , Jimmy Z. Di , Yiwei Lu , Gautam Kamath , Ayush Sekhari , Seth Neel

Reinforcement Learning (RL) algorithms have led to recent successes in solving complex games, such as Atari or Starcraft, and to a huge impact in real-world applications, such as cybersecurity or autonomous driving. In the side of the…

Machine Learning · Computer Science 2021-02-15 Rubén Majadas , Javier García , Fernando Fernández

Machine learning systems deployed in distributed or federated environments are highly susceptible to adversarial manipulations, particularly availability attacks -adding imperceptible perturbations to training data, thereby rendering the…

Cryptography and Security · Computer Science 2025-06-02 Abdessamad El-Kabid , El-Mahdi El-Mhamdi

Prompt injection attack, where an attacker injects a prompt into the original one, aiming to make an Large Language Model (LLM) follow the injected prompt to perform an attacker-chosen task, represent a critical security threat. Existing…

Cryptography and Security · Computer Science 2025-09-16 Zedian Shao , Hongbin Liu , Jaden Mu , Neil Zhenqiang Gong

Preference learning is a central component for aligning current LLMs, but this process can be vulnerable to data poisoning attacks. To address this concern, we introduce PoisonBench, a benchmark for evaluating large language models'…

Cryptography and Security · Computer Science 2025-06-09 Tingchen Fu , Mrinank Sharma , Philip Torr , Shay B. Cohen , David Krueger , Fazl Barez

Machine learning classifiers are known to be vulnerable to inputs maliciously constructed by adversaries to force misclassification. Such adversarial examples have been extensively studied in the context of computer vision applications. In…

Machine Learning · Computer Science 2017-02-09 Sandy Huang , Nicolas Papernot , Ian Goodfellow , Yan Duan , Pieter Abbeel

Federated learning is highly susceptible to model poisoning attacks, especially those meticulously crafted for servers. Traditional defense methods mainly focus on updating assessments or robust aggregation against manually crafted myopic…

Machine Learning · Computer Science 2024-12-17 Yujing Wang , Hainan Zhang , Sijia Wen , Wangjie Qiu , Binghui Guo

Federated learning (FL) has become a popular tool for solving traditional Reinforcement Learning (RL) tasks. The multi-agent structure addresses the major concern of data-hungry in traditional RL, while the federated mechanism protects the…

Machine Learning · Computer Science 2024-01-08 Evelyn Ma , Praneet Rathi , S. Rasoul Etesami

This review paper takes a comprehensive look at malicious attacks against FL, categorizing them from new perspectives on attack origins and targets, and providing insights into their methodology and impact. In this survey, we focus on…

Machine Learning · Computer Science 2024-01-10 Xianghua Xie , Chen Hu , Hanchi Ren , Jingjing Deng

Data poisoning is a type of adversarial attack on training data where an attacker manipulates a fraction of data to degrade the performance of machine learning model. Therefore, applications that rely on external data-sources for training…

Machine Learning · Computer Science 2021-04-28 Sanjay Seetharaman , Shubham Malaviya , Rosni KV , Manish Shukla , Sachin Lodha

While state-of-the-art diffusion models (DMs) excel in image generation, concerns regarding their security persist. Earlier research highlighted DMs' vulnerability to data poisoning attacks, but these studies placed stricter requirements…

Machine Learning · Computer Science 2024-06-18 Zhuoshi Pan , Yuguang Yao , Gaowen Liu , Bingquan Shen , H. Vicky Zhao , Ramana Rao Kompella , Sijia Liu

Despite the tremendous success of deep neural networks across various tasks, their vulnerability to imperceptible adversarial perturbations has hindered their deployment in the real world. Recently, works on randomized ensembles have…

Machine Learning · Computer Science 2022-06-15 Hassan Dbouk , Naresh R. Shanbhag

Nowadays, we are more and more reliant on Deep Learning (DL) models and thus it is essential to safeguard the security of these systems. This paper explores the security issues in Deep Learning and analyses, through the use of experiments,…

Machine Learning · Computer Science 2022-04-26 Marco Marchetti , Edmond S. L. Ho

In recent years, it has been found that neural networks can be easily fooled by adversarial examples, which is a potential safety hazard in some safety-critical applications. Many researchers have proposed various method to make neural…

Machine Learning · Computer Science 2018-04-24 Shuangtao Li , Yuanke Chen , Yanlin Peng , Lin Bai

Use of machine learning to perform database operations, such as indexing, cardinality estimation, and sorting, is shown to provide substantial performance benefits. However, when datasets change and data distribution shifts, empirical…

Machine Learning · Computer Science 2024-11-12 Sepanta Zeighami , Cyrus Shahahbi

Deep networks are well-known to be fragile to adversarial attacks. We conduct an empirical analysis of deep representations under the state-of-the-art attack method called PGD, and find that the attack causes the internal representation to…

Machine Learning · Computer Science 2019-10-29 Chengzhi Mao , Ziyuan Zhong , Junfeng Yang , Carl Vondrick , Baishakhi Ray

Machine Learning (ML) algorithms are vulnerable to poisoning attacks, where a fraction of the training data is manipulated to deliberately degrade the algorithms' performance. Optimal attacks can be formulated as bilevel optimization…

Machine Learning · Computer Science 2023-06-27 Javier Carnerero-Cano , Luis Muñoz-González , Phillippa Spencer , Emil C. Lupu

Advances in distributed machine learning can empower future communications and networking. The emergence of federated learning (FL) has provided an efficient framework for distributed machine learning, which, however, still faces many…

Cryptography and Security · Computer Science 2022-02-15 Zhilin Wang , Qiao Kang , Xinyi Zhang , Qin Hu

Data poisoning for reinforcement learning has historically focused on general performance degradation, and targeted attacks have been successful via perturbations that involve control of the victim's policy and rewards. We introduce an…

Machine Learning · Computer Science 2022-07-29 Harrison Foley , Liam Fowl , Tom Goldstein , Gavin Taylor

Adversarial attacks such as poisoning attacks have attracted the attention of many machine learning researchers. Traditionally, poisoning attacks attempt to inject adversarial training data in order to manipulate the trained model. In…

Machine Learning · Computer Science 2025-03-26 Ali Raza , Shujun Li , Kim-Phuc Tran , Ludovic Koehl , Kim Duc Tran