English
Related papers

Related papers: Data Poisoning Attacks Can Systematically Destabil…

200 papers

Under a commonly-studied backdoor poisoning attack against classification models, an attacker adds a small trigger to a subset of the training data, such that the presence of this trigger at test time causes the classifier to always predict…

Machine Learning · Computer Science 2021-10-06 Mingjie Sun , Siddhant Agarwal , J. Zico Kolter

Machine learning models are brittle, and small changes in the training data can result in different predictions. We study the problem of proving that a prediction is robust to data poisoning, where an attacker can inject a number of…

Programming Languages · Computer Science 2020-06-25 Samuel Drews , Aws Albarghouthi , Loris D'Antoni

We develop a data-driven framework for assessing the resilience of linear time-invariant systems against malicious false-data-injection sensor attacks. Leveraging sparse observability, we propose data-driven resilience metrics and derive…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Takumi Shinohara , Karl Henrik Johansson , Henrik Sandberg

As machine learning (ML) classifiers increasingly oversee the automated monitoring of network traffic, studying their resilience against adversarial attacks becomes critical. This paper focuses on poisoning attacks, specifically backdoor…

Cryptography and Security · Computer Science 2023-06-05 Giorgio Severi , Simona Boboila , Alina Oprea , John Holodnak , Kendra Kratkiewicz , Jason Matterer

We study data poisoning attacks in learning from human preferences. More specifically, we consider the problem of teaching/enforcing a target policy $\pi^\dagger$ by synthesizing preference data. We seek to understand the susceptibility of…

Machine Learning · Computer Science 2025-03-14 Andi Nika , Jonathan Nöther , Debmalya Mandal , Parameswaran Kamalaruban , Adish Singla , Goran Radanović

Property inference attacks consider an adversary who has access to the trained model and tries to extract some global statistics of the training data. In this work, we study property inference in scenarios where the adversary can…

Machine Learning · Computer Science 2021-01-28 Melissa Chase , Esha Ghosh , Saeed Mahloujifar

Synthetic data is often positioned as a solution to replace sensitive fixed-size datasets with a source of unlimited matching data, freed from privacy concerns. There has been much progress in synthetic data generation over the last decade,…

Machine Learning · Computer Science 2025-06-09 Graham Cormode , Samuel Maddock , Enayat Ullah , Shripad Gade

In this work, we focus on analyzing vulnerability of nonlinear dynamical control systems to stealthy false data injection attacks on sensors. We start by defining the stealthiness notion in the most general form where an attack is…

Systems and Control · Electrical Eng. & Systems 2023-10-10 Amir Khazraei , Miroslav Pajic

Federated Learning systems are increasingly subjected to a multitude of model poisoning attacks from clients. Among these, edge-case attacks that target a small fraction of the input space are nearly impossible to detect using existing…

Machine Learning · Computer Science 2024-08-15 Kiran Purohit , Soumi Das , Sourangshu Bhattacharya , Santu Rana

This work proposes a robust data-driven predictive control approach for unknown nonlinear systems in the presence of bounded process and measurement noise. Data-driven reachable sets are employed for the controller design instead of using…

Systems and Control · Electrical Eng. & Systems 2023-07-18 Mahsa Farjadnia , Amr Alanwar , Muhammad Umar B. Niazi , Marco Molinari , Karl Henrik Johansson

This paper presents an automatic formal controller synthesis method for nonlinear sampled-data systems with safety and reachability specifications. Fundamentally, the presented method is not restricted to polynomial systems and controllers.…

Systems and Control · Computer Science 2018-12-07 Cees F. Verdier , Manuel Mazo

Local Differential Privacy (LDP) protocols enable an untrusted data collector to perform privacy-preserving data analytics. In particular, each user locally perturbs its data to preserve privacy before sending it to the data collector, who…

Cryptography and Security · Computer Science 2020-12-10 Xiaoyu Cao , Jinyuan Jia , Neil Zhenqiang Gong

Code autocompletion is an integral feature of modern code editors and IDEs. The latest generation of autocompleters uses neural language models, trained on public open-source code repositories, to suggest likely (not just statically…

Cryptography and Security · Computer Science 2020-10-12 Roei Schuster , Congzheng Song , Eran Tromer , Vitaly Shmatikov

Actuator injection attacks pose real threats to all industrial plants controlled through communication networks. In this manuscript, we study the possibility of constraining the controller output (i.e. the input to the actuators) by means…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Cédric Escudero , Carlos Murguia , Paolo Massioni , Eric Zamaï

Deep neural network-based voice authentication systems are promising biometric verification techniques that uniquely identify biological characteristics to verify a user. However, they are particularly susceptible to targeted data poisoning…

Cryptography and Security · Computer Science 2024-10-02 Alireza Mohammadi , Keshav Sood , Asef Nazari , Dhananjay Thiruvady

In this work, we investigate the concept of biometric backdoors: a template poisoning attack on biometric systems that allows adversaries to stealthily and effortlessly impersonate users in the long-term by exploiting the template update…

Cryptography and Security · Computer Science 2020-11-06 Giulio Lovisotto , Simon Eberz , Ivan Martinovic

Knowledge distillation has become a cornerstone in modern machine learning systems, celebrated for its ability to transfer knowledge from a large, complex teacher model to a more efficient student model. Traditionally, this process is…

Cryptography and Security · Computer Science 2026-01-13 Chen Wu , Qian Ma , Prasenjit Mitra , Sencun Zhu

Data-driven control is a powerful tool that enables the design and implementation of control strategies directly from data without explicitly identifying the underlying system dynamics. While various data-driven control techniques, such as…

Systems and Control · Electrical Eng. & Systems 2025-02-21 Ziqin He , Yidan Mei , Shenghan Mei , Xin Mao , Anqi Dong , Ren Wang , Can Chen

This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization…

Optimization and Control · Mathematics 2021-09-08 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

Nowadays, collaborative filtering recommender systems have been widely deployed in many commercial companies to make profit. Neighbourhood-based collaborative filtering is common and effective. To date, despite its effectiveness, there has…

Information Retrieval · Computer Science 2019-12-10 Liang Chen , Yangjun Xu , Fenfang Xie , Min Huang , Zibin Zheng