English

On the Adversarial Robustness of Multivariate Robust Estimation

Machine Learning 2019-03-28 v1 Information Theory Machine Learning math.IT Statistics Theory Statistics Theory

Abstract

In this paper, we investigate the adversarial robustness of multivariate MM-Estimators. In the considered model, after observing the whole dataset, an adversary can modify all data points with the goal of maximizing inference errors. We use adversarial influence function (AIF) to measure the asymptotic rate at which the adversary can change the inference result. We first characterize the adversary's optimal modification strategy and its corresponding AIF. From the defender's perspective, we would like to design an estimator that has a small AIF. For the case of joint location and scale estimation problem, we characterize the optimal MM-estimator that has the smallest AIF. We further identify a tradeoff between robustness against adversarial modifications and robustness against outliers, and derive the optimal MM-estimator that achieves the best tradeoff.

Keywords

Cite

@article{arxiv.1903.11220,
  title  = {On the Adversarial Robustness of Multivariate Robust Estimation},
  author = {Erhan Bayraktar and Lifeng Lai},
  journal= {arXiv preprint arXiv:1903.11220},
  year   = {2019}
}
R2 v1 2026-06-23T08:20:18.946Z