English
Related papers

Related papers: Adversarial Robustness in Two-Stage Learning-to-De…

200 papers

Recent studies show that models trained by continual learning can achieve the comparable performances as the standard supervised learning and the learning flexibility of continual learning models enables their wide applications in the real…

Machine Learning · Computer Science 2023-04-03 Tao Bai , Chen Chen , Lingjuan Lyu , Jun Zhao , Bihan Wen

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

We present a new algorithm to learn a deep neural network model robust against adversarial attacks. Previous algorithms demonstrate an adversarially trained Bayesian Neural Network (BNN) provides improved robustness. We recognize the…

Machine Learning · Computer Science 2023-12-04 Bao Gia Doan , Ehsan Abbasnejad , Javen Qinfeng Shi , Damith C. Ranasinghe

Robust reinforcement learning (RL) considers the problem of learning policies that perform well in the worst case among a set of possible environment parameter values. In real-world environments, choosing the set of possible values for…

Machine Learning · Computer Science 2022-10-05 JB Lanier , Stephen McAleer , Pierre Baldi , Roy Fox

This paper considers two fundamental sequential decision-making problems: the problem of prediction with expert advice and the multi-armed bandit problem. We focus on stochastic regimes in which an adversary may corrupt losses, and we…

Machine Learning · Statistics 2021-09-24 Shinji Ito

Adversarial training is a common approach to improving the robustness of deep neural networks against adversarial examples. In this work, we propose a novel regularization approach as an alternative. To derive the regularizer, we formulate…

Machine Learning · Computer Science 2021-02-09 Avery Ma , Fartash Faghri , Nicolas Papernot , Amir-massoud Farahmand

Language models (LMs) are indispensable tools for natural language processing tasks, but their vulnerability to adversarial attacks remains a concern. While current research has explored adversarial training techniques, their improvements…

Computation and Language · Computer Science 2024-03-28 Brian Formento , Wenjie Feng , Chuan Sheng Foo , Luu Anh Tuan , See-Kiong Ng

We consider stochastic convex optimization problems where the objective is an expectation over smooth functions. For this setting we suggest a novel gradient estimate that combines two recent mechanism that are related to notion of…

Machine Learning · Computer Science 2025-03-06 Tehila Dahan , Kfir Y. Levy

We study the robustness of reinforcement learning (RL) with adversarially perturbed state observations, which aligns with the setting of many adversarial attacks to deep reinforcement learning (DRL) and is also important for rolling out…

Machine Learning · Computer Science 2021-01-22 Huan Zhang , Hongge Chen , Duane Boning , Cho-Jui Hsieh

Adversarial distillation in the standard min-max adversarial training framework aims to transfer adversarial robustness from a large, robust teacher network to a compact student. However, existing work often neglects to incorporate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hongsin Lee , Hye Won Chung

Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a…

Machine Learning · Computer Science 2020-11-19 Giorgos Mamakoukas , Orest Xherija , T. D. Murphey

Benders decomposition (BD) is a widely used solution approach for solving two-stage stochastic programs arising in real-world decision-making under uncertainty. However, it often suffers from slow convergence as the master problem grows…

Optimization and Control · Mathematics 2026-05-08 Haochen Cai , Xian Yu

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

Machine Learning · Computer Science 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

Legged locomotion has recently achieved remarkable success with the progress of machine learning techniques, especially deep reinforcement learning (RL). Controllers employing neural networks have demonstrated empirical and qualitative…

Robotics · Computer Science 2024-06-03 Fan Shi , Chong Zhang , Takahiro Miki , Joonho Lee , Marco Hutter , Stelian Coros

Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we reveal a surprising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Yanyun Wang , Qingqing Ye , Li Liu , Zi Liang , Haibo Hu

Machine learning models trained on tabular data are vulnerable to adversarial attacks, even in realistic scenarios where attackers only have access to the model's outputs. Since tabular data contains complex interdependencies among…

Machine Learning · Computer Science 2025-09-03 Yael Itzhakev , Amit Giloni , Yuval Elovici , Asaf Shabtai

Recent work has shown that the training of a one-hidden-layer, scalar-output fully-connected ReLU neural network can be reformulated as a finite-dimensional convex program. Unfortunately, the scale of such a convex program grows…

Machine Learning · Computer Science 2021-05-27 Yatong Bai , Tanmay Gautam , Yu Gai , Somayeh Sojoudi

Modern recommendation and search systems typically employ multi-stage ranking architectures to efficiently handle billions of candidates. The conventional approach uses distinct L1 (candidate retrieval) and L2 (re-ranking) models with…

Information Retrieval · Computer Science 2025-05-08 Ayoub Abraich

While deep learning models have shown remarkable performance in various tasks, they are susceptible to learning non-generalizable spurious features rather than the core features that are genuinely correlated to the true label. In this…

Machine Learning · Computer Science 2023-10-31 Yihe Deng , Yu Yang , Baharan Mirzasoleiman , Quanquan Gu

For safety of autonomous driving, vehicles need to be able to drive under various lighting, weather, and visibility conditions in different environments. These external and environmental factors, along with internal factors associated with…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Yu Shen , Laura Zheng , Manli Shu , Weizi Li , Tom Goldstein , Ming C. Lin