English
Related papers

Related papers: L2O-CCG: Adversarial Learning with Set Generalizat…

200 papers

Learning to Optimize (L2O) approaches, including algorithm unrolling, plug-and-play methods, and hyperparameter learning, have garnered significant attention and have been successfully applied to the Alternating Direction Method of…

Optimization and Control · Mathematics 2024-09-27 Ling Liang , Cameron Austin , Haizhao Yang

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara

An acknowledged weakness of neural networks is their vulnerability to adversarial perturbations to the inputs. To improve the robustness of these models, one of the most popular defense mechanisms is to alternatively maximize the loss over…

Machine Learning · Computer Science 2020-10-22 Zhun Deng , Hangfeng He , Jiaoyang Huang , Weijie J. Su

Traditional end-to-end contextual robust optimization models are trained for specific contextual data, requiring complete retraining whenever new contextual information arrives. This limitation hampers their use in online decision-making…

Optimization and Control · Mathematics 2025-10-20 Carlos Gamboa , Alexandre Street , Davi Valladão , Bernardo Pagnocelli

Assigning importance weights to adversarial data has achieved great success in training adversarially robust networks under limited model capacity. However, existing instance-reweighted adversarial training (AT) methods heavily depend on…

Machine Learning · Computer Science 2023-08-02 Daouda Sow , Sen Lin , Zhangyang Wang , Yingbin Liang

Adaptive robust optimization (ARO) extends static robust optimization by allowing decisions to depend on the realized uncertainty - weakly dominating static solutions within the modeled uncertainty set. However, ARO makes previous…

Optimization and Control · Mathematics 2025-11-20 Karl Zhu , Dimitris Bertsimas

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Continual learning aims to avoid catastrophic forgetting and effectively leverage learned experiences to master new knowledge. Existing gradient projection approaches impose hard constraints on the optimization space for new tasks to…

Machine Learning · Computer Science 2023-01-31 Zeyuan Yang , Zonghan Yang , Peng Li , Yang Liu

We consider solving linear optimization (LO) problems with uncertain objective coefficients. For such problems, we often employ robust optimization (RO) approaches by introducing an uncertainty set for the unknown coefficients. Typical RO…

Optimization and Control · Mathematics 2023-12-04 Ayaka Ueta , Mirai Tanaka , Ken Kobayashi , Kazuhide Nakata

Optimal-Transport Distributionally Robust Optimization (OT-DRO) robustifies data-driven decision-making under uncertainty by capturing the sampling-induced statistical error via optimal transport ambiguity sets. The standard OT-DRO pipeline…

Optimization and Control · Mathematics 2025-09-17 Jonas Ohnemus , Marta Fochesato , Riccardo Zuliani , John Lygeros

We introduce a principled learning to optimize (L2O) framework for solving fixed-point problems involving general nonexpansive mappings. Our idea is to deliberately inject summable perturbations into a standard Krasnosel'skii-Mann iteration…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Andrea Martin , Giuseppe Belgioioso

This paper develops an adaptive observation-based efficient reinforcement learning (RL) approach for systems with uncertain drift dynamics. A novel concurrent learning adaptive extended observer (CL-AEO) is first designed to jointly…

Dynamical Systems · Mathematics 2020-11-25 Maopeng Ran , Lihua Xie

Robust reinforcement learning (Robust RL) seeks to handle epistemic uncertainty in environment dynamics, but existing approaches often rely on nested min--max optimization, which is computationally expensive and yields overly conservative…

Machine Learning · Computer Science 2025-10-15 Chenliang Li , Junyu Leng , Jiaxiang Li , Youbang Sun , Shixiang Chen , Shahin Shahrampour , Alfredo Garcia

Recently, empowered with the powerful capabilities of neural networks, reinforcement learning (RL) has successfully tackled numerous challenging tasks. However, while these models demonstrate enhanced decision-making abilities, they are…

Machine Learning · Computer Science 2025-10-09 Zhengpeng Xie , Yulong Zhang

Despite a great deal of research, it is still not well-understood why trained neural networks are highly vulnerable to adversarial examples. In this work we focus on two-layer neural networks trained using data which lie on a low…

Machine Learning · Computer Science 2023-11-17 Odelia Melamed , Gilad Yehudai , Gal Vardi

Learning to optimize (L2O) has gained increasing attention since classical optimizers require laborious problem-specific design and hyperparameter tuning. However, there is a gap between the practical demand and the achievable performance…

Machine Learning · Computer Science 2020-10-20 Tianlong Chen , Weiyi Zhang , Jingyang Zhou , Shiyu Chang , Sijia Liu , Lisa Amini , Zhangyang Wang

Learning to Optimize (L2O) enhances optimization efficiency with integrated neural networks. L2O paradigms achieve great outcomes, e.g., refitting optimizer, generating unseen solutions iteratively or directly. However, conventional L2O…

Machine Learning · Computer Science 2025-03-17 Mingjia Shi , Ruihan Lin , Xuxi Chen , Yuhao Zhou , Zezhen Ding , Pingzhi Li , Tong Wang , Kai Wang , Zhangyang Wang , Jiheng Zhang , Tianlong Chen

Neural networks have led to major improvements in image classification but suffer from being non-robust to adversarial changes, unreliable uncertainty estimates on out-distribution samples and their inscrutable black-box decisions. In this…

Machine Learning · Computer Science 2020-07-30 Maximilian Augustin , Alexander Meinke , Matthias Hein

Adversarial examples, crafted by adding perturbations imperceptible to humans, can deceive neural networks. Recent studies identify the adversarial transferability across various models, \textit{i.e.}, the cross-model attack ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Rongyi Zhu , Zeliang Zhang , Susan Liang , Zhuo Liu , Chenliang Xu

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-05-21 Jiashuo Jiang