English
Related papers

Related papers: Sparse Neural Approximations for Bilevel Adversari…

200 papers

We analyze and contrast two ways to train machine learning models for solving AC optimal power flow (OPF) problems, distinguished with the loss functions used. The first trains a mapping from the loads to the optimal dispatch decisions,…

Systems and Control · Electrical Eng. & Systems 2024-02-02 Ge Chen , Junjie Qin

Deployment of deep neural networks in resource-constrained embedded systems requires innovative algorithmic solutions to facilitate their energy and memory efficiency. To further ensure the reliability of these systems against malicious…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Mathias Schmolli , Maximilian Baronig , Robert Legenstein , Ozan Özdenizci

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Stochastic bilevel optimization generalizes the classic stochastic optimization from the minimization of a single objective to the minimization of an objective function that depends the solution of another optimization problem. Recently,…

Optimization and Control · Mathematics 2022-04-01 Tianyi Chen , Yuejiao Sun , Quan Xiao , Wotao Yin

Optimal power flow (OPF) is one of the fundamental tasks for power system operations. While machine learning (ML) approaches such as deep neural networks (DNNs) have been widely studied to enhance OPF solution speed and performance, their…

Machine Learning · Computer Science 2026-01-07 Xinyi Liu , Xuan He , Yize Chen

We propose a hierarchical distributed algorithm to solve optimal power flow (OPF) problems that aim at dispatching controllable distributed energy resources (DERs) for voltage regulation at minimum cost. The proposed algorithm features…

Optimization and Control · Mathematics 2020-02-10 Xinyang Zhou , Zhiyuan Liu , Changhong Zhao , Lijun Chen

The Optimal Power Flow (OPF) problem is pivotal for power system operations, guiding generator output and power distribution to meet demand at minimized costs, while adhering to physical and engineering constraints. The integration of…

Machine Learning · Computer Science 2023-11-27 Chen Li , Alexander Kies , Kai Zhou , Markus Schlott , Omar El Sayed , Mariia Bilousova , Horst Stoecker

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

Adversarial machine learning concerns situations in which learners face attacks from active adversaries. Such scenarios arise in applications such as spam email filtering, malware detection and fake-image generation, where security methods…

Machine Learning · Computer Science 2024-10-29 David Benfield , Stefano Coniglio , Martin Kunc , Phan Tu Vuong , Alain Zemkoho

An acknowledged weakness of neural networks is their vulnerability to adversarial perturbations to the inputs. To improve the robustness of these models, one of the most popular defense mechanisms is to alternatively maximize the loss over…

Machine Learning · Computer Science 2020-10-22 Zhun Deng , Hangfeng He , Jiaoyang Huang , Weijie J. Su

As the accuracy of machine learning models increases at a fast rate, so does their demand for energy and compute resources. On a low level, the major part of these resources is consumed by data movement between different memory units.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-04 Niels Gleinig , Tal Ben-Nun , Torsten Hoefler

Bilevel optimization reveals the inner structure of otherwise oblique optimization problems, such as hyperparameter tuning, neural architecture search, and meta-learning. A common goal in bilevel optimization is to minimize a…

Optimization and Control · Mathematics 2026-04-29 Lesi Chen , Jing Xu , Jingzhao Zhang

We propose a multilevel stochastic approximation (MLSA) scheme for the computation of the value-at-risk (VaR) and expected shortfall (ES) of a financial loss, which can only be computed via simulations conditionally on the realisation of…

Computational Finance · Quantitative Finance 2026-04-14 Stéphane Crépey , Noufel Frikha , Azar Louzi

Bilevel optimization has found successful applications in various machine learning problems, including hyper-parameter optimization, data cleaning, and meta-learning. However, its huge computational cost presents a significant challenge for…

Machine Learning · Computer Science 2024-11-05 Xiaoyu Wang , Rui Pan , Renjie Pi , Jipeng Zhang

Bayesian Neural Networks (BNNs) provide principled estimates of model and data uncertainty by encoding parameters as distributions. This makes them key enablers for reliable AI that can be deployed on safety critical edge systems. These…

Emerging Technologies · Computer Science 2024-11-13 Prabodh Katti , Bashir M. Al-Hashimi , Bipin Rajendran

Complex computer simulators are increasingly used across fields of science as generative models tying parameters of an underlying theory to experimental observations. Inference in this setup is often difficult, as simulators rarely admit a…

Machine Learning · Statistics 2020-04-17 Gilles Louppe , Joeri Hermans , Kyle Cranmer

Recent theoretical studies proved that deep neural network (DNN) estimators obtained by minimizing empirical risk with a certain sparsity constraint can attain optimal convergence rates for regression and classification problems. However,…

Statistics Theory · Mathematics 2021-08-10 Ilsang Ohn , Yongdai Kim

Alternating current optimal power flow (AC-OPF) is one of the fundamental problems in power systems operation. AC-OPF is traditionally cast as a constrained optimization problem that seeks optimal generation set points whilst fulfilling a…

Machine Learning · Computer Science 2020-12-18 Henning Lange , Bingqing Chen , Mario Berges , Soummya Kar

Under voltage load shedding (UVLS) for power grid emergency control builds the last defensive perimeter to prevent cascade outages and blackouts in case of contingencies. This letter proposes a novel cooperative multi-agent deep…

Systems and Control · Electrical Eng. & Systems 2023-10-23 Ying Zhang , Meng Yue

Bilevel programming can be used to formulate many problems in the field of power systems, such as strategic bidding. However, common reformulations of bilevel problems to mixed-integer linear programs make solving such problems hard, which…

Optimization and Control · Mathematics 2022-07-11 Eléa Prat , Spyros Chatzivasileiadis