English
Related papers

Related papers: Deep Neural Network Accelerated Implicit Filtering

200 papers

Derivative-free optimization algorithms are particularly useful for tackling blackbox optimization problems where the objective function arises from complex and expensive procedures that preclude the use of classical gradient-based methods.…

Optimization and Control · Mathematics 2026-03-31 El Houcine Bergou , Youssef Diouane , Vyacheslav Kungurtsev , Clément W. Royer

Deep neural network (DNN) generally takes thousands of iterations to optimize via gradient descent and thus has a slow convergence. In addition, softmax, as a decision layer, may ignore the distribution information of the data during…

Machine Learning · Computer Science 2021-06-16 Rui Zhang , Ziheng Jiao , Hongyuan Zhang , Xuelong Li

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

Large optimization problems with hard constraints arise in many settings, yet classical solvers are often prohibitively slow, motivating the use of deep networks as cheap "approximate solvers." Unfortunately, naive deep learning approaches…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , David Rolnick , J. Zico Kolter

Deep Learning in Image Registration (DLIR) methods have been tremendously successful in image registration due to their speed and ability to incorporate weak label supervision at training time. However, existing DLIR methods forego many of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Rohit Jena , Pratik Chaudhari , James C. Gee

The growing scale of power systems and the increasing uncertainty introduced by renewable energy sources necessitates novel optimization techniques that are significantly faster and more accurate than existing methods. The AC Optimal Power…

Optimization and Control · Mathematics 2025-12-02 Andrew Rosemberg , Michael Klamkin , Pascal Van Hentenryck

To shift the computational burden from real-time to offline in delay-critical power systems applications, recent works entertain the idea of using a deep neural network (DNN) to predict the solutions of the AC optimal power flow (AC-OPF)…

Optimization and Control · Mathematics 2021-11-12 Manish K. Singh , Vassilis Kekatos , Georgios B. Giannakis

The DC optimal power flow (DCOPF) problem is a fundamental problem in power systems operations and planning. With high penetration of uncertain renewable resources in power systems, DCOPF needs to be solved repeatedly for a large amount of…

Systems and Control · Electrical Eng. & Systems 2020-09-22 Ling Zhang , Yize Chen , Baosen Zhang

In component shape optimization, the component properties are often evaluated by computationally expensive simulations. Such optimization becomes unfeasible when it is focused on a global search requiring thousands of simulations to be…

Computational Engineering, Finance, and Science · Computer Science 2025-12-08 Lucie Kubíčková , Onřej Gebouský , Jan Haidl , Martin Isoz

Despite the fact that deep neural networks (DNNs) have achieved prominent performance in various applications, it is well known that DNNs are vulnerable to adversarial examples/samples (AEs) with imperceptible perturbations in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Yanni Li , Wenhui Zhang , Jiawei Liu , Xiaoli Kou , Hui Li , Jiangtao Cui

The DC Optimal Power Flow (DC-OPF) problem is fundamental to power system operations, requiring rapid solutions for real-time grid management. While traditional optimization solvers provide optimal solutions, their computational cost…

Machine Learning · Computer Science 2025-12-15 Kshitiz Khanal

Deep Symbolic Optimization (DSO) is a novel computational framework that enables symbolic optimization for scientific discovery, particularly in applications involving the search for intricate symbolic structures. One notable example is…

We propose near-optimal overlay networks based on $d$-regular expander graphs to accelerate decentralized federated learning (DFL) and improve its generalization. In DFL a massive number of clients are connected by an overlay network, and…

Networking and Internet Architecture · Computer Science 2022-01-03 Yifan Hua , Kevin Miller , Andrea L. Bertozzi , Chen Qian , Bao Wang

Mathematical optimization is a fundamental tool for decision-making in a wide range of applications. However, in many real-world scenarios, the parameters of the optimization problem are not known a priori and must be predicted from…

Machine Learning · Computer Science 2025-11-13 Senne Berden , Ali İrfan Mahmutoğulları , Dimos Tsouros , Tias Guns

Optimal Power Flow (OPF) is a fundamental problem in power systems. It is computationally challenging and a recent line of research has proposed the use of Deep Neural Networks (DNNs) to find OPF approximations at vastly reduced runtimes…

Machine Learning · Computer Science 2021-11-23 My H. Dinh , Ferdinando Fioretto , Mostafa Mohammadian , Kyri Baker

Derivative-free optimization (DFO) is a method that does not require the calculation of gradients or higher-order derivatives of the objective function, making it suitable for cases where the objective function is non-differentiable or the…

Optimization and Control · Mathematics 2024-07-26 Qi Zhang , Pengcheng Xie

Deep Implicit Function (DIF) has gained popularity as an efficient 3D shape representation. To capture geometry details, current methods usually learn DIF using local latent codes, which discretize the space into a regular 3D grid (or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Tianyang Li , Xin Wen , Yu-Shen Liu , Hua Su , Zhizhong Han

Model-free reinforcement learning has been successfully applied to a range of challenging problems, and has recently been extended to handle large neural network policies and value functions. However, the sample complexity of model-free…

Machine Learning · Computer Science 2016-03-03 Shixiang Gu , Timothy Lillicrap , Ilya Sutskever , Sergey Levine

This work tackles a class of optimization problems in which fixing some well-chosen combinations of the variables makes the problem substantially easier to solve. We consider that the variables space may be partitioned into subsets that fix…

Optimization and Control · Mathematics 2026-03-13 Charles Audet , Pierre-Yves Bouchet , Loïc Bourdin

With the rise of renewable energy sources and their high variability in generation, the management of power grids becomes increasingly complex and computationally demanding. Conventional AC-power-flow simulations, which use the…

Artificial Intelligence · Computer Science 2026-03-31 Muhammed Öz , Jasmin Hörter , Kaleb Phipps , Charlotte Debus , Achim Streit , Markus Götz