English
Related papers

Related papers: A Neural Network Framework for Discovering Closed-…

200 papers

Deep Neural Networks (DNNs) are widely used for their ability to effectively approximate large classes of functions. This flexibility, however, makes the strict enforcement of constraints on DNNs an open problem. Here we present a framework…

Machine Learning · Computer Science 2023-02-10 Eric Marcus , Ray Sheombarsing , Jan-Jakob Sonke , Jonas Teuwen

This paper presents a novel approach to solving convex optimization problems by leveraging the fact that, under certain regularity conditions, any set of primal or dual variables satisfying the Karush-Kuhn-Tucker (KKT) conditions is…

Machine Learning · Computer Science 2024-10-22 Shreya Arvind , Rishabh Pomaje , Rajshekhar V Bhat

Deep neural networks (DNNs) have been widely deployed across diverse domains such as computer vision and natural language processing. However, the impressive accomplishments of DNNs have been realized alongside extensive computational…

Machine Learning · Computer Science 2023-11-28 Chuangtao Chen , Grace Li Zhang , Xunzhao Yin , Cheng Zhuo , Ulf Schlichtmann , Bing Li

To shift the computational burden from real-time to offline in delay-critical power systems applications, recent works entertain the idea of using a deep neural network (DNN) to predict the solutions of the AC optimal power flow (AC-OPF)…

Optimization and Control · Mathematics 2021-11-12 Manish K. Singh , Vassilis Kekatos , Georgios B. Giannakis

Classifiers that are linear in their parameters, and trained by optimizing a convex loss function, have predictable behavior with respect to changes in the training data, initial conditions, and optimization. Such desirable properties are…

Machine Learning · Computer Science 2020-12-22 Alessandro Achille , Aditya Golatkar , Avinash Ravichandran , Marzia Polito , Stefano Soatto

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

Despite their immense promise in performing a variety of learning tasks, a theoretical understanding of the limitations of Deep Neural Networks (DNNs) has so far eluded practitioners. This is partly due to the inability to determine the…

Machine Learning · Computer Science 2024-01-25 Saad Qadeer , Andrew Engel , Amanda Howard , Adam Tsou , Max Vargas , Panos Stinis , Tony Chiang

For verifying the safety of neural networks (NNs), Fazlyab et al. (2019) introduced a semidefinite programming (SDP) approach called DeepSDP. This formulation can be viewed as the dual of the SDP relaxation for a problem formulated as a…

Optimization and Control · Mathematics 2025-04-15 Godai Azuma , Sunyoung Kim , Makoto Yamashita

The DC optimal power flow (DCOPF) problem is a fundamental problem in power systems operations and planning. With high penetration of uncertain renewable resources in power systems, DCOPF needs to be solved repeatedly for a large amount of…

Systems and Control · Electrical Eng. & Systems 2020-09-22 Ling Zhang , Yize Chen , Baosen Zhang

There has been significant recent interest in quantum neural networks (QNNs), along with their applications in diverse domains. Current solutions for QNNs pose significant challenges concerning their scalability, ensuring that the…

Quantum Physics · Physics 2022-03-24 Mohsen Heidari , Ananth Grama , Wojciech Szpankowski

Combinatorial optimization (CO) problems are crucial in various scientific and industrial applications. Recently, researchers have proposed using unsupervised Graph Neural Networks (GNNs) to address NP-hard combinatorial optimization…

Machine Learning · Computer Science 2024-07-24 Daria Pugacheva , Andrei Ermakov , Igor Lyskov , Ilya Makarov , Yuriy Zotov

Deep neural networks (DNNs) have been widely applied to solve real-world regression problems. However, selecting optimal network structures remains a significant challenge. This study addresses this issue by linking neuron selection in DNNs…

Computation · Statistics 2025-09-30 Noah Yi-Ting Hung , Li-Hsiang Lin , Vince D. Calhoun

Modern deep neural networks (DNNs) are extremely powerful; however, this comes at the price of increased depth and having more parameters per layer, making their training and inference more computationally challenging. In an attempt to…

Machine Learning · Statistics 2024-03-04 Lingyu Gu , Yongqi Du , Yuan Zhang , Di Xie , Shiliang Pu , Robert C. Qiu , Zhenyu Liao

Tensor network (TN) techniques - often used in the context of quantum many-body physics - have shown promise as a tool for tackling machine learning (ML) problems. The application of TNs to ML, however, has mostly focused on supervised and…

Statistical Mechanics · Physics 2020-02-14 Edward Gillman , Dominic C. Rose , Juan P. Garrahan

Linear Quadratic Regulator (LQR) is often combined with feedback linearization (FBL) for nonlinear systems that have the nonlinearity additive to the input. Conventional approaches estimate and cancel the nonlinearity based on the first…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Takahito Fujimori

Convex quadratic programs (QPs) are fundamental to numerous applications, including finance, engineering, and energy systems. Among the various methods for solving them, the Douglas-Rachford (DR) splitting algorithm is notable for its…

Optimization and Control · Mathematics 2025-08-19 Jinxin Xiong , Xi Gao , Linxin Yang , Jiang Xue , Xiaodong Luo , Akang Wang

Distribution network reconfiguration (DNR) has proved to be an economical and effective way to improve the reliability of distribution systems. As optimal network configuration depends on system operating states (e.g., loads at each node),…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Mukesh Gautam , Narayan Bhusal , Mohammed Benidris

Quantum computing is a new computational paradigm that promises applications in several fields, including machine learning. In the last decade, deep learning, and in particular Convolutional neural networks (CNN), have become essential for…

Quantum Physics · Physics 2021-06-14 Iordanis Kerenidis , Jonas Landman , Anupam Prakash

Compared to classical deep neural networks its binarized versions can be useful for applications on resource-limited devices due to their reduction in memory consumption and computational demands. In this work we study deep neural networks…

Optimization and Control · Mathematics 2021-10-26 Jannis Kurtz , Bubacarr Bah

The development of a satisfying and rigorous mathematical understanding of the performance of neural networks is a major challenge in artificial intelligence. Against this background, we study the expressive power of neural networks through…

Machine Learning · Computer Science 2024-07-12 Christoph Hertrich , Martin Skutella