English
Related papers

Related papers: Accelerated Methods for the SOCP-relaxed Component…

200 papers

The worst-case robust adaptive beamforming problem for general-rank signal model is considered. Its formulation is to maximize the worst-case signal-to-interference-plus-noise ratio (SINR), incorporating a positive semidefinite constraint…

Signal Processing · Electrical Eng. & Systems 2018-05-15 Yongwei Huang , Sergiy A. Vorobyov

First-order optimization methods, such as stochastic gradient descent (SGD) and its variants, are widely used in machine learning applications due to their simplicity and low per-iteration costs. However, they often require larger numbers…

Machine Learning · Computer Science 2020-02-05 Chih-Hao Fang , Sudhir B Kylasa , Fred Roosta , Michael W. Mahoney , Ananth Grama

We introduce a framework, which we denote as the augmented estimate sequence, for deriving fast algorithms with provable convergence guarantees. We use this framework to construct a new first-order scheme, the Accelerated Composite Gradient…

Optimization and Control · Mathematics 2019-04-24 Mihai I. Florea , Sergiy A. Vorobyov

This paper investigates accelerating the convergence of distributed optimization algorithms on non-convex problems. We propose a distributed primal-dual stochastic gradient descent~(SGD) equipped with "powerball" method to accelerate. We…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Colleen P. Bailey

The security-constrained optimal power flow (SCOPF) is fundamental in power systems and connects the automatic primary response (APR) of synchronized generators with the short-term schedule. Every day, the SCOPF problem is repeatedly solved…

Optimization and Control · Mathematics 2020-07-15 Alexandre Velloso , Pascal Van Hentenryck

This paper presents a method that generates affine inequalities to strengthen the second-order conic programming (SOCP) relaxation of an alternating current optimal power flow (AC OPF) problem. The affine inequalities serve as cuts to get…

Optimization and Control · Mathematics 2018-04-17 Zhixin Miao , Lingling Fan , Hossein Ghassempour , Bo Zeng

Douglas-Rachford splitting and its equivalent dual formulation ADMM are widely used iterative methods in composite optimization problems arising in control and machine learning applications. The performance of these algorithms depends on…

Optimization and Control · Mathematics 2019-06-28 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

A conventional way to handle model predictive control (MPC) problems distributedly is to solve them via dual decomposition and gradient ascent. However, at each time-step, it might not be feasible to wait for the dual algorithm to converge.…

Optimization and Control · Mathematics 2015-03-13 Farhad Farokhi , Iman Shames , Karl H. Johansson

Partially observable Markov decision processes (POMDPs) is a rich mathematical framework that embraces a large class of complex sequential decision-making problems under uncertainty with limited observations. However, the complexity of…

Systems and Control · Electrical Eng. & Systems 2022-11-29 Mingyu Park , Jaeuk Shin , Insoon Yang

We study distributed stochastic gradient (D-SG) method and its accelerated variant (D-ASG) for solving decentralized strongly convex stochastic optimization problems where the objective function is distributed over several computational…

Optimization and Control · Mathematics 2021-10-05 Alireza Fallah , Mert Gurbuzbalaban , Asuman Ozdaglar , Umut Simsekli , Lingjiong Zhu

This paper proposes a novel machine-learning approach for predicting AC-OPF solutions that features a fast and scalable training. It is motivated by the two critical considerations: (1) the fact that topology optimization and the…

Machine Learning · Computer Science 2021-01-19 Minas Chatzos , Terrence W. K. Mak , Pascal Van Hentenryck

Optimal Power Flow (OPF) can be modeled as a non-convex Quadratically Constrained Quadratic Program (QCQP). Our purpose is to solve OPF to global optimality. To this end, we specialize the Mixed-Integer Quadratic Convex Reformulation method…

Optimization and Control · Mathematics 2019-03-14 Hadrien Godard , Sourour Elloumi , Amélie Lambert , Jean Maeght , Manuel Ruiz

We propose Adaptive Compressed Gradient Descent (AdaCGD) - a novel optimization algorithm for communication-efficient training of supervised machine learning models with adaptive compression level. Our approach is inspired by the recently…

Machine Learning · Computer Science 2022-11-02 Maksim Makarenko , Elnur Gasanov , Rustem Islamov , Abdurakhmon Sadiev , Peter Richtarik

We address the open problem of training hypernetworks for Controllable Pareto Front Learning (CPFL) under split feasibility conditions with rigorous theoretical guarantees. We reformulate the constrained Pareto problem as a Bi-Level…

Machine Learning · Computer Science 2026-05-20 Nguyen Viet Hoang , Dung D. Le , Tran Ngoc Thang

Optimal power flow (OPF) problem is a class of large-scale and non-convex optimization problem. Various algorithms are proposed to solve the challenging OPF problem. Recent studies show that semidefinite programming (SDP) can either provide…

Optimization and Control · Mathematics 2018-02-09 Chin-Yao Chang , Wei Zhang

This paper presents a novel approach for distributed model predictive control (MPC) for piecewise affine (PWA) systems. Existing approaches rely on solving mixed-integer optimization problems, requiring significant computation power or…

Optimization and Control · Mathematics 2025-01-06 Samuel Mallick , Azita Dabiri , Bart De Schutter

In this contribution we develop an efficient reduced order model for solving parametrized linear-quadratic optimal control problems with linear time-varying state system. The fully reduced model combines reduced basis approximations of the…

Numerical Analysis · Mathematics 2024-08-29 Hendrik Kleikamp , Lukas Renelt

The present work introduces the hybrid consensus alternating direction method of multipliers (H-CADMM), a novel framework for optimization over networks which unifies existing distributed optimization approaches, including the centralized…

Optimization and Control · Mathematics 2018-05-10 Meng Ma , Athanasios N. Nikolakopoulos , Georgios B. Giannakis

In order to run Computational Fluid Dynamics (CFD) codes on large scale infrastructures, parallel computing has to be used because of the computational intensive nature of the problems. In this paper we investigate the ADAPT platform where…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-25 Imad Kissami , Christophe Cerin , Fayssal Benkhaldoun , Gilles Scarella

This paper proposes an algorithm to efficiently solve multistage stochastic programs with block separable recourse where each recourse problem is a multistage stochastic program with stage-wise independent uncertainty. The algorithm first…

Optimization and Control · Mathematics 2025-07-30 Nicolò Mazzi , Ken Mckinnon , Hongyu Zhang