English
Related papers

Related papers: An Accelerated Proximal Gradient-based Model Predi…

200 papers

This paper presents adaptive robust quadratic program (QP) based control using control Lyapunov and barrier functions for nonlinear systems subject to time-varying and state-dependent uncertainties. An adaptive estimation law is proposed to…

Optimization and Control · Mathematics 2020-10-21 Pan Zhao , Yanbing Mao , Chuyuan Tao , Naira Hovakimyan , Xiaofeng Wang

With a weighting scheme proportional to t, a traditional stochastic gradient descent (SGD) algorithm achieves a high probability convergence rate of O({\kappa}/T) for strongly convex functions, instead of O({\kappa} ln(T)/T). We also prove…

Machine Learning · Computer Science 2013-05-13 Shenghuo Zhu

This paper develops a generalization of the line-search sequential quadratic programming (SQP) algorithm with $\ell_1$-merit function that uses objective and constraint function approximations with tunable accuracy to solve smooth…

Optimization and Control · Mathematics 2025-07-09 Dane S. Grundvig , Matthias Heinkenschloss

We provide a framework for computing the exact worst-case performance of any algorithm belonging to a broad class of oracle-based first-order methods for composite convex optimization, including those performing explicit, projected,…

Optimization and Control · Mathematics 2019-11-22 Adrien B. Taylor , Julien M. Hendrickx , François Glineur

Consider the stochastic composition optimization problem where the objective is a composition of two expected-value functions. We propose a new stochastic first-order method, namely the accelerated stochastic compositional proximal gradient…

Optimization and Control · Mathematics 2016-07-26 Mengdi Wang , Ji Liu , Ethan X. Fang

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters

We consider minimizing a function consisting of a quadratic term and a proximable term which is possibly nonconvex and nonsmooth. This problem is also known as scaled proximal operator. Despite its simple form, existing methods suffer from…

Optimization and Control · Mathematics 2024-03-01 Yiming Zhou , Wei Dai

We consider solving a convex, possibly stochastic optimization problem over a randomly time-varying multi-agent network. Each agent has access to some local objective function, and it only has unbiased estimates of the gradients of the…

Optimization and Control · Mathematics 2016-11-29 Mingyi Hong , Tsung-Hui Chang

A distributed model predictive control (DMPC) approach based on distributed optimization is applied to the power reference tracking problem of a hydro power valley (HPV) system. The applied optimization algorithm is based on accelerated…

Optimization and Control · Mathematics 2013-02-11 Minh Dang Doan , Pontus Giselsson , Tamás Keviczky , Bart De Schutter , Anders Rantzer

Gradient descent method, as one of the major methods in numerical optimization, is the key ingredient in many machine learning algorithms. As one of the most fundamental way to solve the optimization problems, it promises the function value…

Quantum Physics · Physics 2021-02-01 Keren Li , Shijie Wei , Feihao Zhang , Pan Gao , Zengrong Zhou , Tao Xin , Xiaoting Wang , Guilu Long

In this paper, we study the convergence properties of an iterative algorithm for fast nonlinear model predictive control of quasi-linear parameter-varying systems without inequality constraints. Compared to previous works considering this…

Optimization and Control · Mathematics 2023-09-15 Christian Hespe , Herbert Werner

The GRadient Ascent Pulse Engineering (GRAPE) method is widely used for optimization in quantum control. GRAPE is gradient search method based on exact expressions for gradient of the control objective. It has been applied to coherently…

Quantum Physics · Physics 2023-07-18 Vadim Petruhanov , Alexander Pechen

We consider distributed optimization on undirected connected graphs. We propose a novel distributed conditional gradient method with (O(1/\sqrt{k})) convergence. Compared with existing methods, each iteration of our method uses both…

Optimization and Control · Mathematics 2020-03-17 Yue Yu , Behçet Açıkmeşe

We propose a data-driven framework for efficiently solving quadratic programming (QP) problems by reducing the number of variables in high-dimensional QPs using instance-specific projection. A graph neural network-based model is designed to…

Machine Learning · Statistics 2025-10-31 Tomoharu Iwata , Futoshi Futami

Approximate Counting refers to the problem where we are given query access to a function $f : [N] \to \{0,1\}$, and we wish to estimate $K = #\{x : f(x) = 1\}$ to within a factor of $1+\epsilon$ (with high probability), while minimizing the…

Quantum Physics · Physics 2020-10-12 Ramgopal Venkateswaran , Ryan O'Donnell

We present a distributed proximal-gradient method for optimizing the average of convex functions, each of which is the private local objective of an agent in a network with time-varying topology. The local objectives have distinct…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-09 Annie I. Chen , Asuman Ozdaglar

We study PCA as a stochastic optimization problem and propose a novel stochastic approximation algorithm which we refer to as "Matrix Stochastic Gradient" (MSG), as well as a practical variant, Capped MSG. We study the method both…

Machine Learning · Statistics 2013-07-08 Raman Arora , Andrew Cotter , Nathan Srebro

A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is…

Optimization and Control · Mathematics 2023-03-01 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We analyze the last-iterate convergence of the Anchored Gradient Descent Ascent algorithm for smooth convex-concave min-max problems. While previous work established a last-iterate rate of $\mathcal{O}(1/t^{2-2p})$ for the squared gradient…

We introduce a quantum approximate optimization algorithm (QAOA) for continuous optimization. The algorithm is based on the dynamics of a quantum system moving in an energy potential which encodes the objective function. By approximating…

Quantum Physics · Physics 2019-02-04 Guillaume Verdon , Juan Miguel Arrazola , Kamil Brádler , Nathan Killoran