English
Related papers

Related papers: Second-Order Non-Convex Optimization for Constrain…

200 papers

We consider the problem of synthesizing optimal linear feedback policies subject to arbitrary convex constraints on the feedback matrix. This is known to be a hard problem in the usual formulations ($\Htwo,\Hinf,\LQR$) and previous works…

Systems and Control · Computer Science 2013-10-28 Krishnamurthy Dvijotham , Emanuel Todorov , Maryam Fazel

While first-order optimization methods such as stochastic gradient descent (SGD) are popular in machine learning (ML), they come with well-known deficiencies, including relatively-slow convergence, sensitivity to the settings of…

Optimization and Control · Mathematics 2018-02-19 Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

We consider the Linear-Quadratic-Regulator (LQR) problem in terms of optimizing a real-valued matrix function over the set of feedback gains. Such a setup facilitates examining the implications of a natural initial-state independent…

Systems and Control · Electrical Eng. & Systems 2019-07-31 Jingjing Bu , Afshin Mesbahi , Maryam Fazel , Mehran Mesbahi

There has been growing interest in high-order tensor methods for nonconvex optimization, with adaptive regularization, as they possess better/optimal worst-case evaluation complexity globally and faster convergence asymptotically. These…

Optimization and Control · Mathematics 2025-01-17 Coralia Cartis , Wenqi Zhu

One of the desirable objectives in feedback control design is to formulate and solve the design problem as an optimisation problem that is convex, so that an optimal solution can be found efficiently. Unfortunately many control design…

Optimization and Control · Mathematics 2025-11-25 Matthew Newton , Zuxun Xiong , Han Wang , Antonis Papachristodoulou

In this paper, we consider both first- and second-order techniques to address continuous optimization problems arising in machine learning. In the first-order case, we propose a framework of transition from deterministic or…

Machine Learning · Computer Science 2021-11-30 Sanae Lotfi , Tiphaine Bonniot de Ruisselet , Dominique Orban , Andrea Lodi

This paper investigates a model-free solution to the stochastic linear quadratic regulation (LQR) problem for linear discrete-time systems with both multiplicative and additive noises. We formulate the stochastic LQR problem as a nonconvex…

Optimization and Control · Mathematics 2025-12-25 Jing Guo , Xiushan Jiang , Weihai Zhang

The linear quadratic regulator is the fundamental problem of optimal control. Its state feedback version was set and solved in the early 1960s. However the static output feedback problem has no explicit-form solution. It is suggested to…

Optimization and Control · Mathematics 2020-11-03 Ilyas Fatkhullin , Boris Polyak

Achieving optimal steady-state performance in real-time is an increasingly necessary requirement of many critical infrastructure systems. In pursuit of this goal, this paper builds a systematic design framework of feedback controllers for…

Optimization and Control · Mathematics 2017-10-30 Zachary E. Nelson , Enrique Mallada

Computing a stabilizing static output-feedback (SOF) controller is an NP-hard problem, in general. Yet, these controllers have amassed popularity in recent years because of their practical use in feedback control applications, such as fluid…

Systems and Control · Electrical Eng. & Systems 2023-07-10 Talha Mushtaq , Peter Seiler , Maziar S. Hemati

This paper presents the Safe Sequential Quadratically Constrained Quadratic Programming (SS-QCQP) algorithm, a first-order method for smooth inequality-constrained nonconvex optimization that guarantees feasibility at every iteration. The…

Optimization and Control · Mathematics 2025-11-26 Jiarui Wang , Mahyar Fazlyab

Recent strides in nonlinear model predictive control (NMPC) underscore a dependence on numerical advancements to efficiently and accurately solve large-scale problems. Given the substantial number of variables characterizing typical…

Robotics · Computer Science 2024-06-04 Wilson Jallet , Ewen Dantec , Etienne Arlaud , Justin Carpentier , Nicolas Mansard

We consider low-order controller design for large-scale linear time-invariant dynamical systems with inputs and outputs. Model order reduction is a popular technique, but controllers designed for reduced-order models may result in unstable…

Optimization and Control · Mathematics 2018-03-20 Peter Benner , Tim Mitchell , Michael L. Overton

We consider the problem of optimal sparse output feedback controller synthesis for continuous linear time invariant systems when the feedback gain is static and subject to specified structural constraints. Introducing an additional term…

Optimization and Control · Mathematics 2015-06-23 Reza Arastoo , Nader Motee , Mayuresh V. Kothare

Constrained second-order convex optimization algorithms are the method of choice when a high accuracy solution to a problem is needed, due to their local quadratic convergence. These algorithms require the solution of a constrained…

Optimization and Control · Mathematics 2025-06-13 Alejandro Carderera , Sebastian Pokutta

In this paper, we study linearly constrained policy optimization over the manifold of Schur stabilizing controllers, equipped with a Riemannian metric that emerges naturally in the context of optimal control problems. We provide extrinsic…

Optimization and Control · Mathematics 2023-10-27 Shahriar Talebi , Mehran Mesbahi

In this work we describe an Adaptive Regularization using Cubics (ARC) method for large-scale nonconvex unconstrained optimization using Limited-memory Quasi-Newton (LQN) matrices. ARC methods are a relatively new family of optimization…

Optimization and Control · Mathematics 2022-04-21 Jarad Forristal , Joshua Griffin , Wenwen Zhou , Seyedalireza Yektamaram

This paper presents a convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems that are non-convex in the input norm, which is a…

Optimization and Control · Mathematics 2019-11-20 Danylo Malyuta , Michael Szmuk , Behcet Acikmese

Precise representation of large-scale undirected network is the basis for understanding relations within a massive entity set. The undirected network representation task can be efficiently addressed by a symmetry non-negative latent factor…

Machine Learning · Computer Science 2022-03-09 Weiling Li , Xin Luo

An important class of dynamical systems with several practical applications is linear systems with quadratic outputs. These models have the same state equation as standard linear time-invariant systems but differ in their output equations,…

Systems and Control · Electrical Eng. & Systems 2024-08-13 Umair Zulfiqar , Zhi-Hua Xiao , Qiu-Yan Song , Mohammad Monir Uddin , Victor Sreeram