中文
相关论文

相关论文: A Simple and Fast Coordinate-Descent Augmented-Lag…

200 篇论文

Many problems in machine learning and other fields can be (re)for-mulated as linearly constrained separable convex programs. In most of the cases, there are multiple blocks of variables. However, the traditional alternating direction method…

数值分析 · 计算机科学 2014-05-30 Zhouchen Lin , Risheng Liu , Huan Li

This paper studies the optimal control problem for discrete-time nonlinear systems and an approximate dynamic programming-based Model Predictive Control (MPC) scheme is proposed for minimizing a quadratic performance measure. In the…

系统与控制 · 电气工程与系统科学 2023-12-12 Keerthi Chacko , Midhun T. Augustine , S. Janardhanan , Deepak U. Patil , I. N. Kar

Nonconvex and nonsmooth problems have recently attracted considerable attention in machine learning. However, developing efficient methods for the nonconvex and nonsmooth optimization problems with certain performance guarantee remains a…

最优化与控制 · 数学 2019-02-07 Ehsan Kazemi , Liqiang Wang

This paper investigates algorithms for solving distributed consensus optimization problems that are non-convex. Since Typical ALADIN (Typical Augmented Lagrangian based Alternating Direction Inexact Newton Method, T-ALADIN for short) [1] is…

最优化与控制 · 数学 2023-06-12 Xu Du , Jingzhe Wang

Random permutation is observed to be powerful for optimization algorithms: for multi-block ADMM (alternating direction method of multipliers), while the classical cyclic version divergence, the randomly permuted version converges in…

最优化与控制 · 数学 2019-01-03 Ruoyu Sun , Zhi-Quan Luo , Yinyu Ye

This paper addresses problems of second-order cone programming important in optimization theory and applications. The main attention is paid to the augmented Lagrangian method (ALM) for such problems considered in both exact and inexact…

最优化与控制 · 数学 2021-07-07 Nguyen T. V. Hang , Boris S. Mordukhovich , M. Ebrahim Sarabi

Model Predictive Control (MPC) offers rigorous safety and performance guarantees but is computationally intensive. Approximate MPC (AMPC) aims to circumvent this drawback by learning a computationally cheaper surrogate policy. Common…

系统与控制 · 电气工程与系统科学 2025-11-19 Elias Milios , Kim P. Wabersich , Felix Berkel , Felix Gruber , Melanie N. Zeilinger

This work presents Controllable Layer Decomposition (CLD), a method for achieving fine-grained and controllable multi-layer separation of raster images. In practical workflows, designers typically generate and edit each RGBA layer…

图形学 · 计算机科学 2025-11-26 Zihao Liu , Zunnan Xu , Shi Shu , Jun Zhou , Ruicheng Zhang , Zhenchao Tang , Xiu Li

Conic programming has well-documented merits in a gamut of signal processing and machine learning tasks. This contribution revisits a recently developed first-order conic descent (CD) solver, and advances it in three aspects: intuition,…

最优化与控制 · 数学 2023-08-16 Bingcong Li , Georgios B. Giannakis

Interior point methods for solving linearly constrained convex programming involve a variable projection matrix at each iteration to deal with the linear constraints. This matrix often becomes ill-conditioned near the boundary of the…

最优化与控制 · 数学 2024-12-31 Xun Qian , Li-Zhi Liao , Jie Sun

Sampling from a log-concave distribution function is one core problem that has wide applications in Bayesian statistics and machine learning. While most gradient free methods have slow convergence rate, the Langevin Monte Carlo (LMC) that…

机器学习 · 统计学 2020-10-23 Zhiyan Ding , Qin Li

Block coordinate descent (BCD) methods approach optimization problems by performing gradient steps along alternating subgroups of coordinates. This is in contrast to full gradient descent, where a gradient step updates all coordinates…

数值分析 · 数学 2019-07-29 Simon Rabanser , Lukas Neumann , Markus Haltmeier

Model predictive control (MPC) is an optimal control technique which involves solving a sequence of constrained optimization problems across a given time horizon. In this paper, we introduce a category theoretic framework for constructing…

最优化与控制 · 数学 2024-03-12 Tyler Hanks , Baike She , Matthew Hale , Evan Patterson , Matthew Klawonn , James Fairbanks

Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the…

最优化与控制 · 数学 2022-01-19 Youbang Sun , Mahyar Fazlyab , Shahin Shahrampour

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

机器学习 · 统计学 2015-11-24 Zhanxing Zhu , Amos J. Storkey

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep neural networks, to…

最优化与控制 · 数学 2023-05-31 Ilgee Hong , Sen Na , Michael W. Mahoney , Mladen Kolar

This paper presents a distributed optimization algorithm tailored to solve optimization problems arising in smart grids. In detail, we propose a variant of the Augmented Lagrangian based Alternating Direction Inexact Newton (ALADIN) method,…

系统与控制 · 电气工程与系统科学 2020-04-06 Yuning Jiang , Philipp Sauerteig , Boris Houska , Karl Worthmann

This paper presents a model predictive control (MPC) for dynamic systems whose nonlinearity and uncertainty are modelled by deep neural networks (NNs), under input and state constraints. Since the NN output contains a high-order complex…

系统与控制 · 电气工程与系统科学 2024-05-20 Jianglin Lan

This paper deals with model predictive control problems for large scale dynamical systems with cyclic symmetry. Based on the properties of block circulant matrices, we introduce a complex-valued coordinate transformation that block…

最优化与控制 · 数学 2019-04-09 Idris Kempf , Paul J. Goulart , Stephen Duncan

This paper describes the Parametrized Derivative-Free Model Predictive Control pdf-mpc package, a matlab coder-based set of subroutines that enables a model predictive control problem to be defined and solved. the pdf-mpc is made available…

系统与控制 · 计算机科学 2017-04-04 Mazen Alamir