English
Related papers

Related papers: Sequential Hierarchical Least-Squares Programming …

200 papers

Motivated by TRACE algorithm [Curtis et al. 2017], we propose a trust region algorithm for finding second order stationary points of a linearly constrained non-convex optimization problem. We show the convergence of the proposed algorithm…

Optimization and Control · Mathematics 2019-04-16 Maher Nouiehed , Meisam Razaviyayn

We study $\ell^1$ regularized least squares optimization problem in a separable Hilbert space. We show that the iterative soft-thresholding algorithm (ISTA) converges linearly, without making any assumption on the linear operator into play…

Optimization and Control · Mathematics 2017-12-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

A series of third- and fifth-order hybrid compact least-squares central weighted essentially non-oscillatory schemes are proposed and applied to curvilinear structured grids for the finite volume method. In smooth regions, compact…

Fluid Dynamics · Physics 2025-08-05 Jianhua Pan , Luxin Li , Ji Yin , Wei-Gang Zeng

A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is…

Optimization and Control · Mathematics 2023-03-01 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side…

Optimization and Control · Mathematics 2014-09-19 Negin Bagherpour , Nezam Mahdavi-Amiri

We consider variants of trust-region and cubic regularization methods for non-convex optimization, in which the Hessian matrix is approximated. Under mild conditions on the inexact Hessian, and using approximate solution of the…

Optimization and Control · Mathematics 2019-05-15 Peng Xu , Fred Roosta , Michael W. Mahoney

Trust-region algorithms can be applied to very abstract optimization problems because they do not require a specific direction of descent or gradient. This has lead to recent interest in them, in particular in the area of integer optimal…

Optimization and Control · Mathematics 2025-06-12 Paul Manns

We consider optimal control problems that have binary-valued control input functions and a perimeter regularization. We develop and analyze a trust-region algorithm that solves a sequence of subproblems in which the regularization term and…

Optimization and Control · Mathematics 2025-01-15 Paul Manns , Vanja Nikolić

This paper proposes the algorithm NOWPAC (Nonlinear Optimization With Path-Augmented Constraints) for nonlinear constrained derivative-free optimization. The algorithm uses a trust region framework based on fully linear models for the…

Optimization and Control · Mathematics 2015-11-18 F. Augustin , Y. M. Marzouk

Many science and engineering applications involve solving a linear least-squares system formed from some field measurements. In the distributed cyber-physical systems (CPS), often each sensor node used for measurement only knows partial…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-23 Lei Shi , Liang Zhao , Wen-Zhan Song , Goutham Kamath , Yuan Wu , Xuefeng Liu

A stochastic-gradient-based interior-point algorithm for minimizing a continuously differentiable objective function (that may be nonconvex) subject to bound constraints is presented, analyzed, and demonstrated through experimental results.…

Optimization and Control · Mathematics 2024-03-15 Frank E. Curtis , Vyacheslav Kungurtsev , Daniel P. Robinson , Qi Wang

We present a parallel algorithm for the undirected $s,t$-mincut problem with floating-point valued weights. Our overarching algorithm uses an iteratively reweighted least squares framework. This generates a sequence of Laplacian linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-14 Yao Zhu , David F. Gleich

Surface parameterizations are widely applied in computer graphics, medical imaging and transformation optics. In this paper, we rigorously derive the gradient vector and Hessian matrix of the discrete conformal energy for spherical…

Numerical Analysis · Mathematics 2023-12-01 Zhong-Heng Tan , Tiexiang Li , Wen-Wei Lin , Shing-Tung Yau

We propose a sequential minimal optimization method for quantum-classical hybrid algorithms, which converges faster, is robust against statistical error, and is hyperparameter-free. Specifically, the optimization problem of the…

Quantum Physics · Physics 2020-11-04 Ken M. Nakanishi , Keisuke Fujii , Synge Todo

Sampling-based model predictive control (MPC) algorithms, such as model predictive path integral (MPPI), enable approximate, gradient-free solutions to optimal control problems by drawing samples from a proposal distribution, evaluating…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Markus Walker , Marcel Reith-Braun , Daniel Frisch , Uwe D. Hanebeck

Randomized subspace embedding methods have had a great impact on the solution of a linear least squares (LS) problem by reducing its row dimension, leading to a randomized or sketched LS (sLS) problem, and use the solution of the sLS…

Numerical Analysis · Mathematics 2026-02-12 Zhongxiao Jia , Xinyuan Wan

Sparse Subspace Clustering (SSC) has been used extensively for subspace identification tasks due to its theoretical guarantees and relative ease of implementation. However SSC has quadratic computation and memory requirements with respect…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Stephen Tierney , Yi Guo , Junbin Gao

In this article, we develop a trust-region technique to find critical points of unconstrained set optimization problems with the objective set-valued map defined by finitely many twice continuously differentiable functions. The technique is…

Optimization and Control · Mathematics 2025-09-10 Suprova Ghosh , Debdas Ghosh , Christiane Tammer , Xiaopeng Zhao

This contribution presents a hierarchical multigrid approach for the solution of large-scale finite cell problems on both uniform grids and multi-level hp-discretizations. The proposed scheme leverages the hierarchical nature of the basis…

Numerical Analysis · Mathematics 2021-09-08 John Jomo , Oguz Oztoprak , Frits de Prenter , Nils Zander , Stefan Kollmannsberger , Ernst Rank

- We discuss the approximation of distributed null controls for partial differential equations. The main purpose is to determine an approximation of controls that drives the solution from a prescribed initial state at the initial time to…

Optimization and Control · Mathematics 2015-10-14 Arnaud Münch , Pablo Pedregal