English
Related papers

Related papers: A Linear-Time Algorithm for Trust Region Problems

200 papers

Linear programming relaxations are central to {\sc map} inference in discrete Markov Random Fields. The ability to properly solve the Lagrangian dual is a critical component of such methods. In this paper, we study the benefit of using…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 Hariprasad Kannan , Nikos Komodakis , Nikos Paragios

Precision matrices play important roles in many practical applications. Motivated by temporally dependent multivariate data in modern social and scientific studies, we consider the statistical inference of precision matrices for…

Methodology · Statistics 2018-12-21 Jinyuan Chang , Yumou Qiu , Qiwei Yao , Tao Zou

We present an algorithm to perform trust-region-based optimization for nonlinear unconstrained problems. The method selectively uses function and gradient evaluations at different floating-point precisions to reduce the overall energy…

Optimization and Control · Mathematics 2022-02-18 Richard J Clancy , Matt Menickelly , Jan Hückelheim , Paul Hovland , Prani Nalluri , Rebecca Gjini

A classical approach for solving discrete time nonlinear control on a finite horizon consists in repeatedly minimizing linear quadratic approximations of the original problem around current candidate solutions. While widely popular in many…

Optimization and Control · Mathematics 2025-07-08 Vincent Roulet , Siddhartha Srinivasa , Maryam Fazel , Zaid Harchaoui

The solution of linear non-autonomous ordinary differential equation systems (also known as the time-ordered exponential) is a computationally challenging problem arising in a variety of applications. In this work, we present and study a…

Numerical Analysis · Mathematics 2022-06-09 S. Cipolla , S. Pozza , M. Redivo-Zaglia , N. Van Buggenhout

We suggest and compare different methods for the numerical solution of Lyapunov like equations with application to control of Markovian jump linear systems. First, we consider fixed point iterations and associated Krylov subspace…

Numerical Analysis · Mathematics 2017-03-14 Tobias Damm , Kazuhiro Sato , Axel Vierling

A gradient-based method is proposed for solving the linear quadratic regulator (LQR) problem for linear systems with nonlinear dependence on time-invariant probabilistic parametric uncertainties. The approach explicitly accounts for model…

Systems and Control · Electrical Eng. & Systems 2026-03-30 Leilei Cui , Richard D. Braatz

We study the problem of estimating the covariance matrix of a high-dimensional distribution when a small constant fraction of the samples can be arbitrarily corrupted. Recent work gave the first polynomial time algorithms for this problem…

Machine Learning · Computer Science 2019-06-12 Yu Cheng , Ilias Diakonikolas , Rong Ge , David Woodruff

A computationally efficient method to solve non-convex programming problems with linear equality constraints is presented. The proposed method is based on a recursively feasible and descending sequential convex programming procedure proven…

Optimization and Control · Mathematics 2018-10-25 Josep Virgili-Llop , Marcello Romano

In this contribution, we are concerned with parameter optimization problems that are constrained by multiscale PDE state equations. As an efficient numerical solution approach for such problems, we introduce and analyze a new relaxed and…

Numerical Analysis · Mathematics 2023-04-13 Tim Keil , Mario Ohlberger

We consider integer and linear programming problems for which the linear constraints exhibit a (recursive) block-structure: The problem decomposes into independent and efficiently solvable sub-problems if a small number of constraints is…

Computational Complexity · Computer Science 2020-08-04 Jana Cslovjecsek , Friedrich Eisenbrand , Christoph Hunkenschröder , Lars Rohwedder , Robert Weismantel

We present a MATLAB implementation of the symmetric rank-one (SC-SR1) method that solves trust-region. subproblems when a limited-memory symmetric rank-one (L-SR1) matrix is used in place of the true Hessian matrix, which can be used for…

Optimization and Control · Mathematics 2021-07-27 Johannes Brust , Oleg Burdakov , Jennifer B. Erway , Roummel F. Marcia , Ya-Xiang Yuan

We propose a bundle trust-region algorithm to minimize locally Lipschitz functions which are potentially nonsmooth and nonconvex. We prove global convergence of our method and show by way of an example that the classical convergence…

Optimization and Control · Mathematics 2015-04-03 Pierre Apkarian , Dominikus Noll , Laleh Ravanbod

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

Let $P$ be a path graph of $n$ vertices embedded in a metric space. We consider the problem of adding a new edge to $P$ so that the radius of the resulting graph is minimized, where any center is constrained to be one of the vertices of…

Data Structures and Algorithms · Computer Science 2020-06-26 Haitao Wang , Yiming Zhao

We study a class of fused lasso problems where the estimated parameters in a sequence are regressed toward their respective observed values (fidelity loss), with $\ell_1$ norm penalty (regularization loss) on the differences between…

Data Structures and Algorithms · Computer Science 2020-05-14 Cheng Lu

In this article, we present a family of numerical approaches to solve high-dimensional linear non-symmetric problems. The principle of these methods is to approximate a function which depends on a large number of variates by a sum of tensor…

Functional Analysis · Mathematics 2012-10-26 Eric Cances , Virginie Ehrlacher , Tony Lelievre

Continuous-time quantum walks can be used to solve the spatial search problem, which is an essential component for many quantum algorithms that run quadratically faster than their classical counterpart, in $\mathcal O(\sqrt n)$ time for $n$…

Quantum Physics · Physics 2021-06-18 Dylan Lewis , Asmae Benhemou , Natasha Feinstein , Leonardo Banchi , Sougato Bose

We provide the first nearly-linear time algorithm for approximating $\ell_{q \rightarrow p}$-norms of non-negative matrices, for $q \geq p \geq 1$. Our algorithm returns a $(1-\varepsilon)$-approximation to the matrix norm in time…

Data Structures and Algorithms · Computer Science 2025-03-26 Étienne Objois , Adrian Vladu

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

Optimization and Control · Mathematics 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra