English
Related papers

Related papers: Direct optimization of BPX preconditioners

200 papers

We study finite-difference approximations of both Poisson and Poisson-Boltzmann (PB) electrostatic energy functionals for periodic structures constrained by Gauss' law and a class of local algorithms for minimizing the finite-difference…

Numerical Analysis · Mathematics 2024-09-25 Bo Li , Qian Yin , Shenggao Zhou

This paper introduces the Nystr\"om PCG algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nystr\"om method to form a low-rank approximation of the matrix, which leads to an efficient…

Numerical Analysis · Mathematics 2021-12-20 Zachary Frangella , Joel A. Tropp , Madeleine Udell

This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal…

We introduce a novel method for bounding high-order multi-dimensional polynomials in finite element approximations. The method involves precomputing optimal piecewise-linear bounding boxes for polynomial basis functions, which can then be…

Numerical Analysis · Mathematics 2025-04-17 Tarik Dzanic , Tzanio Kolev , Ketan Mittal

In this article we present a new multigrid preconditioner for the linear systems arising in the semismooth Newton method solution of certain control-constrained, quadratic distributed optimal control problems. Using a piecewise constant…

Numerical Analysis · Mathematics 2016-02-16 Andrei Draganescu , Jyoti Saraswat

This paper proves, in very general settings, that convex risk minimization is a procedure to select a unique conditional probability model determined by the classification problem. Unlike most previous work, we give results that are general…

Machine Learning · Computer Science 2015-06-16 Matus Telgarsky , Miroslav Dudík , Robert Schapire

This work focuses on the problem of exact model reduction of positive linear systems, by leveraging minimal realization theory. While determining the existence of a positive reachable realization remains in general an open problem, we are…

Systems and Control · Electrical Eng. & Systems 2025-09-18 Marco Cortese , Tommaso Grigoletto , Francesco Ticozzi , Augusto Ferrante

In this paper we are concerned with a class of optimization problems involving the $p(x)$-Laplacian operator, which arise in imaging and signal analysis. We study the well-posedness of this kind of problems in an amalgam space considering…

Numerical Analysis · Mathematics 2023-04-19 Sergio González-Andrade , María de los Ángeles Silva

For real matrices of full column-rank, we analyze the conditioning of several types of normal equations that are preconditioned by a randomized preconditioner computed in lower precision. These include symmetrically preconditioned normal…

Numerical Analysis · Mathematics 2026-03-18 James E. Garrison , Ilse C. F. Ipsen

We focus on inverse preconditioners based on minimizing $F(X) = 1-\cos(XA,I)$, where $XA$ is the preconditioned matrix and $A$ is symmetric and positive definite. We present and analyze gradient-type methods to minimize $F(X)$ on a suitable…

Numerical Analysis · Mathematics 2015-11-25 Jean-Paul Chehab , Marcos Raydan

This paper analyzes two eXtended finite element methods (XFEMs) for linear quadratic optimal control problems governed by Poisson equation in non-convex domains. We follow the variational discretization concept to discretize the continuous…

Numerical Analysis · Mathematics 2018-08-06 Tao Wang , Chao Chao Yang , Xiaoping Xie

This paper studies approximate solutions of a linear fractional vector optimization problem without requiring boundedness of the constraint set. We establish necessary and sufficient conditions for approximating weakly efficient points of…

Optimization and Control · Mathematics 2024-12-12 Nguyen Thi Thu Huong

This paper addresses a novel data science problem, prescriptive price optimization, which derives the optimal price strategy to maximize future profit/revenue on the basis of massive predictive formulas produced by machine learning. The…

Optimization and Control · Mathematics 2016-05-25 Shinji Ito , Ryohei Fujimaki

Automated hyperparameter search in machine learning, especially for deep learning models, is typically formulated as a bilevel optimization problem, with hyperparameter values determined by the upper level and the model learning achieved by…

Machine Learning · Computer Science 2024-12-06 Meltem Apaydin Ustun , Liang Xu , Bo Zeng , Xiaoning Qian

We show that necessary and sufficient conditions of optimality in periodic optimization problems can be stated in terms of a solution of the corresponding HJB inequality, the latter being equivalent to a max-min type variational problem…

Optimization and Control · Mathematics 2013-09-10 Vladimir Gaitsgory , Ludmila Manic

We develop algorithms for inner approximating the cone of positive semidefinite matrices via linear programming and second order cone programming. Starting with an initial linear algebraic approximation suggested recently by Ahmadi and…

Optimization and Control · Mathematics 2016-03-14 Amir Ali Ahmadi , Sanjeeb Dash , Georgina Hall

The paper is devoted to deriving novel second-order necessary and sufficient optimality conditions for local minimizers in rather general classes of nonsmooth unconstrained and constrained optimization problems in finite-dimensional spaces.…

Optimization and Control · Mathematics 2025-01-07 Pham Duy Khanh , Vu Vinh Huy Khoa , Boris S. Mordukhovich , Vo Thanh Phat

Circulant preconditioners are commonly used to accelerate the rate of convergence of iterative methods when solving linear systems of equations with a Toeplitz matrix. Block extensions that can be applied when the system has a block…

Numerical Analysis · Mathematics 2016-09-06 L. Dykes , S. Noschese , L. Reichel

Data-driven decision-making processes increasingly utilize end-to-end learnable deep neural networks to render final decisions. Sometimes, the output of the forward functions in certain layers is determined by the solutions to mathematical…

Machine Learning · Computer Science 2024-12-31 Jianming Pan , Zeqi Ye , Xiao Yang , Xu Yang , Weiqing Liu , Lewen Wang , Jiang Bian

We provide novel theoretical results regarding local optima of regularized $M$-estimators, allowing for nonconvexity in both loss and penalty functions. Under restricted strong convexity on the loss and suitable regularity conditions on the…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh , Martin J. Wainwright