English
Related papers

Related papers: Scalable matrix-free adaptive product-convolution …

200 papers

We propose a novel preconditioned inexact primal-dual interior point method for constrained convex quadratic programming problems. The algorithm we describe invokes the preconditioned conjugate gradient method on a new reduced Schur…

Numerical Analysis · Mathematics 2021-12-28 Samah Karim , Edgar Solomonik

We devise a numerical scheme for the time evolution of matrix product operators by adapting the time-dependent variational principle for matrix product states [J. Haegeman et al, Phys. Rev. B 94, 165116 (2016)]. A simple augmentation of the…

Quantum Physics · Physics 2019-01-01 Christian B. Mendl

Preconditioning is a crucial operation in gradient-based numerical optimisation. It helps decrease the local condition number of a function by appropriately transforming its gradient. For a convex function, where the gradient can be…

Optimization and Control · Mathematics 2023-08-29 Dmitrii A. Pasechnyuk , Alexander Gasnikov , Martin Takáč

This work investigates finite differences and the use of interpolation models to obtain approximations to the first and second derivatives of a function. Here, it is shown that if a particular set of points is used in the interpolation…

Optimization and Control · Mathematics 2020-01-24 Ian D. Coope , Rachael Tappenden

For low-dimensional data sets with a large amount of data points, standard kernel methods are usually not feasible for regression anymore. Besides simple linear models or involved heuristic deep learning models, grid-based discretizations…

Machine Learning · Computer Science 2019-03-01 Bastian Bohn , Michael Griebel , Jens Oettershagen

Gaussian processes (GPs) offer appealing properties but are costly to train at scale. Sparse variational GP (SVGP) approximations reduce cost yet still rely on Cholesky decompositions of kernel matrices, ill-suited to low-precision,…

Machine Learning · Statistics 2026-04-02 Stefano Cortinovis , Laurence Aitchison , Stefanos Eleftheriadis , Mark van der Wilk

We show that adaptive proximal gradient methods for convex problems are not restricted to traditional Lipschitzian assumptions. Our analysis reveals that a class of linesearch-free methods is still convergent under mere local H\"older…

Optimization and Control · Mathematics 2024-07-08 Konstantinos A. Oikonomidis , Emanuel Laude , Puya Latafat , Andreas Themelis , Panagiotis Patrinos

In this paper we extend the hierarchical model reduction framework based on reduced basis techniques for the application to nonlinear partial differential equations. The major new ingredient to accomplish this goal is the introduction of…

Numerical Analysis · Mathematics 2017-02-27 Kathrin Smetana , Mario Ohlberger

In this paper, we propose a unified two-phase scheme to accelerate any high-order regularized tensor approximation approach on the smooth part of a composite convex optimization model. The proposed scheme has the advantage of not needing to…

Optimization and Control · Mathematics 2020-07-06 Bo Jiang , Tianyi Lin , Shuzhong Zhang

This paper investigates the representation theory of the algebra of partially transposed permutation operators, $\mathcal{A}^d_{p,p}$, which provides a matrix representation for the abstract walled Brauer algebra. This algebra has recently…

Quantum Physics · Physics 2026-02-05 Michał Studziński , Tomasz Młynik , Marek Mozrzymas , Michał Horodecki , Dmitry Grinko

This paper proposes a new method for estimating sparse precision matrices in the high dimensional setting. It has been popular to study fast computation and adaptive procedures for this problem. We propose a novel approach, called Sparse…

Methodology · Statistics 2016-12-23 Weidong Liu , Xi Luo

High-dimensional interpolation problems appear in various applications of uncertainty quantification, stochastic optimization and machine learning. Such problems are computationally expensive and request the use of adaptive grid generation…

Numerical Analysis · Mathematics 2025-05-26 Hendrik Wilka , Jens Lang

Certain classes of CUR algorithms, also referred to as cross or pseudoskeleton algorithms, are widely used for low-rank matrix approximation when direct access to all matrix entries is costly. Their key advantage lies in constructing a…

Numerical Analysis · Mathematics 2025-10-02 Grishma Palkar , Hessam Babaee

The discretization of non-local operators, e.g., solution operators of partial differential equations or integral operators, leads to large densely populated matrices. $\mathcal{H}^2$-matrices take advantage of local low-rank structures in…

Numerical Analysis · Mathematics 2024-03-11 Steffen Börm

This paper develops a parameter-free adaptive proximal bundle method with two important features: 1) adaptive choice of variable prox stepsizes that "closely fits" the instance under consideration; and 2) adaptive criterion for making the…

Optimization and Control · Mathematics 2024-10-29 Renato D. C. Monteiro , Honghao Zhang

Operators with fractional perturbations are crucial components for robust preconditioning of interface-coupled multiphysics systems. However, in case the perturbation is strong, standard approaches can fail to provide scalable approximation…

Numerical Analysis · Mathematics 2022-12-01 Miroslav Kuchta

This study presents novel strategies for improving the node-level performance of matrix-free evaluation of continuous and discontinuous Galerkin spatial discretizations on unstructured tetrahedral grids. In our approach the underlying…

Numerical Analysis · Mathematics 2025-09-15 Dominik Still , Niklas Fehn , Wolfgang A. Wall , Martin Kronbichler

We present new convolution based smooth approximations to the absolute value function and apply them to construct gradient based algorithms such as the nonlinear conjugate gradient scheme to obtain sparse, regularized solutions of linear…

Numerical Analysis · Mathematics 2015-07-02 Sergey Voronin , Gorkem Ozkaya , Davis Yoshida

In this paper, we consider a broad class of nonsmooth and nonconvex fractional programs, where the numerator can be written as the sum of a continuously differentiable convex function whose gradient is Lipschitz continuous and a proper…

Optimization and Control · Mathematics 2022-01-19 Radu Ioan Boţ , Minh N. Dao , Guoyin Li

This manuscript presents an adaptive high order discretization technique for elliptic boundary value problems. The technique is applied to an updated version of the Hierarchical Poincar\'e-Steklov (HPS) method. Roughly speaking, the HPS…

Numerical Analysis · Mathematics 2018-07-03 Peter Geldermans , Adrianna Gillman