English
Related papers

Related papers: Uniform Approximation of Eigenproblems of a Large-…

200 papers

We study the problem of approximating a matrix $\mathbf{A}$ with a matrix that has a fixed sparsity pattern (e.g., diagonal, banded, etc.), when $\mathbf{A}$ is accessed only by matrix-vector products. We describe a simple randomized…

Data Structures and Algorithms · Computer Science 2024-03-27 Noah Amsel , Tyler Chen , Feyza Duman Keles , Diana Halikias , Cameron Musco , Christopher Musco

In many contexts the modal properties of a structure change, either due to the impact of a changing environment, fatigue, or due to the presence of structural damage. For example during flight, an aircraft's modal properties are known to…

Machine Learning · Computer Science 2018-12-12 Prasad Cheema , Mehrisadat M. Alamdari , Gareth A. Vio

Meaningful comparison between sets of observations often necessitates alignment or registration between them, and the resulting optimization problems range in complexity from those admitting simple closed-form solutions to those requiring…

Methodology · Statistics 2025-10-08 Hajg Jasa , Ronny Bergmann , Christian Kümmerle , Avanti Athreya , Zachary Lubberts

Despite the recent progress in hyperparameter optimization (HPO), available benchmarks that resemble real-world scenarios consist of a few and very large problem instances that are expensive to solve. This blocks researchers and…

Machine Learning · Computer Science 2019-11-26 Aaron Klein , Zhenwen Dai , Frank Hutter , Neil Lawrence , Javier Gonzalez

We present a successive constraint approach that makes it possible to cheaply solve large-scale linear matrix inequalities for a large number of parameter values. The efficiency of our method is made possible by an offline/online…

Numerical Analysis · Mathematics 2017-08-08 Robert O'Connor

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

We derive, similar to Lau and Riha, a matrix formulation of a general best approximation theorem of Singer for the special case of spectral approximations of a given matrix from a given subspace. Using our matrix formulation we describe the…

Numerical Analysis · Mathematics 2025-06-12 Vance Faber , Jörg Liesen , Petr Tichý

This manuscript is superseded by Constantine, Dow, and Wang's "Active Subspaces in Theory and Practice: Applications to Kriging Surfaces" [SIAM J. of Sci. Comput., 36 (2014), pp. A1500-A1524]. Many multivariate functions encountered in…

Numerical Analysis · Mathematics 2014-08-26 Paul G. Constantine , Qiqi Wang

With appropriately chosen sampling probabilities, sampling-based random projection can be used to implement large-scale statistical methods, substantially reducing computational cost while maintaining low statistical error. However,…

Machine Learning · Statistics 2026-01-13 Yifan Chen , Yun Yang

In this paper, we consider the problem of approximating a given matrix with a matrix whose eigenvalues lie in some specific region \Omega, within the complex plane. More precisely, we consider three types of regions and their intersections:…

Optimization and Control · Mathematics 2024-12-20 Neelam Choudhary , Nicolas Gillis , Punit Sharma

Subspace methods are commonly used for finding approximate eigenvalues and singular values of large-scale matrices. Once a subspace is found, the Rayleigh-Ritz method (for symmetric eigenvalue problems) and Petrov-Galerkin projection (for…

Numerical Analysis · Mathematics 2025-10-07 Irina-Beatrice Haas , Yuji Nakatsukasa

We develop methods for nonparametric uniform inference in cost-sensitive binary classification, a framework that encompasses maximum score estimation, predicting utility maximizing actions, and policy learning. These problems are well known…

Econometrics · Economics 2025-12-16 Nan Liu , Yanbo Liu , Yuya Sasaki , Yuanyuan Wan

Numerical methods for the optimal feedback control of high-dimensional dynamical systems typically suffer from the curse of dimensionality. In the current presentation, we devise a mesh-free data-based approximation method for the value…

Optimization and Control · Mathematics 2023-05-11 Tobias Ehring , Bernard Haasdonk

The problem of recovering a matrix of low rank from an incomplete and possibly noisy set of linear measurements arises in a number of areas. In order to derive rigorous recovery results, the measurement map is usually modeled…

Information Theory · Computer Science 2015-07-28 Maryia Kabanava , Richard Kueng , Holger Rauhut , Ulrich Terstiege

In this contribution we present an accelerated optimization-based approach for combined state and parameter reduction of a parametrized linear control system which is then used as a surrogate model in a Bayesian inverse setting. Following…

Optimization and Control · Mathematics 2016-08-22 Christian Himpe , Mario Ohlberger

In the present work we show that the joint probability distribution of the eigenvalues can be expressed in terms of a differential operator acting on the distribution of some other matrix quantities. Those quantities might be the diagonal…

Mathematical Physics · Physics 2023-03-13 Mario Kieburg , Jiyuan Zhang

An important yet challenging problem in numerical linear algebra is finding a principal submatrix with maximum determinant from a given symmetric positive semidefinite matrix. This problem arises in experimental design, statistics, and…

Optimization and Control · Mathematics 2026-05-26 Hao Hu , Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

In this paper, we present a unified framework for reduced basis approximations of parametrized partial differential equations defined on parameter-dependent domains. Our approach combines unfitted finite element methods with both classical…

Numerical Analysis · Mathematics 2025-11-24 Nicholas Mueller , Santiago Badia , Yiran Zhao

With computational models becoming more expensive and complex, surrogate models have gained increasing attention in many scientific disciplines and are often necessary to conduct sensitivity studies, parameter optimization etc. In the…

Methodology · Statistics 2023-07-24 Matthias Fischer , Carsten Proppe

Kernel matrices are ubiquitous in computational mathematics, often arising from applications in machine learning and scientific computing. In two or three spatial or feature dimensions, such problems can be approximated efficiently by a…

Numerical Analysis · Mathematics 2025-11-07 Abraham Khan , Chao Chen , Vishwas Rao , Arvind K. Saibaba