English
Related papers

Related papers: Novel technique based on L\'eja Points Approximati…

200 papers

Polynomial Krylov subspace methods are among the most widely used methods for approximating $f(A)b$, the action of a matrix function on a vector, in particular when $A$ is large and sparse. When $A$ is Hermitian positive definite, the…

Numerical Analysis · Mathematics 2025-03-07 Marcel Schweitzer

In theory, the Lanczos algorithm generates an orthogonal basis of the corresponding Krylov subspace. However, in finite precision arithmetic, the orthogonality and linear independence of the computed Lanczos vectors is usually lost quickly.…

Numerical Analysis · Mathematics 2021-06-07 Dorota Šimonová , Petr Tichý

We use available measurements to estimate the unknown parameters (variance, smoothness parameter, and covariance length) of a covariance function by maximizing the joint Gaussian log-likelihood function. To overcome cubic complexity in the…

Computation · Statistics 2018-09-13 Alexander Litvinenko , Ying Sun , Marc G. Genton , David Keyes

We consider the problem of computing a positive definite $p \times p$ inverse covariance matrix aka precision matrix $\theta=(\theta_{ij})$ which optimizes a regularized Gaussian maximum likelihood problem, with the elastic-net regularizer…

Statistics Theory · Mathematics 2015-09-02 Yves F. Atchadé , Rahul Mazumder , Jie Chen

The integrated nested Laplace approximations (INLA) method has become a widely utilized tool for researchers and practitioners seeking to perform approximate Bayesian inference across various fields of application. To address the growing…

Computation · Statistics 2023-11-15 Esmail Abdul-Fattah , Janet Van Niekerk , Haavard Rue

Determinantal Point Processes (DPPs) are a widely used probabilistic model for negatively correlated sets. DPPs have been successfully employed in Machine Learning applications to select a diverse, yet representative subset of data. In…

Computational Complexity · Computer Science 2026-02-27 Elena Grigorescu , Brendan Juba , Karl Wimmer , Ning Xie

The Johnson--Lindenstrauss (JL) lemma is a powerful tool for dimensionality reduction in modern algorithm design. The lemma states that any set of high-dimensional points in a Euclidean space can be flattened to lower dimensions while…

Probability · Mathematics 2024-11-08 Kwassi Joseph Dzahini , Stefan M. Wild

Pseudospectra and structured pseudospectra are important tools for the analysis of matrices. Their computation, however, can be very demanding for all but small matrices. A new approach to compute approximations of pseudospectra and…

Numerical Analysis · Mathematics 2016-11-16 Silvia Noschese , Lothar Reichel

Approximating the action of a matrix function $f(\mathbf{A})$ on a vector $\mathbf{b}$ is an increasingly important primitive in machine learning, data science, and statistics, with applications such as sampling high dimensional Gaussians,…

Numerical Analysis · Mathematics 2024-11-07 Noah Amsel , Tyler Chen , Anne Greenbaum , Cameron Musco , Chris Musco

In this paper we shed more light on determinants of interval matrices. Computing the exact bounds on a determinant of an interval matrix is an NP-hard problem. Therefore, attention is first paid to approximations. NP-hardness of both…

Numerical Analysis · Mathematics 2018-09-12 Jaroslav Horáček , Milan Hladík , Josef Matějka

We analyze a novel multi-level version of a recently introduced compressed sensing (CS) Petrov-Galerkin (PG) method from [H. Rauhut and Ch. Schwab: Compressive Sensing Petrov-Galerkin approximation of high-dimensional parametric operator…

Numerical Analysis · Mathematics 2017-12-19 Jean-Luc Bouchot , Holger Rauhut , Christoph Schwab

This paper proposes a new method for estimating sparse precision matrices in the high dimensional setting. It has been popular to study fast computation and adaptive procedures for this problem. We propose a novel approach, called Sparse…

Methodology · Statistics 2016-12-23 Weidong Liu , Xi Luo

We develop and analyze a set of new sequential simulation-optimization algorithms for large-scale multi-dimensional discrete optimization via simulation problems with a convexity structure. The "large-scale" notion refers to that the…

Optimization and Control · Mathematics 2022-01-20 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

We present randomized algorithms for estimating the trace and deter- minant of Hermitian positive semi-definite matrices. The algorithms are based on subspace iteration, and access the matrix only through matrix vector products. We analyse…

Numerical Analysis · Mathematics 2017-02-17 Arvind K. Saibaba , Alen Alexanderian , Ilse C. F. Ipsen

$D$-optimal designs originate in statistics literature as an approach for optimal experimental designs. In numerical analysis points and weights resulting from maximal determinants turned out to be useful for quadrature and interpolation.…

Numerical Analysis · Mathematics 2024-12-04 Felix Bartel , Lutz Kämmerer , Kateryna Pozharska , Martin Schäfer , Tino Ullrich

In this paper we present a method for matrix inversion based on Cholesky decomposition with reduced number of operations by avoiding computation of intermediate results; further, we use fixed point simulations to compare the numerical…

Mathematical Software · Computer Science 2013-10-21 Aravindh Krishnamoorthy , Deepak Menon

The Lanczos method is one of the most powerful and fundamental techniques for solving an extremal symmetric eigenvalue problem. Convergence-based error estimates depend heavily on the eigenvalue gap. In practice, this gap is often…

Numerical Analysis · Mathematics 2020-09-17 John C. Urschel

We apply novel inner-iteration preconditioned Krylov subspace methods to the interior-point algorithm for linear programming (LP). Inner-iteration preconditioners recently proposed by Morikuni and Hayami enable us to overcome the severe…

Optimization and Control · Mathematics 2021-11-09 Yiran Cui , Keiichi Morikuni , Takashi Tsuchiya , Ken Hayami

This paper provides a finite-time analysis of linear stochastic approximation (LSA) algorithms with fixed step size, a core method in statistics and machine learning. LSA is used to compute approximate solutions of a $d$-dimensional linear…

Machine Learning · Statistics 2023-03-30 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov

Optimal experimental designs are probability measures with finite support enjoying an optimality property for the computation of least squares estimators. We present an algorithm for computing optimal designs on finite sets based on the…

Numerical Analysis · Mathematics 2022-01-11 Federico Piazzon