English
Related papers

Related papers: Novel Pivoted Cholesky Decompositions for Efficien…

200 papers

Iterative algorithms are instrumental in modern numerical simulation for solving systems arising from the discretization of PDEs. They face however significant challenges in industrial applications, such as slow convergence, limit cycle…

Numerical Analysis · Mathematics 2026-05-05 Jeremy Kalfoun , Guillaume Pierrot , John Cagnol

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

It is well-known that the posterior density of linear inverse problems with Gaussian prior and Gaussian likelihood is also Gaussian, hence completely described by its covariance and expectation. Sampling from a Gaussian posterior may be…

Numerical Analysis · Mathematics 2025-02-11 Daniela Calvetti , Erkki Somersalo

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

Kernel methods represent some of the most popular machine learning tools for data analysis. Since exact kernel methods can be prohibitively expensive for large problems, reliable low-rank matrix approximations and high-performance…

Numerical Analysis · Mathematics 2018-04-17 Jianwei Xiao , Ming Gu

Methods for solving scientific computing and inference problems, such as kernel- and neural network-based approaches for partial differential equations (PDEs), inverse problems, and supervised learning tasks, depend crucially on the choice…

Machine Learning · Statistics 2025-10-08 Nicholas H. Nelsen , Houman Owhadi , Andrew M. Stuart , Xianjin Yang , Zongren Zou

Matrix determinants play an important role in data analysis, in particular when Gaussian processes are involved. Due to currently exploding data volumes, linear operations - matrices - acting on the data are often not accessible directly…

Data Analysis, Statistics and Probability · Physics 2015-07-08 Sebastian Dorn , Torsten A. Enßlin

In inverting large sparse matrices, the key difficulty lies in effectively exploiting sparsity during the inversion process. One well-established strategy is the nested dissection, which seeks the so-called sparse Cholesky factorization. We…

Numerical Analysis · Mathematics 2025-05-14 Michał Kos , Krzysztof Podgórski , Hanqing Wu

This work proposes a statistically enhanced framework to address the instability and limited predictive capability of conventional Galerkin-Proper Orthogonal Decomposition (Galerkin-POD) models. The method reformulates the correction of the…

Fluid Dynamics · Physics 2026-04-15 Bijie Yang , Chengyuan Liu , Lu Tian , Yuping Qian , Mingyang Yang

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

Gaussian processes are flexible probabilistic regression models which are widely used in statistics and machine learning. However, a drawback is their limited scalability to large data sets. To alleviate this, full-scale approximations…

Methodology · Statistics 2026-01-13 Tim Gyger , Reinhard Furrer , Fabio Sigrist

Gaussian processes are a versatile probabilistic machine learning model whose effectiveness often depends on good hyperparameters, which are typically learned by maximising the marginal likelihood. In this work, we consider iterative…

Machine Learning · Computer Science 2024-05-29 Jihao Andreas Lin , Shreyas Padhy , Bruno Mlodozeniec , José Miguel Hernández-Lobato

Gaussian graphical models are widely used to infer dependence structures. Bayesian methods are appealing to quantify uncertainty associated with structural learning, i.e., the plausibility of conditional independence statements given the…

Methodology · Statistics 2025-11-05 Deborah Sulem , Jack Jewson , David Rossell

A crucial task in system identification problems is the selection of the most appropriate model class, and is classically addressed resorting to cross-validation or using asymptotic arguments. As recently suggested in the literature, this…

Numerical Analysis · Mathematics 2015-06-09 Silvia Bonettini , Alessandro Chiuso , Marco Prato

Causal discovery is crucial for understanding complex systems and informing decisions. While observational data can uncover causal relationships under certain assumptions, it often falls short, making active interventions necessary. Current…

Machine Learning · Computer Science 2024-06-18 Yuxuan Wang , Mingzhou Liu , Xinwei Sun , Wei Wang , Yizhou Wang

In many applications, data come with a natural ordering. This ordering can often induce local dependence among nearby variables. However, in complex data, the width of this dependence may vary, making simple assumptions such as a constant…

Statistics Theory · Mathematics 2017-12-11 Guo Yu , Jacob Bien

Randomly pivoted Cholesky (RPCholesky) is an algorithm for constructing a low-rank approximation of a positive-semidefinite matrix using a small number of columns. This paper develops an accelerated version of RPCholesky that employs block…

Numerical Analysis · Mathematics 2025-04-08 Ethan N. Epperly , Joel A. Tropp , Robert J. Webber

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

A nonparanormal graphical model is a semiparametric generalization of a Gaussian graphical model for continuous variables in which it is assumed that the variables follow a Gaussian graphical model only after some unknown smooth monotone…

Methodology · Statistics 2021-02-23 Jami J. Mulgrave , Subhashis Ghosal

We consider multi-task regression models where observations are assumed to be a linear combination of several latent node and weight functions, all drawn from Gaussian process (GP) priors that allow nonzero covariance between grouped latent…

Machine Learning · Statistics 2019-07-23 Astrid Dahl , Edwin V. Bonilla