English
Related papers

Related papers: Model Approximation Using Cascade of Tree Decompos…

200 papers

The log Gaussian Cox process is a flexible class of point pattern models for capturing spatial and spatio-temporal dependence for point patterns. Model fitting requires approximation of stochastic integrals which is implemented through…

Computation · Statistics 2016-12-04 Shinichiro Shirota , Alan E. Gelfand

There has been an intense development of Bayes graphical model estimation approaches over the past decade - however, most of the existing methods are restricted to moderate dimensions. We propose a novel approach suitable for high…

Methodology · Statistics 2013-08-20 Suprateek Kundu , Veera Baladandayuthapani , Bani K. Mallick

We show how to perform sparse approximate Gaussian elimination for Laplacian matrices. We present a simple, nearly linear time algorithm that approximates a Laplacian by a matrix with a sparse Cholesky factorization, the version of Gaussian…

Data Structures and Algorithms · Computer Science 2016-05-10 Rasmus Kyng , Sushant Sachdeva

In recent years, non-parametric methods utilizing random walks on graphs have been used to solve a wide range of machine learning problems, but in their simplest form they do not scale well due to the quadratic complexity. In this paper, a…

Machine Learning · Computer Science 2012-10-19 Saeed Amizadeh , Bo Thiesson , Milos Hauskrecht

We introduce tree linear cascades, a class of linear structural equation models for which the error variables are uncorrelated but need not be Gaussian nor independent. We show that, in spite of this weak assumption, the tree structure of…

Methodology · Statistics 2022-02-16 Nicholas C. Landolfi , Sanjay Lall

We present a method to approximate Gaussian process regression models for large datasets by considering only a subset of the data. Our approach is novel in that the size of the subset is selected on the fly during exact inference with…

Machine Learning · Computer Science 2023-05-01 Simon Bartels , Kristoffer Stensbo-Smidt , Pablo Moreno-Muñoz , Wouter Boomsma , Jes Frellsen , Søren Hauberg

The log-Gaussian Cox process is a flexible and popular class of point pattern models for capturing spatial and space-time dependence for point patterns. Model fitting requires approximation of stochastic integrals which is implemented…

Computation · Statistics 2018-10-24 Shinichiro Shirota , Sudipto Banerjee

This paper proposes using a sparse-structured multivariate Gaussian to provide a closed-form approximator for the output of probabilistic ensemble models used for dense image prediction tasks. This is achieved through a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ivor J. A. Simpson , Sara Vicente , Neill D. F. Campbell

We present a framework for incorporating prior information into nonparametric estimation of graphical models. To avoid distributional assumptions, we restrict the graph to be a forest and build on the work of forest density estimation…

Methodology · Statistics 2016-05-26 Yuancheng Zhu , Zhe Liu , Siqi Sun

Stochastic dynamics on sparse graphs and disordered systems often lead to complex behaviors characterized by heterogeneity in time and spatial scales, slow relaxation, localization, and aging phenomena. The mathematical tools and…

Disordered Systems and Neural Networks · Physics 2025-06-05 Mattia Tarabolo , Luca Dall'Asta

Spatial statistics often involves Cholesky decomposition of covariance matrices. To ensure scalability to high dimensions, several recent approximations have assumed a sparse Cholesky factor of the precision matrix. We propose a…

Computation · Statistics 2021-09-27 Marcin Jurek , Matthias Katzfuss

We resolve a long-standing open question, about the existence of a constant-factor approximation algorithm for the average-case \textsc{Decision Tree} problem with uniform probability distribution over the hypotheses. We answer the question…

Data Structures and Algorithms · Computer Science 2026-04-29 Michał Szyfelbein

Natural gradients can improve convergence in stochastic variational inference significantly but inverting the Fisher information matrix is daunting in high dimensions. Moreover, in Gaussian variational approximation, natural gradient…

Computation · Statistics 2025-02-05 Linda S. L. Tan

Discovering the causal relationship via recovering the directed acyclic graph (DAG) structure from the observed data is a well-known challenging combinatorial problem. When there are latent variables, the problem becomes even more…

Machine Learning · Statistics 2023-11-02 Yunfeng Cai , Xu Li , Minging Sun , Ping Li

Expectation propagation is a general approach to fast approximate inference for graphical models. The existing literature treats models separately when it comes to deriving and coding expectation propagation inference algorithms. This comes…

Methodology · Statistics 2018-01-17 Wilson Y. Chen , Matt P. Wand

This paper deals with the Gaussian process based approximation of a code which can be run at different levels of accuracy. This method, which is a particular case of co-kriging, allows us to improve a surrogate model of a complex computer…

Statistics Theory · Mathematics 2012-09-25 Loic Le Gratiet

This paper studies the decentralized learning of tree-structured Gaussian graphical models (GGMs) from noisy data. In decentralized learning, data set is distributed across different machines (sensors), and GGMs are widely used to model…

Machine Learning · Computer Science 2021-09-23 Akram Hussain

Kernel methods represent some of the most popular machine learning tools for data analysis. Since exact kernel methods can be prohibitively expensive for large problems, reliable low-rank matrix approximations and high-performance…

Numerical Analysis · Mathematics 2018-04-17 Jianwei Xiao , Ming Gu

We present a canonical way to decompose finite graphs into highly connected local parts. The decomposition depends only on an integer parameter whose choice sets the intended degree of locality. The global structure of the graph, as…

Combinatorics · Mathematics 2025-07-01 Reinhard Diestel , Raphael W. Jacobs , Paul Knappe , Jan Kurkofka

Dense kernel matrices resulting from pairwise evaluations of a kernel function arise naturally in machine learning and statistics. Previous work in constructing sparse approximate inverse Cholesky factors of such matrices by minimizing…

Computation · Statistics 2025-05-12 Stephen Huan , Joseph Guinness , Matthias Katzfuss , Houman Owhadi , Florian Schäfer