English
Related papers

Related papers: Efficient and Scalable Kernel Matrix Approximation…

200 papers

We propose the Lanczos network (LanczosNet), which uses the Lanczos algorithm to construct low rank approximations of the graph Laplacian for graph convolution. Relying on the tridiagonal decomposition of the Lanczos algorithm, we not only…

Machine Learning · Computer Science 2019-10-24 Renjie Liao , Zhizhen Zhao , Raquel Urtasun , Richard S. Zemel

One of the main challenges for hierarchical clustering is how to appropriately identify the representative points in the lower level of the cluster tree, which are going to be utilized as the roots in the higher level of the cluster tree…

Machine Learning · Statistics 2021-11-16 Wen-Bo Xie , Zhen Liu , Jaideep Srivastava

In this paper we derive and analyze two algorithms -- referred to as decentralized power method (DPM) and decentralized Lanczos algorithm (DLA) -- for distributed computation of one (the largest) or multiple eigenvalues of a sample…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-29 Federico Penna , Slawomir Stanczak

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Manifold learning and dimensionality reduction techniques are ubiquitous in science and engineering, but can be computationally expensive procedures when applied to large data sets or when similarities are expensive to compute. To date,…

Machine Learning · Statistics 2017-04-05 Keith Levin , Vince Lyzinski

We consider radial complex scaling/perfectly matched layer methods for scalar resonance problems in homogeneous exterior domains. We introduce a new abstract framework to analyze the convergence of domain truncations and discretizations.…

Numerical Analysis · Mathematics 2020-07-21 Martin Halla

The integrated nested Laplace approximations (INLA) method has become a widely utilized tool for researchers and practitioners seeking to perform approximate Bayesian inference across various fields of application. To address the growing…

Computation · Statistics 2023-11-15 Esmail Abdul-Fattah , Janet Van Niekerk , Haavard Rue

We investigate the approximation efficiency of score functions by deep neural networks in diffusion-based generative modeling. While existing approximation theories utilize the smoothness of score functions, they suffer from the curse of…

Machine Learning · Computer Science 2023-09-21 Song Mei , Yuchen Wu

This paper proposes a hierarchical approximate-factor approach to analyzing high-dimensional, large-scale heterogeneous time series data using distributed computing. The new method employs a multiple-fold dimension reduction procedure using…

Methodology · Statistics 2022-04-20 Zhaoxing Gao , Ruey S. Tsay

Hierarchical matrices approximate a given matrix by a decomposition into low-rank submatrices that can be handled efficiently in factorized form. $\mathcal{H}^2$-matrices refine this representation following the ideas of fast multipole…

Numerical Analysis · Mathematics 2024-04-24 Steffen Börm

As the size and richness of available datasets grow larger, the opportunities for solving increasingly challenging problems with algorithms learning directly from data grow at the same pace. Consequently, the capability of learning…

Machine Learning · Computer Science 2019-12-13 Raffaello Camoriano

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

Comparing and aligning large datasets is a pervasive problem occurring across many different knowledge domains. We introduce and study MREC, a recursive decomposition algorithm for computing matchings between data sets. The basic idea is to…

Machine Learning · Statistics 2020-02-24 Andrew J. Blumberg , Mathieu Carriere , Michael A. Mandell , Raul Rabadan , Soledad Villar

Kernel methods are fundamental tools in machine learning that allow detection of non-linear dependencies between data without explicitly constructing feature vectors in high dimensional spaces. A major disadvantage of kernel methods is…

Data Structures and Algorithms · Computer Science 2020-12-23 Thomas D. Ahle , Michael Kapralov , Jakob B. T. Knudsen , Rasmus Pagh , Ameya Velingker , David Woodruff , Amir Zandieh

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus the applicability…

Machine Learning · Computer Science 2017-11-28 Bharath Bhushan Damodaran , Nicolas Courty , Philippe-Henri Gosselin

We employ kernel-based approaches that use samples from a probability distribution to approximate a Kolmogorov operator on a manifold. The self-tuning variable-bandwidth kernel method [Berry & Harlim, Appl. Comput. Harmon. Anal.,…

Numerical Analysis · Mathematics 2022-04-21 Andrew D. Davis , Dimitrios Giannakis

Hierarchical Matrix (H-matrix) is an approximation technique which splits a target dense matrix into multiple submatrices, and where a selected portion of submatrices are low-rank approximated. The technique substantially reduces both time…

Mathematical Software · Computer Science 2019-11-04 Rise Ooi , Takeshi Iwashita , Takeshi Fukaya , Akihiro Ida , Rio Yokota

A thick-restart Lanczos type algorithm is proposed for Hermitian $J$-symmetric matrices. Since Hermitian $J$-symmetric matrices possess doubly degenerate spectra or doubly multiple eigenvalues with a simple relation between the degenerate…

Numerical Analysis · Mathematics 2020-09-14 Ken-Ichi Ishikawa , Tomohiro Sogabe

In representation learning, there has been recent interest in developing algorithms to disentangle the ground-truth generative factors behind a dataset, and metrics to quantify how fully this occurs. However, these algorithms and metrics…

Machine Learning · Computer Science 2022-04-11 Andrew Slavin Ross , Finale Doshi-Velez

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood
‹ Prev 1 3 4 5 6 7 10 Next ›