English
Related papers

Related papers: Algorithmic Gaussianization through Sketching: Con…

200 papers

Sketch-and-project is a framework which unifies many known iterative methods for solving linear systems and their variants, as well as further extensions to non-linear optimization problems. It includes popular methods such as randomized…

Optimization and Control · Mathematics 2023-09-20 Michał Dereziński , Elizaveta Rebrova

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

Computation · Statistics 2023-12-12 Søren Højsgaard , Steffen Lauritzen

Sketching algorithms have recently proven to be a powerful approach both for designing low-space streaming algorithms as well as fast polynomial time approximation schemes (PTAS). In this work, we develop new techniques to extend the…

Data Structures and Algorithms · Computer Science 2023-10-31 Gregory Dexter , Petros Drineas , David P. Woodruff , Taisuke Yasuda

3D Gaussian Splatting (3DGS) has witnessed exponential adoption across diverse applications, driving a critical need for semantic-aware 3D Gaussian representations to enable scene understanding and editing tasks. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhaonan Wang , Manyi Li , Changhe Tu

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

We present Stochastic Gaussian Splatting (SGS): the first framework for uncertainty estimation using Gaussian Splatting (GS). GS recently advanced the novel-view synthesis field by achieving impressive reconstruction quality at a fraction…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Luca Savant , Diego Valsesia , Enrico Magli

Sketching has emerged as a powerful technique for speeding up problems in numerical linear algebra, such as regression. In the overconstrained regression problem, one is given an $n \times d$ matrix $A$, with $n \gg d$, as well as an $n…

Data Structures and Algorithms · Computer Science 2017-05-31 Eric Price , Zhao Song , David P. Woodruff

Randomized linear system solvers have become popular as they have the potential to reduce floating point complexity while still achieving desirable convergence rates. One particularly promising class of methods, random sketching solvers,…

Numerical Analysis · Mathematics 2020-12-23 Vivak Patel , Mohammad Jahangoshahi , Daniel Adrian Maldonado

Discrepancy theory provides powerful tools for producing higher-quality objects which "beat the union bound" in fundamental settings throughout combinatorics and computer science. However, this quality has often come at the price of more…

Data Structures and Algorithms · Computer Science 2023-05-16 Arun Jambulapati , Victor Reis , Kevin Tian

We develop a randomized Newton method capable of solving learning problems with huge dimensional feature spaces, which is a common setting in applications such as medical imaging, genomics and seismology. Our method leverages randomized…

Optimization and Control · Mathematics 2019-10-04 Robert M. Gower , Dmitry Kovalev , Felix Lieder , Peter Richtárik

The power of randomized algorithms in numerical methods have led to fast solutions which use the Singular Value Decomposition (SVD) as a core routine. However, given the large data size of modern and the modest runtime of SVD, most…

Machine Learning · Computer Science 2018-12-20 Hui Han Chin , Paul Pu Liang

In all state-of-the-art sketching and coreset techniques for clustering, as well as in the best known fixed-parameter tractable approximation algorithms, randomness plays a key role. For the classic $k$-median and $k$-means problems, there…

Data Structures and Algorithms · Computer Science 2023-10-09 Vincent Cohen-Addad , David Saulpic , Chris Schwiegelshohn

Gaussian Graphical Models (GGM) are often used to describe the conditional correlations between the components of a random vector. In this article, we compare two families of GGM inference methods: nodewise edge selection and penalised…

Random data sketching (or projection) is now a classical technique enabling, for instance, approximate numerical linear algebra and machine learning algorithms with reduced computational complexity and memory. In this context, the…

Signal Processing · Electrical Eng. & Systems 2023-03-09 Rémi Delogne , Vincent Schellekens , Laurent Daudet , Laurent Jacques

Graphical models with change-points are computationally challenging to fit, particularly in cases where the number of observation points and the number of nodes in the graph are large. Focusing on Gaussian graphical models, we introduce an…

Methodology · Statistics 2017-07-17 Yves Atchade , Leland Bybee

Estimating frequencies of elements appearing in a data stream is a key task in large-scale data analysis. Popular sketching approaches to this problem (e.g., CountMin and CountSketch) come with worst-case guarantees that probabilistically…

Data Structures and Algorithms · Computer Science 2023-12-13 Anders Aamand , Justin Y. Chen , Huy Lê Nguyen , Sandeep Silwal , Ali Vakilian

Probabilistic ideas and tools have recently begun to permeate into several fields where they had traditionally not played a major role, including fields such as numerical linear algebra and optimization. One of the key ways in which these…

Numerical Analysis · Mathematics 2016-12-20 Robert M. Gower

We present and analyze an algorithm designed for addressing vector-valued regression problems involving possibly infinite-dimensional input and output spaces. The algorithm is a randomized adaptation of reduced rank regression, a technique…

Machine Learning · Computer Science 2024-01-01 Giacomo Turri , Vladimir Kostic , Pietro Novelli , Massimiliano Pontil

In this paper, we investigate effective sketching schemes via sparsification for high dimensional multilinear arrays or tensors. More specifically, we propose a novel tensor sparsification algorithm that retains a subset of the entries of a…

Methodology · Statistics 2017-11-17 Dong Xia , Ming Yuan

The Count-Min sketch is an important and well-studied data summarization method. It allows one to estimate the count of any item in a stream using a small, fixed size data sketch. However, the accuracy of the sketch depends on…

Data Structures and Algorithms · Computer Science 2018-11-13 Daniel Ting