English
Related papers

Related papers: Algorithmic Gaussianization through Sketching: Con…

200 papers

We improve upon previous oblivious sketching and turnstile streaming results for $\ell_1$ and logistic regression, giving a much smaller sketching dimension achieving $O(1)$-approximation and yielding an efficient optimization problem in…

Data Structures and Algorithms · Computer Science 2023-04-05 Alexander Munteanu , Simon Omlor , David Woodruff

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

3D Gaussian Splatting (3DGS) has emerged as a mainstream solution for novel view synthesis and 3D reconstruction. By explicitly encoding a 3D scene using a collection of Gaussian kernels, 3DGS achieves high-quality rendering with superior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Lei Lan , Tianjia Shao , Zixuan Lu , Yu Zhang , Chenfanfu Jiang , Yin Yang

It is generally known that counting statistics is not correctly described by a Gaussian approximation. Nevertheless, in neutron scattering, it is common practice to apply this approximation to the counting statistics; also at low counting…

Data Analysis, Statistics and Probability · Physics 2020-06-09 Jakob Lassa , Magnus Egede Bøggild , Per Hedegård , Kim Lefmann

Randomized smoothing is a recent technique that achieves state-of-art performance in training certifiably robust deep neural networks. While the smoothing family of distributions is often connected to the choice of the norm used for…

Machine Learning · Computer Science 2022-07-06 Motasem Alfarra , Adel Bibi , Philip H. S. Torr , Bernard Ghanem

This paper argues that randomized linear sketching is a natural tool for on-the-fly compression of data matrices that arise from large-scale scientific simulations and data collection. The technical contribution consists in a new algorithm…

Numerical Analysis · Computer Science 2019-02-26 Joel A. Tropp , Alp Yurtsever , Madeleine Udell , Volkan Cevher

The estimation of small probabilities of failure from computer simulations is a classical problem in engineering, and the Subset Simulation algorithm proposed by Au & Beck (Prob. Eng. Mech., 2001) has become one of the most popular method…

Computation · Statistics 2012-07-10 Ling Li , Julien Bect , Emmanuel Vazquez

In this study, we explore the challenge of efficiently representing scenes with a constrained number of Gaussians. Our analysis shifts from traditional graphics and 2D computer vision to the perspective of point clouds, highlighting the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Guangchi Fang , Bing Wang

Gaussian Splatting (GS) is a novel, state-of-the-art technique for rendering points in a 3D scene by approximating their contribution to image pixels through Gaussian distributions, warranting fast training and real-time rendering. The main…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Joanna Waczyńska , Piotr Borycki , Sławomir Tadeja , Jacek Tabor , Przemysław Spurek

Gaussian graphical modeling has been widely used to explore various network structures, such as gene regulatory networks and social networks. We often use a penalized maximum likelihood approach with the $L_1$ penalty for learning a…

Methodology · Statistics 2017-06-13 Kei Hirose , Hironori Fujisawa , Jun Sese

The nowadays massive amounts of generated and communicated data present major challenges in their processing. While capable of successfully classifying nonlinearly separable objects in various settings, subspace clustering (SC) methods…

Machine Learning · Computer Science 2015-10-07 Panagiotis A. Traganitis , Konstantinos Slavakis , Georgios B. Giannakis

Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using only a limited number of denoising steps, so discretization error is often the dominant…

Machine Learning · Computer Science 2026-05-12 Samuel Hurault , Thomas Moreau , Gabriel Peyré

Low-rank approximation of tensors has been widely used in high-dimensional data analysis. It usually involves singular value decomposition (SVD) of large-scale matrices with high computational complexity. Sketching is an effective data…

Numerical Analysis · Mathematics 2023-01-30 Wandi Dong , Gaohang Yu , Liqun Qi , Xiaohao Cai

Sampling of signals belonging to a low-dimensional subspace has well-documented merits for dimensionality reduction, limited memory storage, and online processing of streaming network data. When the subspace is known, these signals can be…

Information Theory · Computer Science 2019-11-26 Fernando Gama , Antonio G. Marques , Gonzalo Mateos , Alejandro Ribeiro

Scalable algorithms to solve optimization and regression tasks even approximately, are needed to work with large datasets. In this paper we study efficient techniques from matrix sketching to solve a variety of convex constrained regression…

Machine Learning · Computer Science 2019-11-01 Graham Cormode , Charlie Dickens

In recent years, a variety of randomized constructions of sketching matrices have been devised, that have been used in fast algorithms for numerical linear algebra problems, such as least squares regression, low-rank approximation, and the…

Numerical Analysis · Mathematics 2021-02-12 Dong Hu , Shashanka Ubaru , Alex Gittens , Kenneth L. Clarkson , Lior Horesh , Vassilis Kalantzis

We introduce a technique for estimating a structured covariance matrix from observations of a random vector which have been sketched. Each observed random vector $\boldsymbol{x}_t$ is reduced to a single number by taking its inner product…

Information Theory · Computer Science 2015-10-09 Sohail Bahmani , Justin Romberg

A flexible conformal inference method is developed to construct confidence intervals for the frequencies of queried objects in very large data sets, based on a much smaller sketch of those data. The approach is data-adaptive and requires no…

Methodology · Statistics 2022-11-10 Matteo Sesia , Stefano Favaro

Large-sample data became prevalent as data acquisition became cheaper and easier. While a large sample size has theoretical advantages for many statistical methods, it presents computational challenges. Sketching, or compression, is a…

Machine Learning · Statistics 2020-05-11 Alexander F. Lapanowski , Irina Gaynanova

We provide efficient algorithms for the problem of distribution learning from high-dimensional Gaussian data where in each sample, some of the variable values are missing. We suppose that the variables are missing not at random (MNAR). The…

Machine Learning · Computer Science 2025-04-29 Arnab Bhattacharyya , Constantinos Daskalakis , Themis Gouleakis , Yuhao Wang