English
Related papers

Related papers: Asymptotics for Sketching in Least Squares Regress…

200 papers

Sketching algorithms use random projections to generate a smaller sketched data set, often for the purposes of modelling. Complete and partial sketch regression estimates can be constructed using information from only the sketched data set…

Methodology · Statistics 2023-06-07 R. P. Browne , J. L. Andrews

Iterative Hessian sketch (IHS) is an effective sketching method for modeling large-scale data. It was originally proposed by Pilanci and Wainwright (2016; JMLR) based on randomized sketching matrices. However, it is computationally…

Machine Learning · Statistics 2020-03-10 Aijun Zhang , Hengtao Zhang , Guosheng Yin

Matrix sketching is a powerful tool for reducing the size of large data matrices. Yet there are fundamental limitations to this size reduction when we want to recover an accurate estimator for a task such as least square regression. We show…

Data Structures and Algorithms · Computer Science 2024-05-10 Sachin Garg , Kevin Tan , Michał Dereziński

This survey highlights the recent advances in algorithms for numerical linear algebra that have come from the technique of linear sketching, whereby given a matrix, one first compresses it to a much smaller matrix by multiplying it by a…

Data Structures and Algorithms · Computer Science 2015-02-11 David P. Woodruff

We propose a randomized second-order method for optimization known as the Newton Sketch: it is based on performing an approximate Newton step using a randomly projected or sub-sampled Hessian. For self-concordant functions, we prove that…

Optimization and Control · Mathematics 2015-05-12 Mert Pilanci , Martin J. Wainwright

Sketching and stochastic gradient methods are arguably the most common techniques to derive efficient large scale learning algorithms. In this paper, we investigate their application in the context of nonparametric statistical learning.…

Machine Learning · Statistics 2019-01-25 Luigi Carratino , Alessandro Rudi , Lorenzo Rosasco

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

We consider statistical as well as algorithmic aspects of solving large-scale least-squares (LS) problems using randomized sketching algorithms. For a LS problem with input data $(X, Y) \in \mathbb{R}^{n \times p} \times \mathbb{R}^n$,…

Machine Learning · Statistics 2015-08-26 Garvesh Raskutti , Michael Mahoney

This work considers the problem of learning the Markov parameters of a linear system from observed data. Recent non-asymptotic system identification results have characterized the sample complexity of this problem in the single and…

Optimization and Control · Mathematics 2021-12-09 Han Wang , James Anderson

Random sketching is a dimensionality reduction technique that approximately preserves norms and singular values up to some $O(1)$ distortion factor with high probability. The most popular sketches in literature are the Gaussian sketch and…

Numerical Analysis · Mathematics 2025-08-21 Andrew J. Higgins , Erik G. Boman , Ichitaro Yamazaki

Constrained least squares problems arise in many applications. Their memory and computation costs are expensive in practice involving high-dimensional input data. We employ the so-called "sketching" strategy to project the least squares…

Optimization and Control · Mathematics 2021-09-07 Ke Chen , Ruhui Jin

The sketch-and-project, as a general archetypal algorithm for solving linear systems, unifies a variety of randomized iterative methods such as the randomized Kaczmarz and randomized coordinate descent. However, since it aims to find a…

Numerical Analysis · Mathematics 2022-05-04 Ziyang Yuan , Lu Zhang , Hongxia Wang , Hui Zhang

Recently, Bessa et al. (PODS 2023) showed that sketches based on coordinated weighted sampling theoretically and empirically outperform popular linear sketching methods like Johnson-Lindentrauss projection and CountSketch for the ubiquitous…

Databases · Computer Science 2024-08-23 Majid Daliri , Juliana Freire , Christopher Musco , Aécio Santos , Haoxiang Zhang

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

In second-order optimization, a potential bottleneck can be computing the Hessian matrix of the optimized function at every iteration. Randomized sketching has emerged as a powerful technique for constructing estimates of the Hessian which…

Optimization and Control · Mathematics 2021-07-16 Michał Dereziński , Jonathan Lacotte , Mert Pilanci , Michael W. Mahoney

Overparametrization often helps improve the generalization performance. This paper presents a dual view of overparametrization suggesting that downsampling may also help generalize. Focusing on the proportional regime $m\asymp n \asymp p$,…

Statistics Theory · Mathematics 2023-10-17 Xin Chen , Yicheng Zeng , Siyue Yang , Qiang Sun

The Gaussian graphical model, a popular paradigm for studying relationship among variables in a wide range of applications, has attracted great attention in recent years. This paper considers a fundamental question: When is it possible to…

Statistics Theory · Mathematics 2015-06-04 Zhao Ren , Tingni Sun , Cun-Hui Zhang , Harrison H. Zhou

We consider distributed optimization methods for problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We leverage randomized sketches for reducing the problem dimensions as well as…

Optimization and Control · Mathematics 2022-03-21 Burak Bartan , Mert Pilanci

In this work, we propose a method for speeding up linear regression distributively, while ensuring security. We leverage randomized sketching techniques, and improve straggler resilience in asynchronous systems. Specifically, we apply a…

Information Theory · Computer Science 2022-02-23 Neophytos Charalambides , Hessam Mahdavifar , Mert Pilanci , Alfred O. Hero

Sketching is a dimensionality reduction technique where one compresses a matrix by linear combinations that are chosen at random. A line of work has shown how to sketch the Hessian to speed up each iteration in a second order method, but…

Machine Learning · Computer Science 2021-10-07 Yi Li , Honghao Lin , David P. Woodruff