English
Related papers

Related papers: Sketching for Motzkin's Iterative Method for Linea…

200 papers

The Kaczmarz method is an iterative method for solving overcomplete linear systems of equations Ax=b. The randomized version of the Kaczmarz method put forth by Strohmer and Vershynin iteratively projects onto a randomly chosen solution…

Numerical Analysis · Mathematics 2015-06-24 Deanna Needell , Ran Zhao , Anastasios Zouzias

Sketch techniques have been extensively studied in recent years and are especially well-suited to data streaming scenarios, where the sketch summary is updated quickly and compactly. However, it is challenging to recover the current state…

Machine Learning · Computer Science 2026-03-17 Xinyu Yuan , Yan Qiao , Zonghui Wang , Wenzhi Chen

Sketching-based preconditioners have been shown to accelerate the solution of dense least-squares problems with coefficient matrices having substantially more rows than columns. The cost of generating these preconditioners can be reduced by…

Numerical Analysis · Mathematics 2025-06-12 Erin Carson , Ieva Daužickaitė

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

It is shown in this paper that, almost all current prevalent iterative \mbox{methods} for solving linear system of equations can be classified as what we called extended Krylov subspace methods. In this paper a new type of iterative methods…

Numerical Analysis · Mathematics 2016-03-18 Wujian Peng , Shuhua Zhang

Vectorizing hand-drawn sketches is a challenging task, which is of paramount importance for creating CAD vectorized versions for the fashion and creative workflows. This paper proposes a complete framework that automatically transforms…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Luca Donati , Simone Cesano , Andrea Prati

Recent work has explored transforming data sets into smaller, approximate summaries in order to scale Bayesian inference. We examine a related problem in which the parameters of a Bayesian model are very large and expensive to store in…

Machine Learning · Computer Science 2018-10-03 Joseph Tassarotti , Jean-Baptiste Tristan , Michael Wick

We introduce EdgeSketch, a compact graph representation for efficient analysis of massive graph streams. EdgeSketch provides unbiased estimators for key graph properties with controllable variance and supports implementing graph algorithms…

Data Structures and Algorithms · Computer Science 2026-02-24 Jakub Lemiesz , Dingqi Yang , Philippe Cudré-Mauroux

Sketching is a stochastic dimension reduction method that preserves geometric structures of data and has applications in high-dimensional regression, low rank approximation and graph sparsification. In this work, we show that sketching can…

Machine Learning · Statistics 2021-09-17 Zhishen Huang , Stephen Becker

We propose a novel projection-based particle method for solving the McKean-Vlasov stochastic differential equations. Our approach is based on a projection-type estimation of the marginal density of the solution in each time step. The…

Numerical Analysis · Mathematics 2018-08-07 Denis Belomestny , John Schoenmakers

We first propose the regular sketch-and-project method for solving tensor equations with respect to the popular t-product. Then, three adaptive sampling strategies and three corresponding adaptive sketch-and-project methods are derived. We…

Numerical Analysis · Mathematics 2022-10-18 Ling Tang , Yanjun Zhang , Hanyu Li

Physics simulation of slender elastic objects often requires discretization as a polyline. However, constructing a polyline from Gaussian splatting is challenging as Gaussian splatting lacks connectivity information and the configuration of…

Graphics · Computer Science 2026-01-06 Haato Watanabe , Nobuyuki Umetani

We describe a general framework -- compressive statistical learning -- for resource-efficient large-scale learning: the training collection is compressed in one pass into a low-dimensional sketch (a vector of random empirical generalized…

Machine Learning · Statistics 2021-06-23 Rémi Gribonval , Gilles Blanchard , Nicolas Keriven , Yann Traonmilin

Iterative methods are ubiquitous in large-scale scientific computing applications, and a number of approaches based on meta-learning have been recently proposed to accelerate them. However, a systematic study of these approaches and how…

Numerical Analysis · Mathematics 2023-01-31 Sohei Arisaka , Qianxiao Li

This paper develops a new class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized sketching to accelerate subspace projection methods, such as GMRES and Rayleigh--Ritz. This approach…

Numerical Analysis · Mathematics 2022-02-17 Yuji Nakatsukasa , Joel A. Tropp

Randomized sketching is currently introduced into every area of numerical linear algebra. In Krylov subspace methods, it allows runtime savings at the cost of small accuracy reductions. This work offers a different view on sketching in…

Numerical Analysis · Mathematics 2026-04-09 Kai Bergermann

Sketching has emerged as a powerful technique for speeding up problems in numerical linear algebra, such as regression. In the overconstrained regression problem, one is given an $n \times d$ matrix $A$, with $n \gg d$, as well as an $n…

Data Structures and Algorithms · Computer Science 2017-05-31 Eric Price , Zhao Song , David P. Woodruff

Sketching enables many exciting applications, notably, image retrieval. The fear-to-sketch problem (i.e., "I can't sketch") has however proven to be fatal for its widespread adoption. This paper tackles this "fear" head on, and for the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ayan Kumar Bhunia , Subhadeep Koley , Abdullah Faiz Ur Rahman Khilji , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

In this paper, to solve a broad class of complex symmetric linear systems, we recast the complex system in a real formulation and apply the generalized successive overrelaxation (GSOR) iterative method to the equivalent real system. We then…

Numerical Analysis · Mathematics 2014-03-25 Davod Khojasteh Salkuyeh , Davod Hezari , Vahid Edalatpour

We present iterative solvers to approximate the solution of numerical schemes for stochastic Stefan problems. After briefly talking about the convergence results, we tackle the question of efficient strategies for solving the nonlinear…

Numerical Analysis · Mathematics 2025-08-12 Muhammad Awais Khan , Jérôme Droniou , Kim-Ngan Le , Iuliu Sorin Pop