English
Related papers

Related papers: Spectral estimation from simulations via sketching

200 papers

Kernel density estimation is a convenient way to estimate the probability density of a distribution given the sample of data points. However, it has certain drawbacks: proper description of the density using narrow kernels needs large data…

Data Analysis, Statistics and Probability · Physics 2015-02-27 Anton Poluektov

Recently, Bessa et al. (PODS 2023) showed that sketches based on coordinated weighted sampling theoretically and empirically outperform popular linear sketching methods like Johnson-Lindentrauss projection and CountSketch for the ubiquitous…

Databases · Computer Science 2024-08-23 Majid Daliri , Juliana Freire , Christopher Musco , Aécio Santos , Haoxiang Zhang

We propose a randomized second-order method for optimization known as the Newton Sketch: it is based on performing an approximate Newton step using a randomly projected or sub-sampled Hessian. For self-concordant functions, we prove that…

Optimization and Control · Mathematics 2015-05-12 Mert Pilanci , Martin J. Wainwright

Detecting emergence of a low-rank signal from high-dimensional data is an important problem arising from many applications such as camera surveillance and swarm monitoring using sensors. We consider a procedure based on the largest…

Machine Learning · Statistics 2016-10-10 Yao Xie , Lee Seversky

In this paper, we investigate effective sketching schemes via sparsification for high dimensional multilinear arrays or tensors. More specifically, we propose a novel tensor sparsification algorithm that retains a subset of the entries of a…

Methodology · Statistics 2017-11-17 Dong Xia , Ming Yuan

Sketching has emerged as a powerful technique for speeding up problems in numerical linear algebra, such as regression. In the overconstrained regression problem, one is given an $n \times d$ matrix $A$, with $n \gg d$, as well as an $n…

Data Structures and Algorithms · Computer Science 2017-05-31 Eric Price , Zhao Song , David P. Woodruff

Network monitoring is vital in modern clouds and data center networks for traffic engineering, network diagnosis, network intrusion detection, which need diverse traffic statistics ranging from flow size distributions to heavy hitters. To…

Networking and Internet Architecture · Computer Science 2019-05-09 Yongquan Fu , Dongsheng Li , Siqi Shen , Yiming Zhang , Kai Chen

In the process of product design and digital fabrication, the structural analysis of a designed prototype is a fundamental and essential step. However, such a step is usually invisible or inaccessible to designers at the early sketching…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Deng Yu , Chufeng Xiao , Manfred Lau , Hongbo Fu

Traditional models of wormlike chains in shear flows at finite temperature approximate the equation of motion via finite difference discretization (bead and rod models). We introduce here a new method based on a spectral representation in…

Soft Condensed Matter · Physics 2007-05-23 Chris H. Wiggins , Alberto Montesi , Matteo Pasquali

Space-efficient streaming estimation of quantiles in massive datasets is a fundamental problem with numerous applications in data monitoring and analysis. While theoretical research led to optimal algorithms, such as the Greenwald-Khanna…

Data Structures and Algorithms · Computer Science 2025-09-12 Aleksander Łukasiewicz , Jakub Tětek , Pavel Veselý

We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their…

Graphics · Computer Science 2024-10-28 Vishnu Sarukkai , Lu Yuan , Mia Tang , Maneesh Agrawala , Kayvon Fatahalian

We consider sketching algorithms which first compress data by multiplication with a random sketch matrix, and then apply the sketch to quickly solve an optimization problem, e.g., low-rank approximation and regression. In the learning-based…

Machine Learning · Computer Science 2024-04-12 Yi Li , Honghao Lin , Simin Liu , Ali Vakilian , David P. Woodruff

Spectral clustering refers to a family of unsupervised learning algorithms that compute a spectral embedding of the original data based on the eigenvectors of a similarity graph. This non-linear transformation of the data is both the key of…

Machine Learning · Computer Science 2019-01-30 Nicolas Tremblay , Andreas Loukas

We consider a streaming data model in which n sensors observe individual streams of data, presented in a turnstile model. Our goal is to analyze the singular value decomposition (SVD) of the matrix of data defined implicitly by the stream…

Information Theory · Computer Science 2012-11-05 Anna C. Gilbert , Jae Young Park , Michael B. Wakin

In this study some properties of the methanol-water mixture such as diffusivity, density, viscosity, and hydrogen bonding were calculated at different temperatures and atmospheric pressure using molecular dynamics simulations (MDS). The…

Atomic and Molecular Clusters · Physics 2017-08-08 Palazzo Mancini , Mara Cantoni

In recent years, randomized methods for numerical linear algebra have received growing interest as a general approach to large-scale problems. Typically, the essential ingredient of these methods is some form of randomized dimension…

Machine Learning · Statistics 2019-04-05 Miles E. Lopes , Shusen Wang , Michael W. Mahoney

Data reduction in storage systems is becoming increasingly important as an effective solution to minimize the management cost of a data center. To maximize data-reduction efficiency, existing post-deduplication delta-compression techniques…

Machine Learning · Computer Science 2022-02-23 Jisung Park , Jeoggyun Kim , Yeseong Kim , Sungjin Lee , Onur Mutlu

We present a simple and efficient method based on deep learning to automatically decompose sketched objects into semantically valid parts. We train a deep neural network to transfer existing segmentations and labelings from 3D models to…

Graphics · Computer Science 2018-08-01 Lei Li , Hongbo Fu , Chiew-Lan Tai

In this work, we present a dimensionality reduction algorithm, aka. sketching, for categorical datasets. Our proposed sketching algorithm Cabin constructs low-dimensional binary sketches from high-dimensional categorical vectors, and our…

Machine Learning · Computer Science 2021-11-16 Bhisham Dev Verma , Rameshwar Pratap , Debajyoti Bera

In this work, we propose a method for speeding up linear regression distributively, while ensuring security. We leverage randomized sketching techniques, and improve straggler resilience in asynchronous systems. Specifically, we apply a…

Information Theory · Computer Science 2022-02-23 Neophytos Charalambides , Hessam Mahdavifar , Mert Pilanci , Alfred O. Hero