English
Related papers

Related papers: Spectral estimation from simulations via sketching

200 papers

Sketching is a powerful dimensionality reduction technique for accelerating algorithms for data analysis. A crucial step in sketching methods is to compute a subspace embedding (SE) for a large matrix $\mathbf{A} \in \mathbb{R}^{N \times…

Data Structures and Algorithms · Computer Science 2021-07-14 Rajesh Jayaram , Alireza Samadian , David P. Woodruff , Peng Ye

Scalable algorithms to solve optimization and regression tasks even approximately, are needed to work with large datasets. In this paper we study efficient techniques from matrix sketching to solve a variety of convex constrained regression…

Machine Learning · Computer Science 2019-11-01 Graham Cormode , Charlie Dickens

Projection-based iterative methods for solving large over-determined linear systems are well-known for their simplicity and computational efficiency. It is also known that the correct choice of a sketching procedure (i.e., preprocessing…

Numerical Analysis · Mathematics 2019-12-03 Elizaveta Rebrova , Deanna Needell

This paper proposes an approach, Spectral Dynamics Embedding Control (SDEC), to optimal control for nonlinear stochastic systems. This method reveals an infinite-dimensional feature representation induced by the system's nonlinear…

Machine Learning · Computer Science 2025-08-27 Zhaolin Ren , Tongzheng Ren , Haitong Ma , Na Li , Bo Dai

Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal…

Information Theory · Computer Science 2017-01-31 Maxime Ferreira Da Costa , Wei Dai

Parameter reduction has been an important topic in deep learning due to the ever-increasing size of deep neural network models and the need to train and run them on resource limited machines. Despite many efforts in this area, there were no…

Machine Learning · Computer Science 2019-02-26 Yibo Lin , Zhao Song , Lin F. Yang

Sketch-based modeling strives to bring the ease and immediacy of drawing to the 3D world. However, while drawings are easy for humans to create, they are very challenging for computers to interpret due to their sparsity and ambiguity. We…

Graphics · Computer Science 2018-06-20 Johanna Delanoy , Mathieu Aubry , Phillip Isola , Alexei A. Efros , Adrien Bousseau

In this work we propose a new paradigm for designing efficient deep unrolling networks using operator sketching. The deep unrolling networks are currently the state-of-the-art solutions for imaging inverse problems. However, for…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Junqi Tang , Subhadip Mukherjee , Carola-Bibiane Schönlieb

Purpose: Parallel imaging and compressed sensing reconstructions of large MRI datasets often have a prohibitive computational cost that bottlenecks clinical deployment, especially for 3D non-Cartesian acquisitions. One common approach is to…

Image and Video Processing · Electrical Eng. & Systems 2023-10-13 Julio A. Oscanoa , Frank Ong , Siddharth S. Iyer , Zhitao Li , Christopher M. Sandino , Batu Ozturkler , Daniel B. Ennis , Mert Pilanci , Shreyas S. Vasanawala

Data sketches are approximate succinct summaries of long streams. They are widely used for processing massive amounts of data and answering statistical queries about it in real-time. Existing libraries producing sketches are very fast, but…

Data Structures and Algorithms · Computer Science 2019-12-06 Arik Rinberg , Alexander Spiegelman , Edward Bortnikov , Eshcar Hillel , Idit Keidar , Lee Rhodes , Hadar Serviansky

We show that the symmetries of image formation by scattering enable graph-theoretic manifold-embedding techniques to extract structural and timing information from simulated and experimental snapshots at extremely low signal. The approach…

Computational Physics · Physics 2011-09-27 Peter Schwander , Chun Hong Yoon , Abbas Ourmazd , Dimitrios Giannakis

We introduce a technique for estimating a structured covariance matrix from observations of a random vector which have been sketched. Each observed random vector $\boldsymbol{x}_t$ is reduced to a single number by taking its inner product…

Information Theory · Computer Science 2015-10-09 Sohail Bahmani , Justin Romberg

We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self-concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a…

Optimization and Control · Mathematics 2021-05-18 Jonathan Lacotte , Yifei Wang , Mert Pilanci

Stream monitoring is fundamental in many data stream applications, such as financial data trackers, security, anomaly detection, and load balancing. In that respect, quantiles are of particular interest, as they often capture the user's…

Data Structures and Algorithms · Computer Science 2022-01-07 Rana Shahout , Roy Friedman , Ran Ben Basat

We consider the problem of sketching set valuation functions, defined as the expectation of a valuation function applied to independent random item values. For valuation functions that are monotone and either subadditive or submodular, and…

Statistics Theory · Mathematics 2026-03-11 Milan Vojnović , Yiliu Wang

This paper presents transient numerical simulations of hydraulic systems in engineering applications using the spectral element method (SEM). Along with a detailed description of the underlying numerical method, it is shown that the SEM…

Computational Physics · Physics 2017-10-24 Jan-Frederik Mennemann , Lukas Marko , Jakob Schmidt , Wolfgang Kemmetmüller , Andreas Kugi

Sketching is used as a ubiquitous tool of expression by novices and experts alike. In this thesis I explore two methods that help a system provide a geometric machine-understanding of sketches, and in-turn help a user accomplish a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Raghav Brahmadesam Venkataramaiyer

The compressive learning framework reduces the computational cost of training on large-scale datasets. In a sketching phase, the data is first compressed to a lightweight sketch vector, obtained by mapping the data samples through a…

Machine Learning · Statistics 2022-04-20 Vincent Schellekens , Laurent Jacques

Understanding geometric concepts, such as distance and shape, is essential for understanding the real world and also for many vision tasks. To incorporate such information into a visual representation of a scene, we propose learning to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hyundo Lee , Inwoo Hwang , Hyunsung Go , Won-Seok Choi , Kibeom Kim , Byoung-Tak Zhang

Random graph models are used to describe the complex structure of real-world networks in diverse fields of knowledge. Studying their behavior and fitting properties are still critical challenges, that in general, require model specific…

Statistics Theory · Mathematics 2023-08-30 Suzana de Siqueira Santos , André Fujita , Catherine Matias