English
Related papers

Related papers: Faster and Simpler Sketches of Valuation Functions

200 papers

This paper presents several new algorithms for the regularized reconstruction of a surface from its measured gradient field. By taking a matrix-algebraic approach, we establish general framework for the regularized reconstruction problem…

Numerical Analysis · Mathematics 2013-08-21 Matthew Harker , Paul O'Leary

We consider sketched approximate matrix multiplication and ridge regression in the novel setting of localized sketching, where at any given point, only part of the data matrix is available. This corresponds to a block diagonal structure on…

Machine Learning · Statistics 2020-03-23 Rakshith S Srinivasa , Mark A Davenport , Justin Romberg

We study the problem of compressing a weighted graph $G$ on $n$ vertices, building a "sketch" $H$ of $G$, so that given any vector $x \in \mathbb{R}^n$, the value $x^T L_G x$ can be approximated up to a multiplicative $1+\epsilon$ factor…

Data Structures and Algorithms · Computer Science 2014-12-30 Jiecao Chen , Bo Qin , David P. Woodruff , Qin Zhang

In the classical Subset Sum problem we are given a set $X$ and a target $t$, and the task is to decide whether there exists a subset of $X$ which sums to $t$. A recent line of research has resulted in $\tilde{O}(t)$-time algorithms, which…

Data Structures and Algorithms · Computer Science 2023-04-25 Karl Bringmann , Vasileios Nakos

We propose a new random sketching approach for embedding high-dimensional Hilbert-Schmidt operators, using random input-output pairs. Such operator can then be approximated in a low-dimensional subspace of operators by solving a small…

Numerical Analysis · Mathematics 2026-04-15 Oleg Balabanov , Anthony Nouy , Alexandre Pasco

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

The Euler genus of a graph is a fundamental and well-studied parameter in graph theory and topology. Computing it has been shown to be NP-hard by [Thomassen '89 & '93], and it is known to be fixed-parameter tractable. However, the…

Data Structures and Algorithms · Computer Science 2013-11-04 Chandra Chekuri , Anastasios Sidiropoulos

We present a fully nonparametric method to estimate the value function, via simulation, in the context of expected infinite-horizon discounted rewards for Markov chains. Estimating such value functions plays an important role in approximate…

Probability · Mathematics 2013-12-30 Mohammad Mousavi , Peter W. Glynn

This paper proposes a stochastic variant of a classic algorithm---the cubic-regularized Newton method [Nesterov and Polyak 2006]. The proposed algorithm efficiently escapes saddle points and finds approximate local minima for general…

Machine Learning · Computer Science 2017-12-07 Nilesh Tripuraneni , Mitchell Stern , Chi Jin , Jeffrey Regier , Michael I. Jordan

We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm…

Optimization and Control · Mathematics 2024-11-26 Benjamin Dubois-Taine , Francis Bach , Quentin Berthet , Adrien Taylor

Tensor network contraction is a fundamental mathematical operation that generalizes the dot product and matrix multiplication. It finds applications in numerous domains, such as database systems, graph theory, machine learning, probability…

Data Structures and Algorithms · Computer Science 2026-03-10 Mike Heddes , Igor Nunes , Tony Givargis , Alex Nicolau

We develop the first pure node-differentially-private algorithms for learning stochastic block models and for graphon estimation with polynomial running time for any constant number of blocks. The statistical utility guarantees match those…

Data Structures and Algorithms · Computer Science 2024-04-19 Hongjie Chen , Jingqiu Ding , Tommaso d'Orsi , Yiding Hua , Chih-Hung Liu , David Steurer

Fourier extension is an approximation scheme in which a function on an arbitary bounded domain is approximated using a classical Fourier series on a bounding box. On the smaller domain the Fourier series exhibits redundancy, and it has the…

Numerical Analysis · Mathematics 2017-06-16 Roel Matthysen , Daan Huybrechs

We analyze the sketching approximability of constraint satisfaction problems on Boolean domains, where the constraints are balanced linear threshold functions applied to literals. In~particular, we explore the approximability of…

Computational Complexity · Computer Science 2022-07-18 Chi-Ning Chou , Alexander Golovnev , Amirbehshad Shahrasbi , Madhu Sudan , Santhoshini Velusamy

We present a branch and bound method for maximizing an arbitrary set function h mapping 2^V to R. By decomposing h as f-g, where f is a submodular function and g is the cut function of a (simple, undirected) graph G with vertex set V, our…

Combinatorics · Mathematics 2009-06-02 Kevin Byrnes

We take a random matrix theory approach to random sketching and show an asymptotic first-order equivalence of the regularized sketched pseudoinverse of a positive semidefinite matrix to a certain evaluation of the resolvent of the same…

Numerical Analysis · Mathematics 2023-10-09 Daniel LeJeune , Pratik Patil , Hamid Javadi , Richard G. Baraniuk , Ryan J. Tibshirani

In this note, we develop fast and deterministic dimensionality reduction techniques for a family of subspace approximation problems. Let $P\subset \mathbbm{R}^N$ be a given set of $M$ points. The techniques developed herein find an $O(n…

Computational Geometry · Computer Science 2013-12-06 Mark Iwen , Felix Krahmer

Our contribution in this paper is two folded. We consider first the case of linear programming with real coefficients and give a method which allows the computation of a new upper bound on the distance from the origin to a feasible point.…

Optimization and Control · Mathematics 2020-10-30 Beniamin Costandin , Marius Costandin , Petru Dobra

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Based on the characterization of the polyconvex envelope of isotropic functions by their signed singular value representations, we propose a simple algorithm for the numerical approximation of the polyconvex envelope. Instead of operating…

Numerical Analysis · Mathematics 2023-07-31 Timo Neumeier , Malte A. Peter , Daniel Peterseim , David Wiedemann