English
Related papers

Related papers: Approximating the Permanent by Sampling from Adapt…

200 papers

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of…

Statistics Theory · Mathematics 2014-08-27 Olga Klopp , Jean Lafond , Eric Moulines , Joseph Salmon

We give an algorithm for computing approximate PSD factorizations of nonnegative matrices. The running time of the algorithm is polynomial in the dimensions of the input matrix, but exponential in the PSD rank and the approximation error.…

Data Structures and Algorithms · Computer Science 2016-02-25 Amitabh Basu , Michael Dinitz , Xin Li

We consider sampling from a Gibbs distribution by evolving a finite number of particles using a particular score estimator rather than Brownian motion. To accelerate the particles, we consider a second-order score-based ODE, similar to…

Machine Learning · Statistics 2026-01-19 Hong Ye Tan , Stanley Osher , Wuchen Li

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

This paper presents a fast and robust algorithm for trend filtering, a recently developed nonparametric regression tool. It has been shown that, for estimating functions whose derivatives are of bounded variation, trend filtering achieves…

Machine Learning · Statistics 2015-09-01 Aaditya Ramdas , Ryan J. Tibshirani

In 2011, Aaronson gave a striking proof, based on quantum linear optics, showing that the problem of computing the permanent of a matrix is #P-hard. Aaronson's proof led naturally to hardness of approximation results for the permanent, and…

Quantum Physics · Physics 2018-03-01 Daniel Grier , Luke Schaeffer

To avoid ineffective collisions between the equilibrium states, the hybrid method with deviational particles (HDP) has been proposed to integrate the Vlasov-Poisson-Landau system, while leaving a new issue in sampling deviational particles…

Computational Physics · Physics 2025-12-24 Zhengyang Lei , Sihong Shao

Channel simulation algorithms can efficiently encode random samples from a prescribed target distribution $Q$ and find applications in machine learning-based lossy data compression. However, algorithms that encode exact samples usually have…

Information Theory · Computer Science 2024-05-16 Gergely Flamich , Lennie Wells

We present a distributed asynchronous algorithm for approximating a single component of the solution to a system of linear equations $Ax = b$, where $A$ is a positive definite real matrix, and $b \in \mathbb{R}^n$. This is equivalent to…

Data Structures and Algorithms · Computer Science 2019-01-23 Asuman Ozdaglar , Devavrat Shah , Christina Lee Yu

We consider a general method for the approximation of the distribution of a process conditioned to not hit a given set. Existing methods are based on particle system that are failable, in the sense that, in many situations , they are not…

Probability · Mathematics 2016-06-30 William Oçafrain , Denis Villemonais

When auditing a redistricting plan, a persuasive method is to compare the plan with an ensemble of neutrally drawn redistricting plans. Ensembles are generated via algorithms that sample distributions on balanced graph partitions. To audit…

Physics and Society · Physics 2024-02-01 Gabriel Chuang , Gregory Herschlag , Jonathan C. Mattingly

Accurate estimation of the states of a nonlinear dynamical system is crucial for their design, synthesis, and analysis. Particle filters are estimators constructed by simulating trajectories from a sampling distribution and averaging them…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Fernando Gama , Nicolas Zilberstein , Martin Sevilla , Richard Baraniuk , Santiago Segarra

While fine-tuning is a de facto standard method for training deep neural networks, it still suffers from overfitting when using small target datasets. Previous methods improve fine-tuning performance by maintaining knowledge of the source…

Machine Learning · Computer Science 2024-03-18 Shin'ya Yamaguchi , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa

In this paper, we introduce AdaSelection, an adaptive sub-sampling method to identify the most informative sub-samples within each minibatch to speed up the training of large-scale deep learning models without sacrificing model performance.…

Machine Learning · Computer Science 2023-06-21 Minghe Zhang , Chaosheng Dong , Jinmiao Fu , Tianchen Zhou , Jia Liang , Jia Liu , Bo Liu , Michinari Momma , Bryan Wang , Yan Gao , Yi Sun

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

Data Structures and Algorithms · Computer Science 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

We build on recent research on polynomial randomized approximation (PRAX) algorithms for the hard problems of NFA universality and NFA equivalence. Loosely speaking, PRAX algorithms use sampling of infinite domains within any desired…

Data Structures and Algorithms · Computer Science 2024-03-14 Pantelis Andreou , Stavros Konstantinidis , Taylor J. Smith

Evaluating the permanent of a matrix is a fundamental computation that emerges in many domains, including traditional fields like computational complexity theory, graph theory, many-body quantum theory and emerging disciplines like machine…

Quantum Physics · Physics 2025-10-07 Cassandra Masschelein , Michelle Richer , Paul W. Ayers

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

Science and engineering problems subject to uncertainty are frequently both computationally expensive and feature nonsmooth parameter dependence, making standard Monte Carlo too slow, and excluding efficient use of accelerated uncertainty…

Numerical Analysis · Mathematics 2021-10-01 Per Pettersson , Sebastian Krumscheid

In this paper we combine the Alias method with the concept of systematic sampling, a method commonly used in particle filters for efficient low-variance resampling. The proposed method allows very fast sampling from a discrete distribution:…

Data Structures and Algorithms · Computer Science 2025-09-30 Ilari Vallivaara , Katja Poikselkä , Pauli Rikula , Juha Röning