English
Related papers

Related papers: Adaptive low-rank approximation and denoised Monte…

200 papers

An efficient technique based on low-rank separated approximations is proposed for computation of three-dimensional integrals arising in the energy deposition model that describes ion-atomic collisions. Direct tensor-product quadrature…

Computational Physics · Physics 2015-11-17 M. S. Litsarev , I. V. Oseledets

The celebrated Monte Carlo method estimates an expensive-to-compute quantity by random sampling. Bandit-based Monte Carlo optimization is a general technique for computing the minimum of many such expensive-to-compute quantities by adaptive…

Machine Learning · Computer Science 2021-04-30 Vivek Bagaria , Tavor Z. Baharav , Govinda M. Kamath , David N. Tse

Quantum mechanics for many-body systems may be reduced to the evaluation of integrals in 3N dimensions using Monte-Carlo, providing the Quantum Monte Carlo ab initio methods. Here we limit ourselves to expectation values for trial…

Computational Physics · Physics 2010-11-22 John Robert Trail , Ryo Maezono

We demonstrate the use of a variational method to determine a quantitative lower bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as a function of the target density and proposal density. The bound relies on…

Data Analysis, Statistics and Probability · Physics 2013-05-29 Fergal P. Casey , Joshua J. Waterfall , Ryan N. Gutenkunst , Christopher R. Myers , James P. Sethna

We demonstrate that the control protocols of quantum information devices can be simulated by assuming a low-rank ansatz for the density matrix. The rationale underlying this assumption is that quantum information protocols, by design,…

Quantum Physics · Physics 2026-01-27 Leo Goutte , Vincenzo Savona

An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo…

Machine Learning · Computer Science 2022-11-23 Anthony Corso , Kyu-Young Kim , Shubh Gupta , Grace Gao , Mykel J. Kochenderfer

With the goal to provide absolute lower bounds for the best possible running times that can be achieved by $(1+\lambda)$-type search heuristics on common benchmark problems, we recently suggested a dynamic programming approach that computes…

Neural and Evolutionary Computing · Computer Science 2021-02-24 Kirill Antonov , Maxim Buzdalov , Arina Buzdalova , Carola Doerr

We introduce adaptive sampling methods for stochastic programs with deterministic constraints. First, we propose and analyze a variant of the stochastic projected gradient method where the sample size used to approximate the reduced…

Optimization and Control · Mathematics 2023-02-07 Florian Beiser , Brendan Keith , Simon Urbainczyk , Barbara Wohlmuth

In this paper, we propose and analyze a novel combination of multilevel Richardson-Romberg (ML2R) and importance sampling algorithm, with the aim of reducing the overall computational time, while achieving desired root-mean-squared error…

Computational Finance · Quantitative Finance 2022-09-05 Devang Sinha , Siddhartha P. Chakrabarty

Randomized SVD has become an extremely successful approach for efficiently computing a low-rank approximation of matrices. In particular the paper by Halko, Martinsson, and Tropp (SIREV 2011) contains extensive analysis, and has made it a…

Numerical Analysis · Mathematics 2020-09-25 Yuji Nakatsukasa

This article considers stochastic algorithms for efficiently solving a class of large scale non-linear least squares (NLS) problems which frequently arise in applications. We propose eight variants of a practical randomized algorithm where…

Numerical Analysis · Mathematics 2015-01-27 Farbod Roosta-Khorasani , Gábor J. Székely , Uri Ascher

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

Optimization and Control · Mathematics 2018-01-19 Koulik Khamaru , Rahul Mazumder

Probably one of the most striking examples of the close connections between global optimization processes and statistical physics is the simulated annealing method, inspired by the famous Monte Carlo algorithm devised by Metropolis et al.…

Numerical Analysis · Mathematics 2024-01-12 Lorenzo Pareschi

We propose new approximate alternating projection methods, based on randomized sketching, for the low-rank nonnegative matrix approximation problem: find a low-rank approximation of a nonnegative matrix that is nonnegative, but whose…

Numerical Analysis · Mathematics 2023-04-25 Sergey A. Matveev , Stanislav Budzinskiy

An inverse problem of finding an unknown heat source for a class of linear parabolic equations is considered. Such problems can typically be converted to a direct problem with non-local conditions in time instead of an initial value…

Numerical Analysis · Mathematics 2023-02-16 Doghonay Arjmand , Maksat Ashyraliyev

Low-rank training methods reduce the number of trainable parameters by re-parameterizing the weights with matrix decompositions (e.g., singular value decomposition). However, enforcing a fixed low-rank structure caps the rank of the weight…

Machine Learning · Computer Science 2025-10-16 Hyuntak Shin , Aecheon Jung , Sungeun Hong , Sunwoo Lee

We study approximation of the embedding $\ell_p^m \hookrightarrow \ell_q^m$, $1 \leq p < q \leq \infty$, based on randomized algorithms that use up to $n$ arbitrary linear functionals as information on a problem instance where $n \ll m$. By…

Numerical Analysis · Mathematics 2025-09-22 Robert J. Kunsch , Marcin Wnuk

We introduce new variants of classical regression-based algorithms for optimal stopping problems based on computation of regression coefficients by Monte Carlo approximation of the corresponding $L^2$ inner products instead of the…

Computational Finance · Quantitative Finance 2019-04-29 Christian Bayer , Martin Redmann , John Schoenmakers

The numerical integration of stiff equations is a challenging problem that needs to be approached by specialized numerical methods. Exponential integrators form a popular class of such methods since they are provably robust to stiffness and…

Numerical Analysis · Mathematics 2024-05-15 Benjamin Carrel , Bart Vandereycken

Recent years have witnessed intense development of randomized methods for low-rank approximation. These methods target principal component analysis (PCA) and the calculation of truncated singular value decompositions (SVD). The present…

Computation · Statistics 2017-01-02 Arthur Szlam , Yuval Kluger , Mark Tygert