English
Related papers

Related papers: Improving stochastic estimates with inference meth…

200 papers

Efficient estimation of high-dimensional matrices-including covariance and precision matrices-is a cornerstone of modern multivariate statistics. Most existing studies have focused primarily on the theoretical properties of the estimators…

Machine Learning · Computer Science 2026-03-31 Wan Tian , Hui Yang , Zhouhui Lian , Lingyue Zhang , Yijie Peng

A new method is described for constructing a generalized solution for stochastic differential equations. The method is based on the Cameron-Martin version of the Wiener Chaos expansion and provides a unified framework for the study of…

Probability · Mathematics 2007-05-23 S. V. Lototsky , B. L. Rozovskii

We consider the problem of estimating the trace of a matrix function $f(A)$. In certain situations, in particular if $f(A)$ cannot be well approximated by a low-rank matrix, combining probing methods based on graph colorings with stochastic…

Numerical Analysis · Mathematics 2023-08-16 Andreas Frommer , Michele Rinelli , Marcel Schweitzer

Randomized algorithms, such as randomized sketching or stochastic optimization, are a promising approach to ease the computational burden in analyzing large datasets. However, randomized algorithms also produce non-deterministic outputs,…

Methodology · Statistics 2025-05-13 Zhixiang Zhang , Sokbae Lee , Edgar Dobriban

Fast algorithms for matrix multiplication, namely those that perform asymptotically fewer scalar operations than the classical algorithm, have been considered primarily of theoretical interest. Apart from Strassen's original algorithm, few…

Numerical Analysis · Computer Science 2016-07-26 Grey Ballard , Austin R. Benson , Alex Druinsky , Benjamin Lipshitz , Oded Schwartz

The computational cost for inference and prediction of statistical models based on Gaussian processes with Mat\'ern covariance functions scales cubicly with the number of observations, limiting their applicability to large data sets. The…

Statistics Theory · Mathematics 2025-03-04 David Bolin , Vaibhav Mehandiratta , Alexandre B. Simas

The purpose of this text is to provide an accessible introduction to a set of recently developed algorithms for factorizing matrices. These new algorithms attain high practical speed by reducing the dimensionality of intermediate…

Numerical Analysis · Mathematics 2019-02-08 Per-Gunnar Martinsson

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

We propose a technique for reformulation of state and parameter estimation problems as that of matching explicitly computable definite integrals with known kernels to data. The technique applies for a class of systems of nonlinear ordinary…

Optimization and Control · Mathematics 2013-09-11 I. Yu. Tyukin , A. N. Gorban

The implementation of optimal statistical inference protocols for high-dimensional quantum systems is often computationally expensive. To avoid the difficulties associated with optimal techniques, here I propose an alternative approach to…

Quantum Physics · Physics 2015-12-23 Mankei Tsang

Estimation and inference in dynamic discrete choice models often relies on approximation to lower the computational burden of dynamic programming. Unfortunately, the use of approximation can impart substantial bias in estimation and results…

Econometrics · Economics 2020-10-23 Ben Deaner

We develop the first stochastic incremental method for calculating the Moore-Penrose pseudoinverse of a real matrix. By leveraging three alternative characterizations of pseudoinverse matrices, we design three methods for calculating the…

Numerical Analysis · Mathematics 2019-05-02 Robert M. Gower , Peter Richtárik

Integrative modeling of macromolecular assemblies allows for structural characterization of large assemblies that are recalcitrant to direct experimental observation. A Bayesian inference approach facilitates combining data from…

Biomolecules · Quantitative Biology 2026-01-13 Shreyas Arvindekar , Kartik Majila , Shruthi Viswanath

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural…

Machine Learning · Statistics 2021-10-27 Benjamin Kurt Miller , Alex Cole , Patrick Forré , Gilles Louppe , Christoph Weniger

In distributed optimization and distributed numerical linear algebra, we often encounter an inversion bias: if we want to compute a quantity that depends on the inverse of a sum of distributed matrices, then the sum of the inverses does not…

Machine Learning · Computer Science 2019-05-29 Michał Dereziński , Michael W. Mahoney

Neuroscience has recently made much progress, expanding the complexity of both neural-activity measurements and brain-computational models. However, we lack robust methods for connecting theory and experiment by evaluating our new big…

Quantitative Methods · Quantitative Biology 2023-07-06 Heiko H. Schütt , Alexander D. Kipnis , Jörn Diedrichsen , Nikolaus Kriegeskorte

As the amount of economic and other data generated worldwide increases vastly, a challenge for future generations of econometricians will be to master efficient algorithms for inference in empirical models with large information sets. This…

Computation · Statistics 2020-04-27 Dimitris Korobilis , Davide Pettenuzzo

Higher order numerical schemes for stochastic partial differential equations that do not possess commutative noise require the simulation of iterated stochastic integrals. In this work, we extend the algorithms derived by Kloeden, Platen,…

Probability · Mathematics 2017-09-21 Claudine Leonhard , Andreas Rößler

The formalism of Wiener filtering is developed here for the purpose of reconstructing the large scale structure of the universe from noisy, sparse and incomplete data. The method is based on a linear minimum variance solution, given data…

Astrophysics · Physics 2009-10-22 S. Zaroubi , Y. Hoffman , K. B. Fisher , O. Lahav

In this paper, we present several estimators of the diagonal elements of the inverse of the covariance matrix, called precision matrix, of a sample of iid random vectors. The focus is on high dimensional vectors having a sparse precision…

Statistics Theory · Mathematics 2017-07-31 Samuel Balmand , Arnak S. Dalalyan