English
Related papers

Related papers: Observable dictionary learning for high-dimensiona…

200 papers

Inferring the value of a property of a large stochastic system is a difficult task when the number of samples is insufficient to reliably estimate the probability distribution. The Bayesian estimator of the property of interest requires the…

Data Analysis, Statistics and Probability · Physics 2022-01-26 Damián G. Hernández , Inés Samengo

Streamlined qBOLD acquisitions enable experimentally straightforward observations of brain oxygen metabolism. $R_2^\prime$ maps are easily inferred; however, the Oxygen extraction fraction (OEF) and deoxygenated blood volume (DBV) are more…

Image and Video Processing · Electrical Eng. & Systems 2022-04-08 Ivor J. A. Simpson , Ashley McManamon , Balázs Örzsik , Alan J. Stone , Nicholas P. Blockley , Iris Asllani , Alessandro Colasanti , Mara Cercignani

Distributional models are derived from co-occurrences in a corpus, where only a small proportion of all possible plausible co-occurrences will be observed. This results in a very sparse vector space, requiring a mechanism for inferring…

Computation and Language · Computer Science 2016-08-25 Thomas Kober , Julie Weeds , Jeremy Reffin , David Weir

This paper presents a distributed Koopman operator learning framework for modeling unknown nonlinear dynamics using sequential observations from multiple agents. Each agent estimates a local Koopman approximation based on lifted data and…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Ali Azarbahram , Shenyu Liu , Gian Paolo Incremona

Beyond estimating parameters of interest from data, one of the key goals of statistical inference is to properly quantify uncertainty in these estimates. In Bayesian inference, this uncertainty is provided by the posterior distribution, the…

Machine Learning · Computer Science 2025-01-03 Daniela de Albuquerque , John Pearson

Vanilla variational inference finds an optimal approximation to the Bayesian posterior distribution, but even the exact Bayesian posterior is often not meaningful under model misspecification. We propose predictive variational inference…

Machine Learning · Statistics 2026-03-31 Jinlin Lai , Antonio Linero , Yuling Yao

In this article, we propose a novel method for sampling potential functions based on noisy observation data of a finite number of observables in quantum canonical ensembles, which leads to the accurate sampling of a wide class of test…

Numerical Analysis · Mathematics 2020-04-08 Ziheng Chen , Zhennan Zhou

In this work we consider the problem of approximating the statistics of a given Quantity of Interest (QoI) that depends on the solution of a linear elliptic PDE defined over a random domain parameterized by $N$ random variables. The…

Numerical Analysis · Mathematics 2016-03-29 Julio E. Castrillon-Candas , Fabio Nobile , Raul F. Tempone

Given two distributions $\mathcal{P}$ and $\mathcal{Q}$ over a high-dimensional domain $\{0,1\}^n$, and a parameter $\varepsilon$, the goal of distance estimation is to determine the statistical distance between $\mathcal{P}$ and…

Data Structures and Algorithms · Computer Science 2025-09-09 Gunjan Kumar , Kuldeep S. Meel , Yash Pote

We present a general framework for Bayesian estimation of incompletely observed multivariate diffusion processes. Observations are assumed to be discrete in time, noisy and incomplete. We assume the drift and diffusion coefficient depend on…

Methodology · Statistics 2019-02-04 Frank van der Meulen , Moritz Schauer

We study the problem of cooperative inference where a group of agents interact over a network and seek to estimate a joint parameter that best explains a set of observations. Agents do not know the network topology or the observations of…

Optimization and Control · Mathematics 2017-04-11 Angelia Nedić , Alex Olshevsky , César A. Uribe

We present two analytical formulae for estimating the sensitivity -- namely, the gradient or Jacobian -- at given realizations of an arbitrary-dimensional random vector with respect to its distributional parameters. The first formula…

Machine Learning · Statistics 2025-08-14 Pi-Yueh Chuang , Ahmed Attia , Emil Constantinescu

The prior distribution for the unknown model parameters plays a crucial role in the process of statistical inference based on Bayesian methods. However, specifying suitable priors is often difficult even when detailed prior knowledge is…

Methodology · Statistics 2020-03-18 Marcelo Hartmann , Georgi Agiashvili , Paul Bürkner , Arto Klami

Sequential probabilistic inference from streaming observations requires modeling distributions over future trajectories as new observations arrive. Although diffusion and flow-matching models are effective at capturing high-dimensional,…

Machine Learning · Computer Science 2026-05-15 Yinan Huang , Hans Hao-Hsun Hsu , Junran Wang , Bo Dai , Pan Li

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing…

Machine Learning · Computer Science 2023-09-12 Jed A. Duersch

Logistic regression involving high-dimensional covariates is a practically important problem. Often the goal is variable selection, i.e., determining which few of the many covariates are associated with the binary response. Unfortunately,…

Computation · Statistics 2025-02-18 Yiqi Tang , Ryan Martin

Variational inference (VI) is a popular method for approximating intractable posterior distributions in Bayesian inference and probabilistic machine learning. In this paper, we introduce a general framework for quantifying the statistical…

Statistics Theory · Mathematics 2025-07-18 Chenyang Zhong , Sumit Mukherjee , Bodhisattva Sen

Most work on supervised learning research has focused on marginal predictions. In decision problems, joint predictive distributions are essential for good performance. Previous work has developed methods for assessing low-order predictive…

Machine Learning · Statistics 2022-03-01 Ian Osband , Zheng Wen , Seyed Mohammad Asghari , Vikranth Dwaracherla , Xiuyuan Lu , Benjamin Van Roy

Statistical query (SQ) algorithms are algorithms that have access to an {\em SQ oracle} for the input distribution $D$ instead of i.i.d.~ samples from $D$. Given a query function $\phi:X \rightarrow [-1,1]$, the oracle returns an estimate…

Machine Learning · Computer Science 2017-04-18 Vitaly Feldman

This paper develops an inferential theory for high-dimensional matrix-variate factor models with missing observations. We propose an easy-to-use all-purpose method that involves two straightforward steps. First, we perform principal…

Methodology · Statistics 2025-03-26 Yongxia Zhang , Jinwen Liang , Liwen Xu , Keming Yu , Maozai Tian