English
Related papers

Related papers: Observable dictionary learning for high-dimensiona…

200 papers

The Bayesian approach to machine learning amounts to computing posterior distributions of random variables from a probabilistic model of how the variables are related (that is, a prior distribution) and a set of observations of variables.…

Logic in Computer Science · Computer Science 2015-07-01 Johannes Borgström , Andrew D Gordon , Michael Greenberg , James Margetson , Jurgen Van Gael

This paper studies nonparametric series estimation and inference for the effect of a single variable of interest x on an outcome y in the presence of potentially high-dimensional conditioning variables z. The context is an additively…

Statistics Theory · Mathematics 2020-04-07 Damian Kozbur

A central challenge in statistical inference is the presence of confounding variables that may distort observed associations between treatment and outcome. Conventional "causal" methods, grounded in assumptions such as ignorability, exclude…

Methodology · Statistics 2025-09-09 Ellis Scharfenaker , Duncan K. Foley

Understanding the contribution of individual features in predictive models remains a central goal in interpretable machine learning, and while many model-agnostic methods exist to estimate feature importance, they often fall short in…

Machine Learning · Computer Science 2025-07-08 Ivan Lazic , Chiara Barà , Marta Iovino , Sebastiano Stramaglia , Niksa Jakovljevic , Luca Faes

Sampling from the posterior is a key technical problem in Bayesian statistics. Rigorous guarantees are difficult to obtain for Markov Chain Monte Carlo algorithms of common use. In this paper, we study an alternative class of algorithms…

Statistics Theory · Mathematics 2024-08-26 Andrea Montanari , Yuchen Wu

Quantile regression has been successfully used to study heterogeneous and heavy-tailed data. Varying-coefficient models are frequently used to capture changes in the effect of input variables on the response as a function of an index or…

Methodology · Statistics 2021-10-18 Ran Dai , Mladen Kolar

We extend stochastic basis adaptation and spatial domain decomposition methods to solve time varying stochastic partial differential equations (SPDEs) with a large number of input random parameters. Stochastic basis adaptation allows the…

Numerical Analysis · Mathematics 2021-03-08 Ramakrishna Tipireddy , Panos Stinis , Alexandre M. Tartakovsky

The Poisson compound decision problem is a long-standing problem in statistics, where empirical Bayes methodologies are commonly used to estimate Poisson's means in static or batch domains. In this paper, we study the Poisson compound…

Methodology · Statistics 2025-06-10 Stefano Favaro , Sandra Fortini

Robust environment perception is essential for decision-making on robots operating in complex domains. Principled treatment of uncertainty sources in a robot's observation model is necessary for accurate mapping and object detection. This…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Shayegan Omidshafiei , Brett T. Lopez , Jonathan P. How , John Vian

Recent works on word representations mostly rely on predictive models. Distributed word representations (aka word embeddings) are trained to optimally predict the contexts in which the corresponding words tend to appear. Such models have…

Computation and Language · Computer Science 2015-04-10 Rémi Lebret , Ronan Collobert

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

Methodology · Statistics 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

The ability to obtain reliable point estimates of model parameters is of crucial importance in many fields of physics. This is often a difficult task given that the observed data can have a very high number of dimensions. In order to…

Cosmology and Nongalactic Astrophysics · Physics 2021-12-15 Janis Fluri , Aurelien Lucchi , Tomasz Kacprzak , Alexandre Refregier , Thomas Hofmann

Objective prior distributions represent an important tool that allows one to have the advantages of using the Bayesian framework even when information about the parameters of a model is not available. The usual objective approaches work off…

Methodology · Statistics 2018-09-25 Fabrizio Leisen , Cristiano Villa , Stephen G. Walker

We consider statistical inference in factor analysis for ergodic and non-ergodic diffusion processes from discrete observations. Factor model based on high frequency time series data has been mainly discussed in the field of high…

Statistics Theory · Mathematics 2022-02-04 Shogo Kusano , Masayuki Uchida

This paper discusses semiparametric inference on hypotheses on the cointegration and the attractor spaces for $I(1)$ linear processes with moderately large cross-sectional dimension. The approach is based on empirical canonical correlations…

Methodology · Statistics 2025-12-17 Massimo Franchi , Paolo Paruolo

Statistical models often include thousands of parameters. However, large models decrease the investigator's ability to interpret and communicate the estimated parameters. Reducing the dimensionality of the parameter space in the estimation…

Methodology · Statistics 2022-05-16 Eric Dunipace , Lorenzo Trippa

This report introduces general ideas and some basic methods of the Bayesian probability theory applied to physics measurements. Our aim is to make the reader familiar, through examples rather than rigorous formalism, with concepts such as:…

Data Analysis, Statistics and Probability · Physics 2009-11-10 G. D'Agostini

This work is motivated by the analysis of ecological interaction networks. Poisson stochastic blockmodels are widely used in this field to decipher the structure that underlies a weighted network, while accounting for covariate effects.…

Applications · Statistics 2019-07-24 Sophie Donnet , Stéphane Robin

Large-scale datasets are increasingly being used to inform decision making. While this effort aims to ground policy in real-world evidence, challenges have arisen as selection bias and other forms of distribution shifts often plague…

Methodology · Statistics 2023-11-07 Santiago Cortes-Gomez , Mateo Dulce , Carlos Patino , Bryan Wilder

High-dimensional multivariate longitudinal data, which arise when many outcome variables are measured repeatedly over time, are becoming increasingly common in social, behavioral and health sciences. We propose a latent variable model for…

Methodology · Statistics 2025-12-09 Sze Ming Lee , Yunxiao Chen , Tony Sit