English
Related papers

Related papers: Exact Inference with Latent Variables in an Arbitr…

200 papers

We address the problem of unsupervised domain adaptation when the source domain differs from the target domain because of a shift in the distribution of a latent subgroup. When this subgroup confounds all observed data, neither covariate…

This paper presents an algorithm for the unsupervised learning of latent variable models from unlabeled sets of data. We base our technique on spectral decomposition, providing a technique that proves to be robust both in theory and in…

Machine Learning · Statistics 2017-04-05 Matteo Ruffini , Marta Casanellas , Ricard Gavaldà

Probabilistic modeling is iterative. A scientist posits a simple model, fits it to her data, refines it according to her analysis, and repeats. However, fitting complex models to large data is a bottleneck in this process. Deriving…

Machine Learning · Statistics 2016-03-03 Alp Kucukelbir , Dustin Tran , Rajesh Ranganath , Andrew Gelman , David M. Blei

Several approximate inference methods have been proposed for deep discrete latent variable models. However, non-parametric methods which have previously been successfully employed for classical sparse coding models have largely been…

Machine Learning · Computer Science 2023-03-16 Arunesh Mittal , Kai Yang , Paul Sajda , John Paisley

For discrete-valued time series, predictive inference cannot be implemented through the construction of prediction intervals to some predetermined coverage level, as this is the case for real-valued time series. To address this problem, we…

Methodology · Statistics 2025-07-23 Maxime Faymonville , Carsten Jentsch , Efstathios Paparoditis

Estimating and disentangling epistemic uncertainty, uncertainty that is reducible with more training data, and aleatoric uncertainty, uncertainty that is inherent to the task at hand, is critically important when applying machine learning…

Machine Learning · Computer Science 2024-11-08 Matthew A. Chan , Maria J. Molina , Christopher A. Metzler

Latent variable models for ordinal data represent a useful tool in different fields of research in which the constructs of interest are not directly observable. In such models, problems related to the integration of the likelihood function…

Methodology · Statistics 2012-06-26 Silvia Bianconcini , Silvia Cagnone

We explore a novel methodology for constructing confidence regions for parameters of linear models, using predictions from any arbitrary predictor. Our framework requires minimal assumptions on the noise and can be extended to functions…

Machine Learning · Statistics 2024-01-30 Charles Guille-Escuret , Eugene Ndiaye

We propose two approaches to estimate semiparametric discrete choice models for bundles. Our first approach is a kernel-weighted rank estimator based on a matching-based identification strategy. We establish its complete asymptotic…

Econometrics · Economics 2024-12-18 Fu Ouyang , Thomas Tao Yang

We propose two approaches to estimate semiparametric discrete choice models for bundles. Our first approach is a kernel-weighted rank estimator based on a matching-based identification strategy. We establish its complete asymptotic…

Econometrics · Economics 2024-12-18 Fu Ouyang , Thomas T. Yang

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

An increasing number of applications require real-time reasoning under uncertainty with streaming input. The temporal (dynamic) Bayes net formalism provides a powerful representational framework for such applications. However, existing…

Artificial Intelligence · Computer Science 2013-01-07 Masami Takikawa , Bruce D'Ambrosio , Ed Wright

As its name suggests, sufficient dimension reduction (SDR) targets to estimate a subspace from data that contains all information sufficient to explain a dependent variable. Ample approaches exist to SDR, some of the most recent of which…

Methodology · Statistics 2020-12-15 Emmanuel Jordy Menvouta , Sven Serneels , Tim Verdonck

We study inference on scalar-valued pathwise differentiable targets after adaptive data collection, such as a bandit algorithm. We introduce a novel target-specific condition, directional stability, which is strictly weaker than previously…

Machine Learning · Statistics 2026-02-26 Zikai Shen , Houssam Zenati , Nathan Kallus , Arthur Gretton , Koulik Khamaru , Aurélien Bibaut

Given a response $Y$ and a vector $X = (X^1, \dots, X^d)$ of $d$ predictors, we investigate the problem of inferring direct causes of $Y$ among the vector $X$. Models for $Y$ that use all of its causal covariates as predictors enjoy the…

Statistics Theory · Mathematics 2020-03-12 Rune Christiansen , Jonas Peters

This paper studies the causal representation learning problem when the latent causal variables are observed indirectly through an unknown linear transformation. The objectives are: (i) recovering the unknown linear transformation (up to…

Machine Learning · Statistics 2023-05-02 Burak Varici , Emre Acarturk , Karthikeyan Shanmugam , Abhishek Kumar , Ali Tajer

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

This paper introduces a novel approach to evaluating the asymptotic stability of equilibrium points in both continuous-time (CT) and discrete-time (DT) nonlinear autonomous systems. By utilizing indirect Lyapunov methods and linearizing…

Systems and Control · Electrical Eng. & Systems 2025-08-08 Sadredin Hokmi , Mohammad Khajenejad

In scientific applications, there often are several competing models that could be fit to the observed data, so quantification of the model uncertainty is of fundamental importance. In this paper, we develop an inferential model (IM)…

Statistics Theory · Mathematics 2016-06-07 Ryan Martin , Huiping Xu , Zuoyi Zhang , Chuanhai Liu

We propose confidence regions for the parameters of incomplete models with exact coverage of the true parameter in finite samples. Our confidence region inverts a test, which generalizes Monte Carlo tests to incomplete models. The test…

Econometrics · Economics 2025-10-07 Lixiong Li , Marc Henry