English
Related papers

Related papers: Tractability through Exchangeability: A New Perspe…

200 papers

Statistics has moved beyond the frequentist-Bayesian controversies of the past. Where does this leave our ability to interpret results? I suggest that a philosophy compatible with statistical practice, labeled here statistical pragmatism,…

Other Statistics · Statistics 2011-06-23 Robert E. Kass

A central problem in machine learning involves modeling complex data-sets using highly flexible families of probability distributions in which learning, sampling, inference, and evaluation are still analytically or computationally…

Machine Learning · Computer Science 2015-11-20 Jascha Sohl-Dickstein , Eric A. Weiss , Niru Maheswaranathan , Surya Ganguli

P-values are a mainstay in statistics but are often misinterpreted. We propose a new interpretation of p-value as a meaningful plausibility, where this is to be interpreted formally within the inferential model framework. We show that, for…

Statistics Theory · Mathematics 2014-10-28 Ryan Martin , Chuanhai Liu

Variational inference is a popular technique to approximate a possibly intractable Bayesian posterior with a more tractable one. Recently, boosting variational inference has been proposed as a new paradigm to approximate the posterior by a…

Machine Learning · Computer Science 2018-03-08 Francesco Locatello , Rajiv Khanna , Joydeep Ghosh , Gunnar Rätsch

We present a novel family of deep neural architectures, named partially exchangeable networks (PENs) that leverage probabilistic symmetries. By design, PENs are invariant to block-switch transformations, which characterize the partial…

Machine Learning · Statistics 2019-07-25 Samuel Wiqvist , Pierre-Alexandre Mattei , Umberto Picchini , Jes Frellsen

A fundamental task in statistical learning is quantifying the joint dependence or association between two continuous random variables. We introduce a novel, fully non-parametric measure that assesses the degree of association between…

In Bayesian multilevel models, the data are structured in interconnected groups, and their posteriors borrow information from one another due to prior dependence between latent parameters. However, little is known about the behaviour of the…

Statistics Theory · Mathematics 2025-09-25 Marta Catalano , Hugo Lavenant , Francesco Mascari

There has been great interest in identifying tractable subclasses of NP complete problems and designing efficient algorithms for these tractable classes. Constraint satisfaction and Bayesian network inference are two examples of such…

Artificial Intelligence · Computer Science 2012-12-12 Yong Gao

We introduce the notion of a restricted exchangeable partition of $\mathbb{N}$. We obtain integral representations, consider associated fragmentations, embeddings into continuum random trees and convergence to such limit trees. In…

Probability · Mathematics 2012-11-12 Bo Chen , Matthias Winkel

Note: Published now as a chapter in "Handbook of the History and Philosophy of Mathematical Practice" (Springer Nature, editor B. Sriraman, https://doi.org/10.1007/978-3-030-19071-2_105-1). The application of mathematical probability theory…

Other Statistics · Statistics 2023-11-21 Christian Hennig

Recent work has introduced sparse exchangeable graphs and the associated graphex framework, as a generalization of dense exchangeable graphs and the associated graphon framework. The development of this subject involves the interplay…

Probability · Mathematics 2020-02-12 Christian Borgs , Jennifer T. Chayes , Henry Cohn , Victor Veitch

We study conditional independence relationships for random networks and their interplay with exchangeability. We show that, for finitely exchangeable network models, the empirical subgraph densities are maximum likelihood estimates of their…

Statistics Theory · Mathematics 2017-11-22 Steffen Lauritzen , Alessandro Rinaldo , Kayvan Sadeghi

Prediction is a central task of statistics and machine learning, yet many inferential settings provide only partial information, typically in the form of moment constraints or estimating equations. We develop a finite, fully Bayesian…

Statistics Theory · Mathematics 2026-03-20 Nicholas G. Polson , Daniel Zantedeschi

Probability estimation is one of the fundamental tasks in statistics and machine learning. However, standard methods for probability estimation on discrete objects do not handle object structure in a satisfactory manner. In this paper, we…

Applications · Statistics 2018-11-06 Cheng Zhang , Frederick A. Matsen

This paper examines the foundational concept of random variables in probability theory and statistical inference, demonstrating that their mathematical definition requires no reference to randomization or hypothetical repeated sampling. We…

Other Statistics · Statistics 2025-02-11 Paul W. Vos

We develop Bayesian predictive stacking for geostatistical models, where the primary inferential objective is to provide inference on the latent spatial random field and conduct spatial predictions at arbitrary locations. We exploit…

Methodology · Statistics 2025-09-25 Lu Zhang , Wenpin Tang , Sudipto Banerjee

Circuit representations are becoming the lingua franca to express and reason about tractable generative and discriminative models. In this paper, we show how complex inference scenarios for these models that commonly arise in machine…

Machine Learning · Statistics 2021-02-12 Antonio Vergari , YooJung Choi , Anji Liu , Stefano Teso , Guy Van den Broeck

A wide variety of transition-based algorithms are currently used for dependency parsers. Empirical studies have shown that performance varies across different treebanks in such a way that one algorithm outperforms another on one treebank…

Computation and Language · Computer Science 2020-04-01 Mark Anderson , Carlos Gómez-Rodríguez

Big data analytics applications drive the convergence of data management and machine learning. But there is no conceptual language available that is spoken in both worlds. The main contribution of the paper is a method to translate Bayesian…

Databases · Computer Science 2016-07-11 Frank Rosner , Alexander Hinneburg

Conformal prediction is a powerful post-hoc framework for uncertainty quantification that provides distribution-free coverage guarantees. However, these guarantees crucially rely on the assumption of exchangeability. This assumption is…

Methodology · Statistics 2025-11-18 M. Stocker , W. Małgorzewicz , M. Fontana , S. Ben Taieb