English
Related papers

Related papers: Tractability through Exchangeability: A New Perspe…

200 papers

The monitoring and control of any dynamic system depends crucially on the ability to reason about its current status and its future trajectory. In the case of a stochastic system, these tasks typically involve the use of a belief state- a…

Artificial Intelligence · Computer Science 2013-02-01 Xavier Boyen , Daphne Koller

Tasks are central in machine learning, as they are the most natural objects to assess the capabilities of current models. The trend is to build general models able to address any task. Even though transfer learning and multitask learning…

We revisit and generalize the concept of composite likelihood as a method to make a probabilistic inference by aggregation of multiple Bayesian agents, thereby defining a class of predictive models which we call composite Bayesian. This…

Computation · Statistics 2019-04-18 Alexis Roche

The likelihood function is central to both frequentist and Bayesian formulations of parametric statistical inference, and large-sample approximations to the sampling distributions of estimators and test statistics, and to posterior…

Methodology · Statistics 2022-04-05 Anthony C. Davison , Nancy Reid

Separable Bayesian Networks, or the Influence Model, are dynamic Bayesian Networks in which the conditional probability distribution can be separated into a function of only the marginal distribution of a node's neighbors, instead of the…

Artificial Intelligence · Computer Science 2012-07-02 Chalee Asavathiratham

We develop a new framework of uncertainty variables to model uncertainty. An uncertainty variable is characterized by an uncertainty set, in which its realization is bound to lie, while the conditional uncertainty is characterized by a set…

Machine Learning · Statistics 2019-12-10 Rajat Talak , Sertac Karaman , Eytan Modiano

The aim of this paper is to present an elementary computable theory of random variables, based on the approach to probability via valuations. The theory is based on a type of lower-measurable sets, which are controlled limits of open sets,…

Logic in Computer Science · Computer Science 2021-01-05 Pieter Collins

The ``impossibility theorem'' -- which is considered foundational in algorithmic fairness literature -- asserts that there must be trade-offs between common notions of fairness and performance when fitting statistical models, except in two…

Machine Learning · Computer Science 2023-02-14 Andrew Bell , Lucius Bynum , Nazarii Drushchak , Tetiana Herasymova , Lucas Rosenblatt , Julia Stoyanovich

We develop a domain-theoretic framework for imprecise probability reasoning and inference on general topological spaces with a countably based continuous lattice of open sets. We address two distinct forms of uncertainty: partial or…

Logic in Computer Science · Computer Science 2026-04-13 Abbas Edalat , Pietro Di Gianantonio , Amin Farjudian

Inference in expressive probabilistic models is generally intractable, which makes them difficult to learn and limits their applicability. Sum-product networks are a class of deep models where, surprisingly, inference remains tractable even…

Machine Learning · Computer Science 2016-11-14 Abram L. Friesen , Pedro Domingos

Feature and trait allocation models are fundamental objects in Bayesian nonparametrics and play a prominent role in several applications. Existing approaches, however, typically assume full exchangeability of the data, which may be…

Methodology · Statistics 2025-11-11 Lorenzo Ghilotti , Federico Camerlenghi , Tommaso Rigon , Michele Guindani

The theory of optimal transportation has developed into a powerful and elegant framework for comparing probability distributions, with wide-ranging applications in all areas of science. The fundamental idea of analyzing probabilities by…

Methodology · Statistics 2025-03-14 Florian F Gunsilius

Maximum likelihood estimators are often of limited practical use due to the intensive computation they require. We propose a family of alternative estimators that maximize a stochastic variation of the composite likelihood function. Each of…

Machine Learning · Computer Science 2010-03-04 Joshua V Dillon , Guy Lebanon

Generalised Probabilistic Theories (GPTs) provide a unifying framework encompassing classical theories, quantum theories, as well as hypothetical alternatives. We investigate the problem of extending a system with a finite set of…

Quantum Physics · Physics 2026-03-17 Serge Massar

There have been controversies among statisticians on (i) what to model and (ii) how to make inferences from models with unobservables. One such controversy concerns the difference between estimation methods for the marginal means not…

Methodology · Statistics 2010-10-07 Youngjo Lee , John A. Nelder

Split conformal prediction (CP) is arguably the most popular CP method for uncertainty quantification, enjoying both academic interest and widespread deployment. However, the original theoretical analysis of split CP makes the crucial…

Statistics Theory · Mathematics 2024-08-26 Roberto I. Oliveira , Paulo Orenstein , Thiago Ramos , João Vitor Romano

We propose a rigorous decomposition of predictive error, highlighting that not all 'irreducible' error is genuinely immutable. Many domains stand to benefit from iterative enhancements in measurement, construct validity, and modeling. Our…

Machine Learning · Computer Science 2025-02-12 Jiani Yan , Charles Rahal

Investment planning in power utilities, such as generation and transmission expansion, requires decisions under substantial uncertainty over decade--long horizons for policies, demand, renewable availability, and outages, while maintaining…

Machine Learning · Computer Science 2026-03-17 Nicolas M. Cuadrado A. , Mohannad Takrouri , Jiří Němeček , Martin Takáč , Jakub Mareček

Directed graphs occur throughout statistical modeling of networks, and exchangeability is a natural assumption when the ordering of vertices does not matter. There is a deep structural theory for exchangeable undirected graphs, which…

Statistics Theory · Mathematics 2016-12-19 Diana Cai , Nathanael Ackerman , Cameron Freer

Bayesian variable selection often assumes normality, but the effects of model misspecification are not sufficiently understood. There are sound reasons behind this assumption, particularly for large $p$: ease of interpretation, analytical…

Methodology · Statistics 2017-08-07 David Rossell , Francisco J. Rubio