English
Related papers

Related papers: The Optimal 'AND'

200 papers

In this article, we construct semiparametrically efficient estimators of linear functionals of a probability measure in the presence of side information using an easy empirical likelihood approach. We use estimated constraint functions and…

Methodology · Statistics 2023-03-01 Shan Wang , Hanxiang Peng

The joint probabilistic data association (JPDA) filter is a popular tracking methodology for problems involving well-spaced targets, but it is rarely applied in problems with closely-spaced targets due to its complexity in these cases, and…

Systems and Control · Computer Science 2014-12-16 Jason L. Williams

Inference of the marginal probability distribution is defined as the calculation of the probability of a subset of the variables and is relevant for handling missing data and hidden variables. While inference of the marginal probability…

Machine Learning · Statistics 2022-07-22 Fritz M. Bayer , Giusi Moffa , Niko Beerenwinkel , Jack Kuipers

Consider bivariate observations $(X_1,Y_1), \ldots, (X_n,Y_n) \in \mathbb{R}\times \mathbb{R}$ with unknown conditional distributions $Q_x$ of $Y$, given that $X = x$. The goal is to estimate these distributions under the sole assumption…

Statistics Theory · Mathematics 2025-01-31 Alexandre Mösching , Lutz Duembgen

Stochastic interdependence of a probablility distribution on a product space is measured by its Kullback-Leibler distance from the exponential family of product distributions (called multi-information). Here we investigate low-dimensional…

Mathematical Physics · Physics 2016-01-08 Nihat Ay , Andreas Knauf

We consider the probability distribution when the monotonic function $F(X)$ of the independent variable $X$ takes the maximum or minimum expected value under the two constraints of a certain probability and a certain expected value of the…

Quantum Physics · Physics 2022-02-25 Wangjun Lu , Lei Shao , Xingyu Zhang , Zhucheng Zhang , Jie Chen , Hong Tao , Xiaoguang Wang

We study the problem of maximizing a spectral risk measure of a given output function which depends on several underlying variables, whose individual distributions are known but whose joint distribution is not. We establish and exploit an…

Optimization and Control · Mathematics 2022-11-16 Hamza Ennaji , Quentin Mérigot , Luca Nenna , Brendan Pass

We investigate whether in a distributed setting, adaptive estimation of a smooth function at the optimal rate is possible under minimal communication. It turns out that the answer depends on the risk considered and on the number of servers…

Statistics Theory · Mathematics 2020-03-31 Botond Szabo , Harry van Zanten

We propose algorithms to approximate directed information graphs. Directed information graphs are probabilistic graphical models that depict causal dependencies between stochastic processes in a network. The proposed algorithms identify…

Information Theory · Computer Science 2015-06-17 Christopher J. Quinn , Ali Pinar , Negar Kiyavash

Composite likelihood provides approximate inference when the full likelihood is intractable and sub-likelihood functions of marginal events can be evaluated relatively easily. It has been successfully applied for many complex models.…

Methodology · Statistics 2024-09-05 Wentao Li , Rosabeth White , Dennis Prangle

We present a new algorithm for solving a polynomial program P based on the recent "joint + marginal" approach of the first author for, parametric optimization. The idea is to first consider the variable x1 as a parameter and solve the…

Optimization and Control · Mathematics 2010-06-01 Jean B. Lasserre , Thanh Tung Phan

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

Machine Learning · Statistics 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

Reconstructing the structural connectivity between interacting units from observed activity is a challenge across many different disciplines. The fundamental first step is to establish whether or to what extent the interactions between the…

Neurons and Cognition · Quantitative Biology 2016-11-02 Elliot A. Martin , Jaroslav Hlinka , Jörn Davidsen

We study in this paper optimal mass transport over a strongly connected, directed graph on a given discrete time interval. Differently from previous literature, we do not assume full knowledge of the initial and final goods distribution…

Probability · Mathematics 2024-07-16 Aayan Masood Pathan , Michele Pavon

We study the problem of maximizing the probability that (i) an electric component or financial institution $X$ does not default before another component or institution $Y$ and (ii) that $X$ and $Y$ default jointly within the class of all…

Probability · Mathematics 2021-10-04 Thomas Mroz , Juan Fernández Sánchez , Sebastian Fuchs , Wolfgang Trutschnig

A basic problem in information theory is the following: Let $\mathbf{P} = (\mathbf{X}, \mathbf{Y})$ be an arbitrary distribution where the marginals $\mathbf{X}$ and $\mathbf{Y}$ are (potentially) correlated. Let Alice and Bob be two…

Computational Complexity · Computer Science 2017-02-17 Anindya De , Elchanan Mossel , Joe Neeman

In the probabilistic approach to uncertainty management the input knowledge is usually represented by means of some probability distributions. In this paper we assume that the input knowledge is given by two discrete conditional probability…

Artificial Intelligence · Computer Science 2013-03-25 Angelo Gilio , Fulvio Spezzaferri

We derive information-theoretic converses (i.e., lower bounds) for the minimum time required by any algorithm for distributed function computation over a network of point-to-point channels with finite capacity, where each node of the…

Information Theory · Computer Science 2017-01-04 Aolin Xu , Maxim Raginsky

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem…

Machine Learning · Statistics 2013-07-19 Qiang Liu , Alexander Ihler

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson