English
Related papers

Related papers: Extremum Problems with Total Variation Distance an…

200 papers

The total variation distance is a core statistical distance between probability measures that satisfies the metric axioms, with value always falling in $[0,1]$. This distance plays a fundamental role in machine learning and signal…

Machine Learning · Computer Science 2018-07-02 Frank Nielsen , Ke Sun

$f$-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler…

Statistics Theory · Mathematics 2013-10-16 Adityanand Guntuboyina , Sujayam Saha , Geoffrey Schiebinger

This paper develops a novel approach to necessary optimality conditions for constrained variational problems defined in generally incomplete subspaces of absolutely continuous functions. Our approach involves reducing a variational problem…

Optimization and Control · Mathematics 2021-11-01 Ashkan Mohammadi , Boris Mordukhovich

In this paper we develop new applications of variational analysis and generalized differentiation to the following optimization problem and its specifications: given n closed subsets of a Banach space, find such a point for which the sum of…

Optimization and Control · Mathematics 2010-09-09 Boris Mordukhovich , Nguyen Mau Nam

We consider a variational convex relaxation of a class of optimal partitioning and multiclass labeling problems, which has recently proven quite successful and can be seen as a continuous analogue of Linear Programming (LP) relaxation…

Computer Vision and Pattern Recognition · Computer Science 2011-12-06 Jan Lellmann , Frank Lenzen , Christoph Schnörr

In a variety of applications it is important to extract information from a probability measure $\mu$ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and possibly conditioned) continuous time…

Probability · Mathematics 2016-06-02 Frank Pinski , Gideon Simpson , Andrew Stuart , Hendrik Weber

We consider the problem of allocating samples to a finite set of discrete distributions in order to learn them uniformly well in terms of four common distance measures: $\ell_2^2$, $\ell_1$, $f$-divergence, and separation distance. To…

Machine Learning · Statistics 2019-12-10 Shubhanshu Shekhar , Tara Javidi , Mohammad Ghavamzadeh

The isoperimetric problem asks for the maximum area of a region of given perimeter. It is natural to consider other measurements of a region, such as the diameter and width, and ask for the extreme value of one when another is fixed. The…

Metric Geometry · Mathematics 2022-02-22 Gábor Fejes Tóth

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

We derive a novel variational expectation maximization approach based on truncated posterior distributions. Truncated distributions are proportional to exact posteriors within subsets of a discrete state space and equal zero otherwise. The…

Machine Learning · Statistics 2019-07-12 Jörg Lücke

In this paper we perform an analytical and numerical study of Extreme Value distributions in discrete dynamical systems that have a singular measure. Using the block maxima approach described in Faranda et al. [2011] we show that,…

Dynamical Systems · Mathematics 2011-06-14 Davide Faranda , Valerio Lucarini , Giorgio Turchetti , Sandro Vaienti

Maximal inequalities refer to bounds on expected values of the supremum of averages of random variables over a collection. They play a crucial role in the study of non-parametric and high-dimensional estimators, and especially in the study…

Probability · Mathematics 2025-04-28 Supratik Basu , Arun K Kuchibhotla

Risk management is particularly concerned with extreme events, but analysing these events is often hindered by the scarcity of data, especially in a multivariate context. This data scarcity complicates risk management efforts. Various tools…

Methodology · Statistics 2026-01-15 Nisrine Madhar , Juliette Legrand , Maud Thomas

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists…

Optimization and Control · Mathematics 2025-05-28 Francesco Cordiano , Matin Jafarian , Bart De Schutter

Necessary and sufficient conditions for a measure to be an extreme point of the set of measures (on an abstract measurable space) with prescribed generalized moments are given, as well as an application to extremal problems over such moment…

Optimization and Control · Mathematics 2017-01-17 Iosif Pinelis

Extreme values modeling has attracting the attention of researchers in diverse areas such as the environment, engineering, or finance. Multivariate extreme value distributions are particularly suitable to model the tails of multidimensional…

Statistics Theory · Mathematics 2017-01-16 Helena Ferreira , Marta Ferreira

I explain the difficulty of making various concepts of and relating to probability precise, rigorous and physically significant when attempting to apply them in reasoning about objects (e.g., spacetimes) living in infinite-dimensional…

General Relativity and Quantum Cosmology · Physics 2015-09-08 Erik Curiel

This paper considers estimation and inference in semiparametric econometric models. Standard procedures estimate the model based on an independence restriction that induces a minimum distance between a joint cumulative distribution function…

Statistics Theory · Mathematics 2014-12-09 Zhengyuan Gao , Antonio Galvao

We consider the possibility problem of determining if a document is a possible world of a probabilistic document, in the setting of probabilistic XML. This basic question is a special case of query answering or tree automata evaluation, but…

Databases · Computer Science 2016-07-19 Antoine Amarilli

Independence testing is a fundamental problem in statistical inference: given samples from a joint distribution $p$ over multiple random variables, the goal is to determine whether $p$ is a product distribution or is $\epsilon$-far from all…

Machine Learning · Statistics 2026-03-06 Maryam Aliakbarpour , Alireza Azizi , Ria Stevens