English
Related papers

Related papers: From Soft-Minoration to Information-Constrained Op…

200 papers

We implement the Ising model on a structural connectivity matrix describing the brain at a coarse scale. Tuning the model temperature to its critical value, i.e. at the susceptibility peak, we find a maximal amount of total information…

Neurons and Cognition · Quantitative Biology 2013-09-03 Daniele Marinazzo , Mario Pellicoro , Guorong Wu , Leonardo Angelini , Jesus M Cortes , Sebastiano Stramaglia

We consider the minimum spanning tree problem in a setting where the edge weights are stochastic from unknown distributions, and the only available information is a single sample of each edge's weight distribution. In this setting, we…

Data Structures and Algorithms · Computer Science 2024-09-25 Ruben Hoeksma , Gavin Speek , Marc Uetz

We study the information-theoretic lower bound of the sample complexity of the correct recovery of diffusion network structures. We introduce a discrete-time diffusion model based on the Independent Cascade model for which we obtain a lower…

Machine Learning · Computer Science 2019-05-28 Keehwan Park , Jean Honorio

In this paper we discuss Sudakov type minoration for the dependent setting. Sudakov minoration is a well known property first proved for centered Gaussian processes which states that for well separated points there is a natural lower bound…

Probability · Mathematics 2014-05-06 Witold Bednorz

Conditional risk minimization arises in high-stakes decisions where risk must be assessed in light of side information, such as stressed economic conditions, specific customer profiles, or other contextual covariates. Constructing reliable…

Machine Learning · Statistics 2025-09-30 Xinqiao Xie , Jonathan Yu-Meng Li

We introduce weak barycenters of a family of probability distributions, based on the recently developed notion of optimal weak transport of mass by Gozlanet al. (2017) and Backhoff-Veraguas et al. (2020). We provide a theoretical analysis…

Machine Learning · Statistics 2023-03-13 Elsa Cazelles , Felipe Tobar , Joaquín Fontbona

Computational implementation of optimal transport barycenters for a set of target probability measures requires a form of approximation, a widespread solution being empirical approximation of measures. We provide an $O(\sqrt{N/n})$…

Optimization and Control · Mathematics 2025-11-19 Léo Portales , Edouard Pauwels , Elsa Cazelles

We study the following one-way asymmetric transmission problem, also a variant of model-based compressed sensing: a resource-limited encoder has to report a small set $S$ from a universe of $N$ items to a more powerful decoder (server). The…

Data Structures and Algorithms · Computer Science 2018-07-30 Alexandr Andoni , Javad Ghaderi , Daniel Hsu , Dan Rubenstein , Omri Weinstein

Sorted data is usually easier to compress than unsorted permutations of the same data. This motivates a simple compression scheme: specify the sorted permutation of the data along with a representation of the sorted data compressed…

Data Structures and Algorithms · Computer Science 2014-11-24 Oscar Stiffelman

We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Jingchao Gao , Ao Tang , Weiyu Xu

We consider iterative (`turbo') algorithms for compressed sensing. First, a unified exposition of the different approaches available in the literature is given, thereby enlightening the general principles and main differences. In particular…

Information Theory · Computer Science 2017-05-22 Robert F. H. Fischer , Susanne Sparrer

The present work extends the randomized shortest-paths framework (RSP), interpolating between shortest-path and random-walk routing in a network, in three directions. First, it shows how to deal with equality constraints on a subset of…

Machine Learning · Computer Science 2018-07-13 Bertrand Lebichot , Guillaume Guex , Ilkka Kivimäki , Marco Saerens

Optimal transport aligns samples across distributions by minimizing the transportation cost between them, e.g., the geometric distances. Yet, it ignores coherence structure in the data such as clusters, does not handle outliers well, and…

Machine Learning · Computer Science 2023-05-31 Ching-Yao Chuang , Stefanie Jegelka , David Alvarez-Melis

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

We characterize the communication complexity of the following distributed estimation problem. Alice and Bob observe infinitely many iid copies of $\rho$-correlated unit-variance (Gaussian or $\pm1$ binary) random variables, with unknown…

Information Theory · Computer Science 2019-04-19 Uri Hadar , Jingbo Liu , Yury Polyanskiy , Ofer Shayevitz

We propose a protocol optimization technique that is applicable to both weighted or unweighted graphs. Our aim is to explore by how much a small variation around the Shortest Path or Optimal Path protocols can enhance protocol performance.…

Physics and Society · Physics 2015-05-19 Jose J. Ramasco , Marta S. de la Lama , Eduardo Lopez , Stefan Boettcher

In compact settings, the convergence rate of the empirical optimal transport cost to its population value is well understood for a wide class of spaces and cost functions. In unbounded settings, however, hitherto available results require…

Statistics Theory · Mathematics 2024-07-24 Thomas Staudt , Shayan Hundrieser

This paper addresses the distributed stochastic minimax optimization problem subject to stochastic constraints. We propose a novel first-order Softmax-Weighted Switching Gradient method tailored for federated learning. Under full client…

Machine Learning · Computer Science 2026-03-09 Zhankun Luo , Antesh Upadhyay , Sang Bin Moon , Abolfazl Hashemi

Optimization problems with stochastic dominance constraints provide a possibility to shape risk by selecting a benchmark random outcome with a desired distribution. The comparison of the relevant random outcomes to the respective benchmarks…

Optimization and Control · Mathematics 2025-09-09 Darinka Dentcheva , Yunxuan Yi

Optimal transport (OT) plays an essential role in various areas like machine learning and deep learning. However, computing discrete optimal transport plan for large scale problems with adequate accuracy and efficiency is still highly…

Machine Learning · Computer Science 2021-07-20 Dongsheng An , Na Lei , Xianfeng Gu