English
Related papers

Related papers: Optimality of Binning for Distributed Hypothesis T…

200 papers

The trade-offs between error probabilities in quantum hypothesis testing are by now well-understood in the centralized setting, but much less is known for distributed settings. Here, we study a distributed binary hypothesis testing problem…

Quantum Physics · Physics 2026-04-29 Sreejith Sreekumar , Christoph Hirche , Hao-Chung Cheng , Mario Berta

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

High complexity models are notorious in machine learning for overfitting, a phenomenon in which models well represent data but fail to generalize an underlying data generating process. A typical procedure for circumventing overfitting…

Machine Learning · Statistics 2025-03-11 James Schmidt

Minimizing risk with fairness constraints is one of the popular approaches to learning a fair classifier. Recent works showed that this approach yields an unfair classifier if the training set is corrupted. In this work, we study the…

Machine Learning · Computer Science 2022-05-10 Changhun Jo , Jy-yong Sohn , Kangwook Lee

This work deals with a general problem of testing multiple hypotheses about the distribution of a discrete-time stochastic process. Both the Bayesian and the conditional settings are considered. The structure of optimal sequential tests is…

Statistics Theory · Mathematics 2009-12-23 Andrey Novikov

We consider a hypothesis testing problem where a part of data cannot be observed. Our helper observes the missed data and can send us a limited amount of information about them. What kind of this limited information will allow us to make…

Information Theory · Computer Science 2020-09-08 Marat V. Burnashev

Binary embedding is the problem of mapping points from a high-dimensional space to a Hamming cube in lower dimension while preserving pairwise distances. An efficient way to accomplish this is to make use of fast embedding techniques…

Data Structures and Algorithms · Computer Science 2016-03-15 Samet Oymak

A central server needs to perform statistical inference based on samples that are distributed over multiple users who can each send a message of limited length to the center. We study problems of distribution learning and identity testing…

Data Structures and Algorithms · Computer Science 2020-10-02 Jayadev Acharya , Clément L. Canonne , Himanshu Tyagi

We first describe a general class of optimization problems that describe many natural, economic, and statistical phenomena. After noting the existence of a conserved quantity in a transformed coordinate system, we outline several instances…

Optimization and Control · Mathematics 2018-04-03 David Rushing Dewhurst

Emerging applications of sensor networks for detection sometimes suggest that classical problems ought be revisited under new assumptions. This is the case of binary hypothesis testing with independent - but not necessarily identically…

Information Theory · Computer Science 2019-03-27 Stefano Marano , Peter Willett

The traditional binary classification framework constructs classifiers which may have good accuracy, but whose false positive and false negative error rates are not under users' control. In many cases, one of the errors is more severe and…

Machine Learning · Statistics 2020-10-22 Miloš Simić

We study the problem of efficient compression of a stochastic source of probability distributions. It can be viewed as a generalization of Shannon's source coding problem. It has relation to the theory of common randomness, as well as to…

Quantum Physics · Physics 2016-09-08 Andreas Winter

Algorithms are now routinely used to make consequential decisions that affect human lives. Examples include college admissions, medical interventions or law enforcement. While algorithms empower us to harness all information hidden in vast…

Machine Learning · Computer Science 2020-12-10 Bahar Taskesen , Jose Blanchet , Daniel Kuhn , Viet Anh Nguyen

Specimens are collected from $N$ different sources. Each specimen has probability $p$ of being contaminated (e.g., in the case of an infectious disease, $p$ is the prevalence rate), independently of the other specimens. In many cases group…

Probability · Mathematics 2024-01-31 Vassilis G. Papanicolaou

Methods of performing anomaly detection on high-dimensional data sets are needed, since algorithms which are trained on data are only expected to perform well on data that is similar to the training data. There are theoretical results on…

Machine Learning · Computer Science 2020-11-13 Forrest Laine , Claire Tomlin

Various problems in Engineering and Statistics require the computation of the likelihood ratio function of two probability densities. In classical approaches the two densities are assumed known or to belong to some known parametric family.…

Signal Processing · Electrical Eng. & Systems 2019-11-06 George V. Moustakides , Kalliopi Basioti

We consider the sequential composite binary hypothesis testing problem in which one of the hypotheses is governed by a single distribution while the other is governed by a family of distributions whose parameters belong to a known set…

Information Theory · Computer Science 2022-03-30 Jiachun Pan , Yonglong Li , Vincent Y. F. Tan

Hypothesis testing for small-sample scenarios is a practically important problem. In this paper, we investigate the robust hypothesis testing problem in a data-driven manner, where we seek the worst-case detector over distributional…

Machine Learning · Statistics 2022-05-17 Jie Wang , Yao Xie

We study the problem of storing a data object in a set of data nodes that fail independently with given probabilities. Our problem is a natural generalization of a homogenous storage allocation problem where all the nodes had the same…

Information Theory · Computer Science 2012-02-09 Vasileios Ntranos , Giuseppe Caire , Alexandros G. Dimakis

As a popular form of knowledge and experience, patterns and their identification have been critical tasks in most data mining applications. However, as far as we are aware, no study has systematically examined the dynamics of pattern values…

Optimization and Control · Mathematics 2024-09-10 Huayan Zhang , Ruibin Bai , Tie-Yan Liu , Jiawei Li , Bingchen Lin , Jianfeng Ren