English
Related papers

Related papers: Covering Codes as Near-Optimal Quantizers for Dist…

200 papers

The classical binary hypothesis testing problem is revisited. We notice that when one of the hypotheses is composite, there is an inherent difficulty in defining an optimality criterion that is both informative and well-justified. For…

Statistics Theory · Mathematics 2021-03-29 Michael Bell , Yuval Kochman

Multi-distribution learning extends agnostic Probably Approximately Correct (PAC) learning to the setting in which a family of $k$ distributions, $\{D_i\}_{i\in[k]}$, is considered and a classifier's performance is measured by its error…

Machine Learning · Computer Science 2025-06-24 Chicheng Zhang , Yihan Zhou

The paper is concerned with a class of nonlinear free boundary problems, which are usually solved by variational methods based on primal (or primal-dual) variational settings. We deduce and investigate special relations (error identities).…

Analysis of PDEs · Mathematics 2017-03-01 Sergey Repin , Jan Valdman

In this paper, we examine the optimal quantization of signals for system identification. We deal with memoryless quantization for the output signals and derive the optimal quantization schemes. The objective functions are the errors of…

Optimization and Control · Mathematics 2009-05-13 Koji Tsumura

Two-sample hypothesis testing-determining whether two sets of data are drawn from the same distribution-is a fundamental problem in statistics and machine learning with broad scientific applications. In the context of nonparametric testing,…

Machine Learning · Statistics 2026-04-21 Antoine Chatalic , Marco Letizia , Nicolas Schreuder , Lorenzo Rosasco

We consider the problem of distributed feature quantization, where the goal is to enable a pretrained classifier at a central node to carry out its classification on features that are gathered from distributed nodes through communication…

Machine Learning · Computer Science 2019-11-04 Osama A. Hanna , Yahya H. Ezzeldin , Tara Sadjadpour , Christina Fragouli , Suhas Diggavi

We investigate the problem of jointly testing a pair of composite hypotheses and, depending on the test result, estimating a random parameter under distributional uncertainties. Specifically, it is assumed that the distribution of the data…

Signal Processing · Electrical Eng. & Systems 2026-04-27 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

This PhD thesis is concerned with SDP bounds for codes: upper bounds for (non)-binary error correcting codes and lower bounds for (non)-binary covering codes. The methods are based on the method of Schrijver that uses triple distances in…

Combinatorics · Mathematics 2010-07-07 Dion Gijswijt

We present a device-independent (DI) self-testing protocol in a constrained prepare-measure scenario, based on the $n-$bit parity-oblivious multiplexing (POM) task. In this scenario, a parity-oblivious constraint is imposed on the…

Quantum Physics · Physics 2025-05-27 Ritesh K. Singh , Souradeep Sasmal , S. Nautiyal , A. K. Pan

We consider the problem of binary classification with abstention in the relatively less studied \emph{bounded-rate} setting. We begin by obtaining a characterization of the Bayes optimal classifier for an arbitrary input-label distribution…

Machine Learning · Computer Science 2019-05-24 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

In several interesting applications one is faced with the problem of simultaneous binary hypothesis testing and parameter estimation. Although such joint problems are not infrequent, there exist no systematic analysis in the literature that…

Statistics Theory · Mathematics 2009-11-25 George V. Moustakides

We study the problem of approximate near neighbor (ANN) search and show the following results: - An improved framework for solving the ANN problem using locality-sensitive hashing, reducing the number of evaluations of locality-sensitive…

Data Structures and Algorithms · Computer Science 2019-06-25 Tobias Christiani

The double hypothesis test (DHT) is a test that allows controlling Type I (producer) and Type II (consumer) errors. It is possible to say whether the batch has a defect rate, p, between 1.5 and 2%, or between 2 and 5%, or between 5 and 10%,…

This paper is concerned with the ordered statistic decoding with local constraints (LC-OSD) of binary linear block codes, which is a near maximum-likelihood decoding algorithm. Compared with the conventional OSD, the LC-OSD significantly…

Information Theory · Computer Science 2024-01-31 Jifan Liang , Xiao Ma

Hypothesis Selection is a fundamental distribution learning problem where given a comparator-class $Q=\{q_1,\ldots, q_n\}$ of distributions, and a sampling access to an unknown target distribution $p$, the goal is to output a distribution…

Machine Learning · Computer Science 2021-08-19 Olivier Bousquet , Mark Braverman , Klim Efremenko , Gillat Kol , Shay Moran

We consider network coding for networks experiencing worst-case bit-flip errors, and argue that this is a reasonable model for highly dynamic wireless network transmissions. We demonstrate that in this setup prior network error-correcting…

Information Theory · Computer Science 2011-08-16 Qiwen Wang , Sidharth Jaggi , Shuo-Yen Robert Li

We derive bounds on the asymptotic density of parity-check matrices and the achievable rates of binary linear block codes transmitted over memoryless binary-input output-symmetric (MBIOS) channels. The lower bounds on the density of…

Information Theory · Computer Science 2007-07-13 Gil Wiechman , Igal Sason

The problem of publishing privacy-guaranteed data for hypothesis testing is studied using the maximal leakage (ML) as a metric for privacy and the type-II error exponent as the utility metric. The optimal mechanism (random mapping) that…

Information Theory · Computer Science 2017-04-12 Jiachun Liao , Lalitha Sankar , Flavio P. Calmon , Vincent Y. F. Tan

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

We study an optimum measurement for quantum state discrimination, which maximizes the probability of correct results when the probability of inconclusive results is fixed at a given value. The measurement describes minimum-error…

Quantum Physics · Physics 2012-09-26 Ulrike Herzog