English
Related papers

Related papers: Metric-Distortion Bounds under Limited Information

200 papers

We introduce estimation and test procedures through divergence minimization for models satisfying linear constraints with unknown parameter. Several statistical examples and motivations are given. These procedures extend the empirical…

Statistics Theory · Mathematics 2008-11-24 Michel Broniatowski , Amor Keziou

Several researchers have proposed minimisation of maximum mean discrepancy (MMD) as a method to quantise probability measures, i.e., to approximate a target distribution by a representative point set. We consider sequential algorithms that…

Machine Learning · Statistics 2021-02-15 Onur Teymur , Jackson Gorham , Marina Riabiz , Chris. J. Oates

Learning disentangled representations of textual data is essential for many natural language tasks such as fair classification, style transfer and sentence generation, among others. The existent dominant approaches in the context of text…

Artificial Intelligence · Computer Science 2021-05-07 Pierre Colombo , Chloe Clavel , Pablo Piantanida

We show on theoretical grounds that, even in the presence of noise, probabilistic measurement strategies (which have a certain probability of failure or abstention) can provide, upon a heralded successful outcome, estimates with a precision…

Quantum Physics · Physics 2016-10-27 J. Calsamiglia , B. Gendra , R. Munoz-Tapia , E. Bagan

Impartial selection is the selection of an individual from a group based on nominations by other members of the group, in such a way that individuals cannot influence their own chance of selection. For this problem, we give a deterministic…

Computer Science and Game Theory · Computer Science 2024-10-07 Javier Cembrano , Felix Fischer , David Hannon , Max Klimm

We consider the problem of estimating the number of distinct elements in a large data set (or, equivalently, the support size of the distribution induced by the data set) from a random sample of its elements. The problem occurs in many…

Machine Learning · Computer Science 2021-06-17 Talya Eden , Piotr Indyk , Shyam Narayanan , Ronitt Rubinfeld , Sandeep Silwal , Tal Wagner

Algorithmic discrimination is a critical concern as machine learning models are used in high-stakes decision-making in legally protected contexts. Although substantial research on algorithmic bias and discrimination has led to the…

Computers and Society · Computer Science 2025-06-18 Holli Sargeant , Måns Magnusson

We study infinite-horizon Discounted Markov Decision Processes (DMDPs) under a generative model. Motivated by the Algorithm with Advice framework Mitzenmacher and Vassilvitskii 2022, we propose a novel framework to investigate how a…

Machine Learning · Computer Science 2025-02-24 Lixing Lyu , Jiashuo Jiang , Wang Chi Cheung

In parametric Bayesian learning, a prior is assumed on the parameter $W$ which determines the distribution of samples. In this setting, Minimum Excess Risk (MER) is defined as the difference between the minimum expected loss achievable when…

Machine Learning · Computer Science 2021-07-20 Hassan Hafez-Kolahi , Behrad Moniri , Shohreh Kasaei , Mahdieh Soleymani Baghshah

In some rate-distortion-type problems, the required fidelity of information is affected by past actions. As a result, the distortion function depends not only on the instantaneous distortion between a source symbol and its representation…

Information Theory · Computer Science 2026-01-30 Hamidreza Abin , Amin Gohari , Andrew W. Eckford

In this study, I investigate the dynamic decision problem with a finite parameter space when the functional form of conditional expected rewards is misspecified. Traditional algorithms, such as Thompson Sampling, guarantee neither an…

Econometrics · Economics 2025-05-22 Xinyu Dai

In this paper, we use tools from rate-distortion theory to establish new upper bounds on the generalization error of statistical distributed learning algorithms. Specifically, there are $K$ clients whose individually chosen models are…

Machine Learning · Statistics 2022-11-23 Milad Sefidgaran , Romain Chor , Abdellatif Zaidi

We introduce a general problem about bribery in voting systems. In the $\mathcal{R}$-Multi-Bribery problem, the goal is to bribe a set of voters at minimum cost such that a desired candidate wins the perturbed election under the voting rule…

Data Structures and Algorithms · Computer Science 2018-12-06 Dušan Knop , Martin Koutecký , Matthias Mnich

The hitting set problem is one of the fundamental problems in combinatorial optimization and is well-studied in offline setup. We consider the online hitting set problem, where only the set of points is known in advance, and objects are…

Computational Geometry · Computer Science 2024-10-02 Minati De , Ratnadip Mandal , Satyam Singh

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

We study the matrix discrepancy problem in the average-case setting. Given a sequence of $m \times m$ symmetric matrices $A_1,\ldots,A_n$, its discrepancy is defined as the minimal spectral norm over all signed sums $\sum_{i=1}^n x_iA_i$…

Probability · Mathematics 2025-10-07 Dmitriy Kunisky , Timm Oertel , Nicola Wengiel , Peiyuan Zhang

We study the problem of automated mechanism design with partial verification, where each type can (mis)report only a restricted set of types (rather than any other type), induced by the principal's limited verification power. We prove…

Computer Science and Game Theory · Computer Science 2021-04-13 Hanrui Zhang , Yu Cheng , Vincent Conitzer

We consider parameter estimation in distributed networks, where each sensor in the network observes an independent sample from an underlying distribution and has $k$ bits to communicate its sample to a centralized processor which computes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-23 Yanjun Han , Ayfer Özgür , Tsachy Weissman

In some practical learning tasks, such as traffic video analysis, the number of available training samples is restricted by different factors, such as limited communication bandwidth and computation power. Determinantal Point Process (DPP)…

Machine Learning · Computer Science 2023-08-17 Xiwen Chen , Huayu Li , Rahul Amin , Abolfazl Razi

We study a distributed hypothesis testing setup where peripheral nodes send quantized data to the fusion center in a memoryless fashion. The \emph{expected} number of bits sent by each node under the null hypothesis is kept limited. We…

Information Theory · Computer Science 2022-06-27 Yunus Inan , Mert Kayaalp , Ali H. Sayed , Emre Telatar