English
Related papers

Related papers: Parity Queries for Binary Classification

200 papers

In this paper we study the reconstruction of binary sparse signals from partial random circulant measurements. We show that the reconstruction via the least-squares algorithm is as good as the reconstruction via the usually used program…

Information Theory · Computer Science 2020-06-29 Sandra Keiper

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

In the compressive phase retrieval problem, or phaseless compressed sensing, or compressed sensing from intensity only measurements, the goal is to reconstruct a sparse or approximately $k$-sparse vector $x \in \mathbb{R}^n$ given access to…

Data Structures and Algorithms · Computer Science 2020-03-03 Yi Li , Vasileios Nakos

This paper investigates total variation minimization in one spatial dimension for the recovery of gradient-sparse signals from undersampled Gaussian measurements. Recently established bounds for the required sampling rate state that uniform…

Information Theory · Computer Science 2022-04-12 Martin Genzel , Maximilian März , Robert Seidel

One of the central issues in the hidden subgroup problem is to bound the sample complexity, i.e., the number of identical samples of coset states sufficient and necessary to solve the problem. In this paper, we present general bounds for…

Quantum Physics · Physics 2008-04-26 Masahito Hayashi , Akinori Kawachi , Hirotada Kobayashi

Consider the following estimation problem: there are $n$ entities, each with an unknown parameter $p_i \in [0,1]$, and we observe $n$ independent random variables, $X_1,\ldots,X_n$, with $X_i \sim $ Binomial$(t, p_i)$. How accurately can…

Machine Learning · Computer Science 2017-11-23 Kevin Tian , Weihao Kong , Gregory Valiant

We present a systematic approach for achieving fairness in a binary classification setting. While we focus on two well-known quantitative definitions of fairness, our approach encompasses many other previously studied definitions as special…

Machine Learning · Computer Science 2018-07-17 Alekh Agarwal , Alina Beygelzimer , Miroslav Dudík , John Langford , Hanna Wallach

Mixture of linear regressions is a popular learning theoretic model that is used widely to represent heterogeneous data. In the simplest form, this model assumes that the labels are generated from either of two different linear models and…

Machine Learning · Statistics 2020-07-15 Arya Mazumdar , Soumyabrata Pal

In this paper, we expand the theory of depth-unbiased source localization to unbiased parameter estimation and signal reconstruction of an arbitrary number of non-zero parameters to be recovered. The topic touches on the concept of exact…

Information Theory · Computer Science 2026-05-08 Joonas Lahtinen

Two widely-used computational paradigms for sublinear algorithms are using linear measurements to perform computations on a high dimensional input and using structured queries to access a massive input. Typically, algorithms in the former…

Computational Complexity · Computer Science 2021-07-14 Amit Chakrabarti , Manuel Stoeckl

We consider the problem of finding the matching map between two sets of $d$-dimensional noisy feature-vectors. The distinctive feature of our setting is that we do not assume that all the vectors of the first set have their corresponding…

Statistics Theory · Mathematics 2023-03-10 Arshak Minasyan , Tigran Galstyan , Sona Hunanyan , Arnak Dalalyan

In high-dimensional generalized linear models, it is crucial to identify a sparse model that adequately accounts for response variation. Although the best subset section has been widely regarded as the Holy Grail of problems of this type,…

Machine Learning · Statistics 2023-08-02 Junxian Zhu , Jin Zhu , Borui Tang , Xuanyu Chen , Hongmei Lin , Xueqin Wang

We design new algorithms for the combinatorial pure exploration problem in the multi-arm bandit framework. In this problem, we are given $K$ distributions and a collection of subsets $\mathcal{V} \subset 2^{[K]}$ of these distributions, and…

Machine Learning · Statistics 2019-05-29 Tongyi Cao , Akshay Krishnamurthy

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

Machine Learning · Computer Science 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Pairwise likelihood is a useful approximation to the full likelihood function for covariance estimation in high-dimensional context. It simplifies high-dimensional dependencies by combining marginal bivariate likelihood objects, thus making…

Methodology · Statistics 2024-07-25 Alessandro Casa , Davide Ferrari , Zhendong Huang

Sequential hypothesis testing is a desirable decision making strategy in any time sensitive scenario. Compared with fixed sample-size testing, sequential testing is capable of achieving identical probability of error requirements using less…

Machine Learning · Statistics 2017-11-17 Diyan Teng , Emre Ertin

In this paper, we establish sample complexity bounds for learning high-dimensional simplices in $\mathbb{R}^K$ from noisy data. Specifically, we consider $n$ i.i.d. samples uniformly drawn from an unknown simplex in $\mathbb{R}^K$, each…

Machine Learning · Statistics 2025-06-13 Seyed Amir Hossein Saberi , Amir Najafi , Abolfazl Motahari , Babak H. khalaj

The randomized query complexity $R(f)$ of a boolean function $f\colon\{0,1\}^n\to\{0,1\}$ is famously characterized (via Yao's minimax) by the least number of queries needed to distinguish a distribution $D_0$ over $0$-inputs from a…

Computational Complexity · Computer Science 2020-02-26 Andrew Bassilakis , Andrew Drucker , Mika Göös , Lunjia Hu , Weiyun Ma , Li-Yang Tan

We investigate the reconstruction of multivariate functions from samples using sparse recovery techniques. For Square Root Lasso, Orthogonal Matching Pursuit, and Compressive Sampling Matching Pursuit, we demonstrate both theoretically and…

Numerical Analysis · Mathematics 2026-01-21 Moritz Moeller , Sebastian Neumayer , Kateryna Pozharska , Tizian Sommerfeld , Tino Ullrich

This paper presents an algorithm tailored for the efficient recovery of sparse probability measures incorporating $\ell_0$-sparse regularization within the probability simplex constraint. Employing the Bregman proximal gradient method, our…

Optimization and Control · Mathematics 2024-11-26 Jianting Pan , Ming Yan