English
Related papers

Related papers: Group testing and local search: is there a computa…

200 papers

Group testing is the combinatorial problem of identifying the defective items in a population by grouping items into test pools. Recently, nonadaptive group testing - where all the test pools must be decided on at the start - has been…

Information Theory · Computer Science 2013-01-31 Matthew Aldridge

We address the problem of variable selection in a high-dimensional but sparse mean model, under the additional constraint that only privatised data are available for inference. The original data are vectors with independent entries having a…

Statistics Theory · Mathematics 2022-06-30 Cristina Butucea , Amandine Dubois , Adrien Saumard

Learning invariant representations is an important requirement when training machine learning models that are driven by spurious correlations in the datasets. These spurious correlations, between input samples and the target labels, wrongly…

Machine Learning · Computer Science 2022-01-12 Vishnu Suresh Lokhande , Kihyuk Sohn , Jinsung Yoon , Madeleine Udell , Chen-Yu Lee , Tomas Pfister

We propose and analyze the problems of \textit{community goodness-of-fit and two-sample testing} for stochastic block models (SBM), where changes arise due to modification in community memberships of nodes. Motivated by practical…

Information Theory · Computer Science 2019-11-01 Aditya Gangrade , Praveen Venkatesh , Bobak Nazer , Venkatesh Saligrama

The low-degree polynomial framework has emerged as a powerful tool for providing evidence of statistical-computational gaps in high-dimensional inference. For detection problems, the standard approach bounds the low-degree advantage through…

Statistics Theory · Mathematics 2026-04-21 Zhangsong Li

The problem of population recovery refers to estimating a distribution based on incomplete or corrupted samples. Consider a random poll of sample size $n$ conducted on a population of individuals, where each pollee is asked to answer $d$…

Statistics Theory · Mathematics 2020-04-30 Yury Polyanskiy , Ananda Theertha Suresh , Yihong Wu

Empirical risk minimization (ERM) is sensitive to spurious correlations in the training data, which poses a significant risk when deploying systems trained under this paradigm in high-stake applications. While the existing literature…

Machine Learning · Computer Science 2023-10-31 Christos Tsirigotis , Joao Monteiro , Pau Rodriguez , David Vazquez , Aaron Courville

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

Local SGD is a popular optimization method in distributed learning, often outperforming other algorithms in practice, including mini-batch SGD. Despite this success, theoretically proving the dominance of local SGD in settings with…

Population risk is always of primary interest in machine learning; however, learning algorithms only have access to the empirical risk. Even for applications with nonconvex nonsmooth losses (such as modern deep networks), the population…

Machine Learning · Computer Science 2018-10-19 Chi Jin , Lydia T. Liu , Rong Ge , Michael I. Jordan

Consider the community detection problem in random hypergraphs under the non-uniform hypergraph stochastic block model (HSBM), where each hyperedge appears independently with some given probability depending only on the labels of its…

Statistics Theory · Mathematics 2024-08-29 Ioana Dumitriu , Haixiao Wang

We study the problem of group testing with a non-adaptive randomized algorithm in the random incidence design (RID) model where each entry in the test is chosen randomly independently from $\{0,1\}$ with a fixed probability $p$. The…

Machine Learning · Computer Science 2017-08-10 Nader H. Bshouty , Nuha Diab , Shada R. Kawar , Robert J. Shahla

We present a computational approach to solution of the Kiefer-Weiss problem. Algorithms for construction of the optimal sampling plans and evaluation of their performance are proposed. In the particular case of Bernoulli observations, the…

Methodology · Statistics 2021-10-12 Andrey Novikov , Andrei Novikov , Fahil Farkhshatov

Detection of rare traits or diseases in a large population is challenging. Pool testing allows covering larger swathes of population at a reduced cost, while simplifying logistics. However, testing precision decreases as it becomes unclear…

Information Theory · Computer Science 2021-06-22 Éric Brier , Megi Dervishi , Rémi Géraud-Stewart , David Naccache , Ofer Yifrach-Stav

Test-time training (TTT) adapts language models through gradient-based updates at inference. But is adaptation the right strategy? We study compute-optimal test-time strategies for verifiable execution-grounded (VEG) tasks, domains like GPU…

Machine Learning · Computer Science 2026-02-10 Jarrod Barnes

In a group testing scheme, a set of tests is designed to identify a small number $t$ of defective items that are present among a large number $N$ of items. Each test takes as input a group of items and produces a binary output indicating…

Information Theory · Computer Science 2016-11-17 Arya Mazumdar

Integer Linear Programs (ILPs) are a flexible and ubiquitous model for discrete optimization problems. Solving ILPs is \textsf{NP-Hard} yet of great practical importance. Super-quadratic quantum speedups for ILPs have been difficult to…

In this paper, an exact bitwise MAP (Maximum A Posteriori) estimation algorithm for group testing problems is presented. We assume a simplest non-adaptive group testing scenario including N-objects with binary status and M-disjunctive…

Information Theory · Computer Science 2014-01-20 Tadashi Wadayama , Taisuke Izumi

Geo-social group search aims to find a group of people proximate to a location while socially related. One of the driven applications for geo-social group search is organizing an impromptu activity. This is because the social cohesiveness…

Databases · Computer Science 2019-12-19 Lu Chen , Chengfei Liu , Rui Zhou , Jiajie Xu , Jianxin Li

In network analysis and graph mining, closeness centrality is a popular measure to infer the importance of a vertex. Computing closeness efficiently for individual vertices received considerable attention. The NP-hard problem of group…

Data Structures and Algorithms · Computer Science 2019-11-11 Eugenio Angriman , Alexander van der Grinten , Henning Meyerhenke