English
Related papers

Related papers: Properly Learning Poisson Binomial Distributions i…

200 papers

We give two results on PAC learning DNF formulas using membership queries in the challenging "distribution-free" learning framework, where learning algorithms must succeed for an arbitrary and unknown distribution over $\{0,1\}^n$. (1) We…

Data Structures and Algorithms · Computer Science 2025-05-27 Josh Alman , Shivam Nadimpalli , Shyamal Patel , Rocco A. Servedio

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

The Unbounded Subset-Sum Problem (USSP) is defined as: given sum $s$ and a set of integers $W\leftarrow \{p_1,\dots,p_n\}$ output a set of non-negative integers $\{y_1,\dots,y_n\}$ such that $p_1y_1+\dots+p_ny_n=s$. The USSP is an…

Data Structures and Algorithms · Computer Science 2021-03-17 Majid Salimi , Hamid Mala

In the setting where we have $n$ independent observations of a random variable $X$, we derive explicit error bounds in total variation distance when approximating the number of observations equal to the maximum of the sample (in the case…

Probability · Mathematics 2026-04-10 Fraser Daly

Despite rapid advances in AI, safety remains the main bottleneck to deploying machine-learning systems. A critical safety component is out-of-distribution detection: given an input, decide whether it comes from the same distribution as the…

Machine Learning · Computer Science 2025-11-06 Joonas Järve , Karl Kaspar Haavel , Meelis Kull

Prior-data fitted networks (PFNs) have recently emerged as a powerful approach for Bayesian prediction tasks, approximating the posterior predictive distribution (PPD) through in-context learning. Despite their strong empirical performance…

Machine Learning · Statistics 2026-05-27 Gyeonghun Kang , Changwoo J. Lee , Xiang Cheng

We introduce the problem of Poisson sampling over joins: compute a sample of the result of a join query by conceptually performing a Bernoulli trial for each join tuple, using a non-uniform and tuple-specific probability. We propose an…

Databases · Computer Science 2026-03-17 Liese Bekkers , Frank Neven , Lorrens Pantelis , Stijn Vansummeren

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

Machine Learning · Computer Science 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

We study the efficient learnability of low-degree polynomial threshold functions (PTFs) in the presence of a constant fraction of adversarial corruptions. Our main algorithmic result is a polynomial-time PAC learning algorithm for this…

Data Structures and Algorithms · Computer Science 2024-04-02 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

We consider a change detection problem in which the arrival rate of a Poisson process changes suddenly at some unknown and unobservable disorder time. It is assumed that the prior distribution of the disorder time is known. The objective is…

Optimization and Control · Mathematics 2007-05-23 Erhan Bayraktar , Semih Sezer

We revisit the problem of learning from untrusted batches introduced by Qiao and Valiant [QV17]. Recently, Jain and Orlitsky [JO19] gave a simple semidefinite programming approach based on the cut-norm that achieves essentially…

Machine Learning · Computer Science 2020-06-09 Sitan Chen , Jerry Li , Ankur Moitra

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

In this paper we deal with the classical problem of random cover times. We investigate the distribution of the time it takes for a Poisson process of cylinders to cover a set $A \subset \mathbb{R}^d.$ This Poisson process of cylinders is…

Probability · Mathematics 2018-10-17 Erik I. Broman , Filipe Mussini

In Bayesian probabilistic programming, a central problem is to estimate the normalised posterior distribution (NPD) of a probabilistic program with conditioning via score (a.k.a. observe) statements. Most previous approaches address this…

Programming Languages · Computer Science 2024-08-02 Peixin Wang , Tengshun Yang , Hongfei Fu , Guanyan Li , C. -H. Luke Ong

We consider the problem of learning low-degree quantum objects up to $\varepsilon$-error in $\ell_2$-distance. We show the following results: $(i)$ unknown $n$-qubit degree-$d$ (in the Pauli basis) quantum channels and unitaries can be…

We consider a problem which has received considerable attention in systems literature because of its applications to routing in delay tolerant networks and replica placement in distributed storage systems. In abstract terms the problem can…

Data Structures and Algorithms · Computer Science 2013-07-16 Constantinos Daskalakis , Anindya De , Ilias Diakonikolas , Ankur Moitra , Rocco A. Servedio

We develop fast and memory efficient numerical methods for learning functions of many variables that admit sparse representations in terms of general bounded orthonormal tensor product bases. Such functions appear in many applications…

Numerical Analysis · Mathematics 2020-05-11 Bosu Choi , Mark Iwen , Felix Krahmer

We investigate sample-based learning of conditional distributions on multi-dimensional unit boxes, allowing for different dimensions of the feature and target spaces. Our approach involves clustering data near varying query points in the…

Machine Learning · Statistics 2024-06-14 Cyril Bénézet , Ziteng Cheng , Sebastian Jaimungal

Let $V$ be any vector space of multivariate degree-$d$ homogeneous polynomials with co-dimension at most $k$, and $S$ be the set of points where all polynomials in $V$ {\em nearly} vanish. We establish a qualitatively optimal upper bound on…

Machine Learning · Computer Science 2020-12-15 Ilias Diakonikolas , Daniel M. Kane

Deciding how to act in partially observable environments remains an active area of research. Identifying good sequences of decisions is particularly challenging when good control performance requires planning multiple steps into the future…

Artificial Intelligence · Computer Science 2014-01-17 Ruijie He , Emma Brunskill , Nicholas Roy