English
Related papers

Related papers: Faster Algorithms for Agnostically Learning Disjun…

200 papers

We study binary classification algorithms for which the prediction on any point is not too sensitive to individual examples in the dataset. Specifically, we consider the notions of uniform stability (Bousquet and Elisseeff, 2001) and…

Machine Learning · Computer Science 2020-09-24 Yuval Dagan , Vitaly Feldman

Here we study the comparative power of classical and quantum learners for generative modelling within the Probably Approximately Correct (PAC) framework. More specifically we consider the following task: Given samples from some unknown…

Quantum Physics · Physics 2021-03-24 Ryan Sweke , Jean-Pierre Seifert , Dominik Hangleiter , Jens Eisert

We study the problem of agnostic PAC reinforcement learning (RL): given a policy class $\Pi$, how many rounds of interaction with an unknown MDP (with a potentially large state and action space) are required to learn an…

Machine Learning · Computer Science 2023-10-11 Zeyu Jia , Gene Li , Alexander Rakhlin , Ayush Sekhari , Nathan Srebro

This paper presents a PAC-Bayes framework for learning controllers for unknown stochastic linear discrete-time systems, where the system parameters are drawn from a fixed but unknown distribution. We derive a data-dependent high probability…

Optimization and Control · Mathematics 2026-05-22 Yujia Luo , Ye Pu , Jonathan H. Manton , Jingge Zhu

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

Machine Learning · Computer Science 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

We investigate the complexity of learning query inseparable ELH ontologies in a variant of Angluin's exact learning model. Given a fixed data instance A* and a query language Q, we are interested in computing an ontology H that entails the…

Artificial Intelligence · Computer Science 2020-06-19 Ana Ozaki , Cosimo Persia , Andrea Mazzullo

We propose a learning model called the quantum statistical learning QSQ model, which extends the SQ learning model introduced by Kearns to the quantum setting. Our model can be also seen as a restriction of the quantum PAC learning model:…

Quantum Physics · Physics 2020-11-26 Srinivasan Arunachalam , Alex B. Grilo , Henry Yuen

Inferring the dynamical generator of a many-body quantum system from measurement data is essential for the verification, calibration, and control of quantum processors. When the system is open, this task becomes considerably harder than in…

We study the problem of learning under arbitrary distribution shift, where the learner is trained on a labeled set from one distribution but evaluated on a different, potentially adversarially generated test distribution. We focus on two…

Data Structures and Algorithms · Computer Science 2024-06-06 Surbhi Goel , Abhishek Shetty , Konstantinos Stavropoulos , Arsen Vasilyan

We study the power of query access for the task of agnostic learning under the Gaussian distribution. In the agnostic model, no assumptions are made on the labels and the goal is to compute a hypothesis that is competitive with the {\em…

Machine Learning · Computer Science 2023-12-29 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We generalize the "indirect learning" technique of Furst et. al., 1991 to reduce from learning a concept class over a samplable distribution $\mu$ to learning the same concept class over the uniform distribution. The reduction succeeds when…

Machine Learning · Computer Science 2021-12-24 Eric Binnendyk , Marco Carmosino , Antonina Kolokolova , Ramyaa Ramyaa , Manuel Sabin

We propose a novel learning paradigm for Deep Neural Networks (DNN) by using Boolean logic algebra. We first present the basic differentiable operators of a Boolean system such as conjunction, disjunction and exclusive-OR and show how these…

Machine Learning · Computer Science 2019-04-10 Ali Payani , Faramarz Fekri

We study the problem of learning mixtures of linear classifiers under Gaussian covariates. Given sample access to a mixture of $r$ distributions on $\mathbb{R}^n$ of the form $(\mathbf{x},y_{\ell})$, $\ell\in [r]$, where…

Machine Learning · Computer Science 2023-10-19 Ilias Diakonikolas , Daniel M. Kane , Yuxin Sun

We study the collaborative PAC learning problem recently proposed in Blum et al.~\cite{BHPQ17}, in which we have $k$ players and they want to learn a target function collaboratively, such that the learned function approximates the target…

Machine Learning · Computer Science 2018-10-15 Jiecao Chen , Qin Zhang , Yuan Zhou

We study the complexity of learning mixtures of separated Gaussians with common unknown bounded covariance matrix. Specifically, we focus on learning Gaussian mixture models (GMMs) on $\mathbb{R}^d$ of the form $P= \sum_{i=1}^k w_i…

Machine Learning · Computer Science 2023-06-23 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We improve both upper and lower bounds for the distribution-free testing of monotone conjunctions. Given oracle access to an unknown Boolean function $f:\{0,1\}^n \rightarrow \{0,1\}$ and sampling oracle access to an unknown distribution…

Discrete Mathematics · Computer Science 2015-11-12 Xi Chen , Jinyu Xie

We study the problem of computationally efficient proper agnostic learning of multidimensional concept classes under the Gaussian distribution. In this setting, given i.i.d. labeled samples from an unknown distribution over $\mathbb{R}^d…

Data Structures and Algorithms · Computer Science 2026-05-28 Sergei Tikhonov , Arsen Vasilyan

We study the task of agnostically learning halfspaces under the Gaussian distribution. Specifically, given labeled examples $(\mathbf{x},y)$ from an unknown distribution on $\mathbb{R}^n \times \{ \pm 1\}$, whose marginal distribution on…

Machine Learning · Computer Science 2023-02-14 Ilias Diakonikolas , Daniel M. Kane , Lisheng Ren

We establish the first general connection between the design of quantum algorithms and circuit lower bounds. Specifically, let $\mathfrak{C}$ be a class of polynomial-size concepts, and suppose that $\mathfrak{C}$ can be PAC-learned with…

Quantum Physics · Physics 2021-12-03 Srinivasan Arunachalam , Alex B. Grilo , Tom Gur , Igor C. Oliveira , Aarthi Sundaram