English
Related papers

Related papers: Fat Shattering, Joint Measurability, and PAC Learn…

200 papers

We present a new general-purpose algorithm for learning classes of $[0,1]$-valued functions in a generalization of the prediction model, and prove a general upper bound on the expected absolute error of this algorithm in terms of a…

Machine Learning · Computer Science 2023-04-25 Peter L. Bartlett , Philip M. Long

We study risk-sensitive reinforcement learning in finite discounted MDPs, where a generative model of the MDP is assumed to be available. We consider a family or risk measures called the optimized certainty equivalent (OCE), which includes…

Machine Learning · Computer Science 2026-05-22 Oliver Mortensen , Mohammad Sadegh Talebi

In many a traditional physics textbook, a quantum measurement is defined as a projective measurement represented by a Hermitian operator. In quantum information theory, however, the concept of a measurement is dealt with in complete…

Quantum Physics · Physics 2015-11-06 Ravi Kunjwal , Chris Heunen , Tobias Fritz

We study the problem of {\em properly} learning large margin halfspaces in the agnostic PAC model. In more detail, we study the complexity of properly learning $d$-dimensional halfspaces on the unit ball within misclassification error…

Machine Learning · Computer Science 2019-08-30 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi

As learning solutions reach critical applications in social, industrial, and medical domains, the need to curtail their behavior has become paramount. There is now ample evidence that without explicit tailoring, learning can lead to biased,…

Machine Learning · Computer Science 2021-02-19 Luiz F. O. Chamon , Alejandro Ribeiro

We characterize the asymptotic performance of a class of positive operator valued measurements (POVMs) where the only task is to make measurements on independent and identically distributed quantum states on finite-dimensional systems. The…

Quantum Physics · Physics 2016-11-24 Janis Nötzel

We study the distinguishability norms associated to families of locally restricted POVMs on multipartite systems. These norms (introduced by Matthews, Wehner and Winter) quantify how quantum measurements, subject to locality constraints,…

Quantum Physics · Physics 2020-08-27 Guillaume Aubrun , Cécilia Lancien

Valiant's 1984 paper is widely credited with introducing the PAC learning model, but it, in fact, introduced a different model: unlike PAC learning, the learner receives only positives, may issue membership queries, and must output a…

Machine Learning · Statistics 2026-05-14 Steve Hanneke , Anay Mehrotra , Grigoris Velegkas , Manolis Zampetakis

In this work, we initiate a formal study of probably approximately correct (PAC) learning under evasion attacks, where the adversary's goal is to \emph{misclassify} the adversarially perturbed sample point $\widetilde{x}$, i.e.,…

Machine Learning · Computer Science 2019-06-14 Dimitrios I. Diochnos , Saeed Mahloujifar , Mohammad Mahmoody

We revisit the problem of characterising the complexity of Quantum PAC learning, as introduced by Bshouty and Jackson [SIAM J. Comput. 1998, 28, 1136-1153]. Several quantum advantages have been demonstrated in this setting, however, none…

Quantum Physics · Physics 2023-09-21 Wilfred Salmon , Sergii Strelchuk , Tom Gur

Statistical performance bounds for reinforcement learning (RL) algorithms can be critical for high-stakes applications like healthcare. This paper introduces a new framework for theoretically measuring the performance of such algorithms…

Machine Learning · Computer Science 2018-01-03 Christoph Dann , Tor Lattimore , Emma Brunskill

Empirical risk minimization (ERM) is a fundamental learning rule for statistical learning problems where the data is generated according to some unknown distribution $\mathsf{P}$ and returns a hypothesis $f$ chosen from a fixed class…

Machine Learning · Computer Science 2014-11-25 Nishant A. Mehta , Robert C. Williamson

It is well-known in quantum information theory that a positive operator valued measure (POVM) is the most general kind of quantum measurement. Mathematically, a quantum probability is a normalised POVM, namely a function on certain subsets…

Quantum Physics · Physics 2022-12-06 Kyler S. Johnson , Michael J. Kozdron

Reinforcement learning in partially observed Markov decision processes (POMDPs) faces two challenges. (i) It often takes the full history to predict the future, which induces a sample complexity that scales exponentially with the horizon.…

Machine Learning · Computer Science 2024-04-02 Lingxiao Wang , Qi Cai , Zhuoran Yang , Zhaoran Wang

This paper focuses on the relation between computational learning theory and resource-bounded dimension. We intend to establish close connections between the learnability/nonlearnability of a concept class and its corresponding size in…

Computational Complexity · Computer Science 2015-03-17 Ricard Gavalda , Maria Lopez-Valdes , Elvira Mayordomo , N. V. Vinodchandran

In reinforcement learning, the classic objectives of maximizing discounted and finite-horizon cumulative rewards are PAC-learnable: There are algorithms that learn a near-optimal policy with high probability using a finite amount of samples…

Machine Learning · Computer Science 2023-07-04 Cambridge Yang , Michael Littman , Michael Carbin

In real-world applications, the distribution of the data, and our goals, evolve over time. The prevailing theoretical framework for studying machine learning, namely probably approximately correct (PAC) learning, largely ignores time. As a…

Machine Learning · Statistics 2025-01-31 Ashwin De Silva , Rahul Ramesh , Rubing Yang , Siyu Yu , Joshua T Vogelstein , Pratik Chaudhari

We present a novel notion of complexity that interpolates between and generalizes some classic existing complexity notions in learning theory: for estimators like empirical risk minimization (ERM) with arbitrary bounded losses, it is upper…

Machine Learning · Computer Science 2017-10-24 Peter D. Grünwald , Nishant A. Mehta

Superposition is an essential feature of quantum mechanics. From the Schrodinger's cat to quantum algorithms such as Deutsch-Jorsza algorithm, quantum superposition plays an important role. It is one fundamental and crucial question how to…

Quantum Physics · Physics 2025-07-15 Hai Wang

We consider PAC learning of probability distributions (a.k.a. density estimation), where we are given an i.i.d. sample generated from an unknown target distribution, and want to output a distribution that is close to the target in total…

Machine Learning · Computer Science 2018-06-05 Hassan Ashtiani , Shai Ben-David , Abbas Mehrabian