English
Related papers

Related papers: Efficient Quantum Agnostic Improper Learning of De…

200 papers

The problem of learning Boolean linear functions from quantum examples w.r.t. the uniform distribution can be solved on a quantum computer using the Bernstein-Vazirani algorithm. A similar strategy can be applied in the case of noisy…

Quantum Physics · Physics 2020-04-22 Matthias C. Caro

Noise is often regarded as anathema to quantum computation, but in some settings it can be an unlikely ally. We consider the problem of learning the class of $n$-bit parity functions by making queries to a quantum example oracle. In the…

Quantum Physics · Physics 2015-08-05 Andrew W. Cross , Graeme Smith , John A. Smolin

Traditional learning approaches for classification implicitly assume that each mistake has the same cost. In many real-world problems though, the utility of a decision depends on the underlying context $x$ and decision $y$. However,…

Machine Learning · Computer Science 2021-04-20 Kush Bhatia , Peter L. Bartlett , Anca D. Dragan , Jacob Steinhardt

Boosting is a method for finding a highly accurate hypothesis by linearly combining many ``weak" hypotheses, each of which may be only moderately accurate. Thus, boosting is a method for learning an ensemble of classifiers. While boosting…

Machine Learning · Computer Science 2021-07-30 Sai Saketh Rambhatla , Michael Jones , Rama Chellappa

Inspired by the problem of improving classification accuracy on rare or hard subsets of a population, there has been recent interest in models of learning where the goal is to generalize to a collection of distributions, each representing a…

Machine Learning · Computer Science 2023-06-06 Nick Rittler , Kamalika Chaudhuri

Weakly supervised methods have emerged as a powerful tool for model-agnostic anomaly detection at the Large Hadron Collider (LHC). While these methods have shown remarkable performance on specific signatures such as di-jet resonances, their…

We describe a framework for designing efficient active learning algorithms that are tolerant to random classification noise and are differentially-private. The framework is based on active learning algorithms that are statistical in the…

Machine Learning · Computer Science 2014-11-06 Maria Florina Balcan , Vitaly Feldman

Boosting is a general method to convert a weak learner (which generates hypotheses that are just slightly better than random) into a strong learner (which generates hypotheses that are much better than random). Recently, Arunachalam and…

Quantum Physics · Physics 2020-09-18 Adam Izdebski , Ronald de Wolf

Boosting is a popular way to derive powerful learners from simpler hypothesis classes. Following previous work (Mason et al., 1999; Friedman, 2000) on general boosting frameworks, we analyze gradient-based descent algorithms for boosting…

Machine Learning · Computer Science 2012-02-15 Alexander Grubb , J. Andrew Bagnell

We study the problem of PAC learning halfspaces in the reliable agnostic model of Kalai et al. (2012). The reliable PAC model captures learning scenarios where one type of error is costlier than the others. Our main positive result is a new…

Machine Learning · Computer Science 2024-11-19 Ilias Diakonikolas , Lisheng Ren , Nikos Zarifis

Boosting is an extremely successful idea, allowing one to combine multiple low accuracy classifiers into a much more accurate voting classifier. In this work, we present a new and surprisingly simple Boosting algorithm that obtains a…

Machine Learning · Computer Science 2024-09-02 Mikael Møller Høgsgaard , Kasper Green Larsen , Markus Engelund Mathiasen

Bayesian network structure learning is an NP-hard problem that has been faced by a number of traditional approaches in recent decades. Currently, quantum technologies offer a wide range of advantages that can be exploited to solve…

Quantum Physics · Physics 2022-03-07 Vicente P. Soloviev , Concha Bielza , Pedro Larrañaga

The efficacy of particle identification is compared using artificial neutral networks and boosted decision trees. The comparison is performed in the context of the MiniBooNE, an experiment at Fermilab searching for neutrino oscillations.…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Byron P. Roe , Hai-Jun Yang , Ji Zhu , Yong Liu , Ion Stancu , Gordon McGregor

Boosted decision trees enjoy popularity in a variety of applications; however, for large-scale datasets, the cost of training a decision tree in each round can be prohibitively expensive. Inspired by ideas from the multi-arm bandit…

Machine Learning · Computer Science 2018-05-22 Maryam Aziz , Jesse Anderton , Javed Aslam

We study the power of query access for the task of agnostic learning under the Gaussian distribution. In the agnostic model, no assumptions are made on the labels and the goal is to compute a hypothesis that is competitive with the {\em…

Machine Learning · Computer Science 2023-12-29 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

Logitboost is an influential boosting algorithm for classification. In this paper, we develop robust logitboost to provide an explicit formulation of tree-split criterion for building weak learners (regression trees) for logitboost. This…

Machine Learning · Computer Science 2012-03-19 Ping Li

Boosting combines weak (biased) learners to obtain effective learning algorithms for classification and prediction. In this paper, we show a connection between boosting and kernel-based methods, highlighting both theoretical and practical…

Machine Learning · Statistics 2017-04-14 Aleksandr Y. Aravkin , Giulio Bottegal , Gianluigi Pillonetto

In boosting, we aim to leverage multiple weak learners to produce a strong learner. At the center of this paradigm lies the concept of building the strong learner as a voting classifier, which outputs a weighted majority vote of the weak…

Machine Learning · Computer Science 2024-12-23 Arthur da Cunha , Kasper Green Larsen , Martin Ritzert

Algorithms for noiseless collaborative PAC learning have been analyzed and optimized in recent years with respect to sample complexity. In this paper, we study collaborative PAC learning with the goal of reducing communication cost at…

Machine Learning · Computer Science 2020-12-22 Avrim Blum , Shelby Heinecke , Lev Reyzin

We develop a framework using Hilbert spaces as a proxy to analyze PAC learning problems with structural properties. We consider a joint Hilbert space incorporating the relation between the true label and the predictor under a joint…

Machine Learning · Computer Science 2021-02-15 Mohsen Heidari , Wojciech Szpankowski