English
Related papers

Related papers: Efficient Quantum Agnostic Improper Learning of De…

200 papers

Fair classification has become an important topic in machine learning research. While most bias mitigation strategies focus on neural networks, we noticed a lack of work on fair classifiers based on decision trees even though they have…

Machine Learning · Computer Science 2019-11-19 Vincent Grari , Boris Ruf , Sylvain Lamprier , Marcin Detyniecki

Boosted decision trees typically yield good accuracy, precision, and ROC area. However, because the outputs from boosting are not well calibrated posterior probabilities, boosting yields poor squared error and cross-entropy. We empirically…

Machine Learning · Computer Science 2012-07-09 Alexandru Niculescu-Mizil , Richard A. Caruana

We give a quantum algorithm for evaluating a class of boolean formulas (such as NAND trees and 3-majority trees) on a restricted set of inputs. Due to the structure of the allowed inputs, our algorithm can evaluate a depth $n$ tree using…

Quantum Physics · Physics 2012-07-04 Bohua Zhan , Shelby Kimmel , Avinatan Hassidim

We use a Bayesian approach to optimally solve problems in noisy binary search. We deal with two variants: 1. Each comparison can be erroneous with some probability $1 - p$. 2. At each stage $k$ comparisons can be performed in parallel and a…

Quantum Physics · Physics 2011-11-09 M. Ben-Or , Avinatan Hassidim

Decision trees provide a rich family of highly non-linear but efficient models, due to which they continue to be the go-to family of predictive models by practitioners across domains. But learning trees is challenging due to their discrete…

Machine Learning · Computer Science 2022-10-03 Ajaykrishna Karthikeyan , Naman Jain , Nagarajan Natarajan , Prateek Jain

This paper explores the challenges of PAC learning in semi-enclosed environments that face persistent disruptive noise and demonstrates the weaknesses of traditional learning models based on noise-free data. We present a novel algorithm…

Machine Learning · Computer Science 2024-11-05 Shirmohammad Tavangari , Zahra Shakarami , Aref Yelghi , Asef Yelghi

A quantum learning machine for binary classification of qubit states that does not require quantum memory is introduced and shown to perform with the very same error rate as the optimal (programmable) discrimination machine for any size of…

Quantum Physics · Physics 2012-09-13 G. Sentís , J. Calsamiglia , R. Munoz-Tapia , E. Bagan

Unsupervised representation learning presents new opportunities for advancing Quantum Architecture Search (QAS) on Noisy Intermediate-Scale Quantum (NISQ) devices. QAS is designed to optimize quantum circuits for Variational Quantum…

Quantum Physics · Physics 2026-02-04 Yize Sun , Zixin Wu , Volker Tresp , Yunpu Ma

We develop a framework for learning from noisy quantum experiments in which fault-tolerant devices access uncharacterized systems through noisy couplings. Introducing the complexity class $\textsf{NBQP}$ ("noisy BQP''), we model noisy…

Quantum Physics · Physics 2026-01-15 Jordan Cotler , Weiyuan Gong , Ishaan Kannan

This paper investigates the integration of gradient boosted decision trees and varying coefficient models. We introduce the tree boosted varying coefficient framework which justifies the implementation of decision tree boosting as the…

Methodology · Statistics 2019-04-03 Yichen Zhou , Giles Hooker

In pool-based active learning, the learner is given an unlabeled data set and aims to efficiently learn the unknown hypothesis by querying the labels of the data points. This can be formulated as the classical Optimal Decision Tree (ODT)…

Machine Learning · Computer Science 2024-08-01 Su Jia , Fatemeh Navidi , Viswanath Nagarajan , R. Ravi

We study the complexity of two closely related learning problems, one quantum and one classical. In the quantum setting, we consider agnostic tomography for the natural class of product mixed states. Given $N$ copies of an $n$-qubit state…

Quantum Physics · Physics 2026-04-30 Alvan Arulandu , Ilias Diakonikolas , Daniel Kane , Jerry Li

Positive-unlabeled (PU) learning deals with binary classification problems when only positive (P) and unlabeled (U) data are available. Many recent PU methods are based on neural networks, but little has been done to develop boosting…

Machine Learning · Computer Science 2022-12-08 Yawen Zhao , Mingzhe Zhang , Chenhao Zhang , Weitong Chen , Nan Ye , Miao Xu

Model-free reinforcement learning algorithms, such as Q-learning, perform poorly in the early stages of learning in noisy environments, because much effort is spent unlearning biased estimates of the state-action value function. The bias…

Machine Learning · Computer Science 2018-02-01 Roy Fox , Ari Pakman , Naftali Tishby

We aim to study the modeling limitations of the commonly employed boosted decision trees classifier. Inspired by the success of large, data-hungry visual recognition models (e.g. deep convolutional neural networks), this paper focuses on…

Computer Vision and Pattern Recognition · Computer Science 2017-01-09 Eshed Ohn-Bar , Mohan M. Trivedi

We prove that it is NP-hard to properly PAC learn decision trees with queries, resolving a longstanding open problem in learning theory (Bshouty 1993; Guijarro-Lavin-Raghavan 1999; Mehta-Raghavan 2002; Feldman 2016). While there has been a…

Computational Complexity · Computer Science 2023-07-11 Caleb Koch , Carmen Strassle , Li-Yang Tan

We propose a Gradient Boosting algorithm for learning an ensemble of kernel functions adapted to the task at hand. Unlike state-of-the-art Multiple Kernel Learning techniques that make use of a pre-computed dictionary of kernel functions to…

Machine Learning · Statistics 2019-06-17 Léo Gautheron , Pascal Germain , Amaury Habrard , Emilie Morvant , Marc Sebban , Valentina Zantedeschi

Neural networks enjoy widespread success in both research and industry and, with the imminent advent of quantum technology, it is now a crucial challenge to design quantum neural networks for fully quantum learning tasks. Here we propose…

Learning problems involving quantum data are natural candidates for demonstrating an advantage in quantum machine learning. Recent results indicate that, for certain tasks and under noiseless conditions, coherent processing of quantum data…

We propose a soft gradient boosting framework for sequential regression that embeds a learnable linear feature transform within the boosting procedure. At each boosting iteration, we train a soft decision tree and learn a linear input…

Machine Learning · Computer Science 2025-09-17 Huseyin Karaca , Suleyman Serdar Kozat