English
Related papers

Related papers: Hardness of Learning Boolean Functions from Label …

200 papers

In many applications, especially due to lack of supervision or privacy concerns, the training data is grouped into bags of instances (feature-vectors) and for each bag we have only an aggregate label derived from the instance-labels in the…

Machine Learning · Computer Science 2025-07-16 Sagalpreet Singh , Navodita Sharma , Shreyas Havaldar , Rishi Saket , Aravindan Raghuveer

Learning with Label Proportions (LLP) is the problem of recovering the underlying true labels given a dataset when the data is presented in the form of bags. This paradigm is particularly suitable in contexts where providing individual…

Machine Learning · Computer Science 2018-10-25 Rafael Poyiadzi , Raul Santos-Rodriguez , Niall Twomey

Learning from Label Proportions (LLP) is a learning problem where only aggregate level labels are available for groups of instances, called bags, during training, and the aim is to get the best performance at the instance-level on the test…

Machine Learning · Computer Science 2024-03-21 Shreyas Havaldar , Navodita Sharma , Shubhi Sareen , Karthikeyan Shanmugam , Aravindan Raghuveer

We study the efficient PAC learnability of halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, each label is independently flipped with some probability which is controlled by an adversary. This noise model…

Machine Learning · Computer Science 2020-06-12 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We propose a learning algorithm capable of learning from label proportions instead of direct data labels. In this scenario, our data are arranged into various bags of a certain size, and only the proportions of each label within a given bag…

Machine Learning · Computer Science 2019-06-27 Gabriel Dulac-Arnold , Neil Zeghidour , Marco Cuturi , Lucas Beyer , Jean-Philippe Vert

We prove the hardness of weakly learning halfspaces in the presence of adversarial noise using polynomial threshold functions (PTFs). In particular, we prove that for any constants $d \in \mathbb{Z}^+$ and $\varepsilon > 0$, it is NP-hard…

Computational Complexity · Computer Science 2017-07-07 Arnab Bhattacharyya , Suprovat Ghoshal , Rishi Saket

We study the problem of efficient PAC active learning of homogeneous linear classifiers (halfspaces) in $\mathbb{R}^d$, where the goal is to learn a halfspace with low error using as few label queries as possible. Under the extra assumption…

Machine Learning · Computer Science 2018-06-05 Chicheng Zhang

This paper proposes a novel and efficient method for Learning from Label Proportions (LLP), whose goal is to train a classifier only by using the class label proportions of instance sets, called bags. We propose a novel LLP method based on…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Shinnosuke Matsuo , Ryoma Bise , Seiichi Uchida , Daiki Suehiro

In learning from aggregate labels, the training data consists of sets or "bags" of feature-vectors (instances) along with an aggregate label for each bag derived from the (usually {0,1}-valued) labels of its instances. In learning from…

Machine Learning · Computer Science 2024-11-12 Yukti Makhija , Rishi Saket

We prove the following strong hardness result for learning: Given a distribution of labeled examples from the hypercube such that there exists a monomial consistent with $(1-\eps)$ of the examples, it is NP-hard to find a halfspace that is…

Computational Complexity · Computer Science 2010-12-06 Vitaly Feldman , Venkatesan Guruswami , Prasad Raghavendra , Yi Wu

We give an algorithm that learns arbitrary Boolean functions of $k$ arbitrary halfspaces over $\mathbb{R}^n$, in the challenging distribution-free Probably Approximately Correct (PAC) learning model, running in time $2^{\sqrt{n} \cdot (\log…

Data Structures and Algorithms · Computer Science 2026-03-10 Josh Alman , Shyamal Patel , Rocco A. Servedio

Learning from label proportions (LLP) is a promising weakly supervised learning problem. In LLP, a set of instances (bag) has label proportions, but no instance-level labels are given. LLP aims to train an instance-level classifier by using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Takanori Asanomi , Shinnosuke Matsuo , Daiki Suehiro , Ryoma Bise

The basic problem in the PAC model of computational learning theory is to determine which hypothesis classes are efficiently learnable. There is presently a dearth of results showing hardness of learning problems. Moreover, the existing…

Machine Learning · Computer Science 2014-03-11 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

Learning from label proportions (LLP), i.e., a challenging weakly-supervised learning task, aims to train a classifier by using bags of instances and the proportions of classes within bags, rather than annotated labels for each instance.…

Artificial Intelligence · Computer Science 2025-03-26 Tianhao Ma , Han Chen , Juncheng Hu , Yungang Zhu , Ximing Li

We study {\em online} active learning of homogeneous halfspaces in $\mathbb{R}^d$ with adversarial noise where the overall probability of a noisy label is constrained to be at most $\nu$. Our main contribution is a Perceptron-like online…

Machine Learning · Computer Science 2021-06-24 Jie Shen

This work addresses the challenge of training supervised machine or deep learning models on orbiting platforms where we are generally constrained by limited on-board hardware capabilities and restricted uplink bandwidths to upload. We aim…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Raúl Ramos-Pollán , Fabio A. González

In the supervised learning setting termed Multiple-Instance Learning (MIL), the examples are bags of instances, and the bag label is a function of the labels of its instances. Typically, this function is the Boolean OR. The learner observes…

Machine Learning · Computer Science 2015-03-19 Sivan Sabato , Naftali Tishby

Learning from Label Proportion (LLP) is a weakly supervised learning scenario in which training data is organized into predefined bags of instances, disclosing only the class label proportions per bag. This paradigm is essential for user…

Machine Learning · Computer Science 2024-08-14 Jialiang Wang , Ning Zhang , Shimin Di , Ruidong Wang , Lei Chen

We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a…

Machine Learning · Computer Science 2023-03-10 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

Objective: Using traditional approaches, a Brain-Computer Interface (BCI) requires the collection of calibration data for new subjects prior to online use. Calibration time can be reduced or eliminated e.g.~by transfer of a pre-trained…

Machine Learning · Statistics 2017-07-05 D Hübner , T Verhoeven , K Schmid , K-R Müller , M Tangermann , P-J Kindermans