English
Related papers

Related papers: ShareBoost: Efficient Multiclass Learning with Fea…

200 papers

We consider a multitask learning problem, in which several predictors are learned jointly. Prior research has shown that learning the relations between tasks, and between the input features, together with the predictor, can lead to better…

Machine Learning · Computer Science 2019-07-11 Han Zhao , Otilia Stretcu , Alex Smola , Geoff Gordon

This paper presents a computationally efficient variant of gradient boosting for multi-class classification and multi-output regression tasks. Standard gradient boosting uses a 1-vs-all strategy for classifications tasks with more than two…

Machine Learning · Computer Science 2024-07-25 Seyedsaman Emami , Gonzalo Martínez-Muñoz

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

In multi-class classification tasks, like human activity recognition, it is often assumed that classes are separable. In real applications, this assumption becomes strong and generates inconsistencies. Besides, the most commonly used…

Machine Learning · Computer Science 2021-04-13 Aomar Osmani , Massinissa Hamidi , Pegah Alizadeh

Few-shot classification aims to learn a classifier to recognize unseen classes during training with limited labeled examples. While significant progress has been made, the growing complexity of network designs, meta-learning algorithms, and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Wei-Yu Chen , Yen-Cheng Liu , Zsolt Kira , Yu-Chiang Frank Wang , Jia-Bin Huang

In real-world classification problems, the class balance in the training dataset does not necessarily reflect that of the test dataset, which can cause significant estimation bias. If the class ratio of the test dataset is known, instance…

Machine Learning · Computer Science 2012-06-22 Marthinus Du Plessis , Masashi Sugiyama

We consider the problem of producing fair probabilistic classifiers for multi-class classification tasks. We formulate this problem in terms of "projecting" a pre-trained (and potentially unfair) classifier onto the set of models that…

Machine Learning · Computer Science 2022-06-17 Wael Alghamdi , Hsiang Hsu , Haewon Jeong , Hao Wang , P. Winston Michalak , Shahab Asoodeh , Flavio P. Calmon

Multicalibration extends classical calibration by requiring predictions to be unbiased over a rich collection of functions, encompassing both prediction slices and subpopulations. It has emerged as a powerful framework for fairness,…

Machine Learning · Statistics 2026-05-26 Hanxuan Ye , Hongzhe Li

Few-shot learning aims to correctly recognize query samples from unseen classes given a limited number of support samples, often by relying on global embeddings of images. In this paper, we propose to equip the backbone network with an…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Jie Hong , Pengfei Fang , Weihao Li , Tong Zhang , Christian Simon , Mehrtash Harandi , Lars Petersson

A key question in Reinforcement Learning is which representation an agent can learn to efficiently reuse knowledge between different tasks. Recently the Successor Representation was shown to have empirical benefits for transferring…

Machine Learning · Computer Science 2018-07-06 Lucas Lehnert , Michael L. Littman

Excessive reuse of holdout data can lead to overfitting. However, there is little concrete evidence of significant overfitting due to holdout reuse in popular multiclass benchmarks today. Known results show that, in the worst-case,…

Machine Learning · Computer Science 2019-05-27 Vitaly Feldman , Roy Frostig , Moritz Hardt

Developing learning methods which do not discriminate subgroups in the population is a central goal of algorithmic fairness. One way to reach this goal is by modifying the data representation in order to meet certain fairness constraints.…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Andreas Maurer , Massimiliano Pontil

Federated learning aims to learn a global model collaboratively while the training data belongs to different clients and is not allowed to be exchanged. However, the statistical heterogeneity challenge on non-IID data, such as class…

Machine Learning · Computer Science 2023-04-12 Yunheng Shen , Haoxiang Wang , Hairong Lv

We consider the general problem of learning a predictor that satisfies multiple objectives of interest simultaneously, a broad framework that captures a range of specific learning goals including calibration, regret, and multiaccuracy. We…

Machine Learning · Computer Science 2026-02-17 Jivat Neet Kaur , Isaac Gibbs , Michael I. Jordan

This paper introduces self-paced task selection to multitask learning, where instances from more closely related tasks are selected in a progression of easier-to-harder tasks, to emulate an effective human education strategy, but applied to…

Machine Learning · Statistics 2017-06-20 Keerthiram Murugesan , Jaime Carbonell

Learning auxiliary tasks, such as multiple predictions about the world, can provide many benefits to reinforcement learning systems. A variety of off-policy learning algorithms have been developed to learn such predictions, but as yet there…

Machine Learning · Computer Science 2022-02-24 Matthew McLeod , Chunlok Lo , Matthew Schlegel , Andrew Jacobsen , Raksha Kumaraswamy , Martha White , Adam White

For classification models based on neural networks, the maximum predicted class probability is often used as a confidence score. This score rarely predicts well the probability of making a correct prediction and requires a post-processing…

Machine Learning · Computer Science 2024-11-07 Adrien LeCoz , Stéphane Herbin , Faouzi Adjed

Deep neural networks usually benefit from unsupervised pre-training, e.g. auto-encoders. However, the classifier further needs supervised fine-tuning methods for good discrimination. Besides, due to the limits of full-connection, the…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Hailin Shi , Xiangyu Zhu , Zhen Lei , Shengcai Liao , Stan Z. Li

We present online boosting algorithms for multiclass classification with bandit feedback, where the learner only receives feedback about the correctness of its prediction. We propose an unbiased estimate of the loss using a randomized…

Machine Learning · Statistics 2019-02-26 Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto