English
Related papers

Related papers: ShareBoost: Efficient Multiclass Learning with Fea…

200 papers

When training data is scarce, it is common to make use of a feature extractor that has been pre-trained on a large base dataset, either by fine-tuning its parameters on the ``target'' dataset or by directly adopting its representation as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Raphael Lafargue , Yassir Bendou , Bastien Pasdeloup , Jean-Philippe Diguet , Ian Reid , Vincent Gripon , Jack Valmadre

Multiclass classifiers are often designed and evaluated only on a sample from the classes on which they will eventually be applied. Hence, their final accuracy remains unknown. In this work we study how a classifier's performance over the…

Machine Learning · Computer Science 2024-05-29 Yuli Slavutsky , Yuval Benjamini

A general formulation of optimization problems in which various candidate solutions may use different feature-sets is presented, encompassing supervised classification, automated program learning and other cases. A novel characterization of…

Machine Learning · Computer Science 2017-03-22 Ben Goertzel , Nil Geisweiller , Chris Poulin

Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods, little is known about why the resulting feature extractors…

Machine Learning · Computer Science 2020-07-02 Micah Goldblum , Steven Reich , Liam Fowl , Renkun Ni , Valeriia Cherepanova , Tom Goldstein

A principle bottleneck in image classification is the large number of training examples needed to train a classifier. Using active learning, we can reduce the number of training examples to teach a CNN classifier by strategically selecting…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Thien Nhan Vo

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

We present a scalable and effective classification model to train multi-class boosting for multi-class classification problems. Shen and Hao introduced a direct formulation of multi- class boosting in the sense that it directly maximizes…

Machine Learning · Computer Science 2013-07-23 Sakrapee Paisitkriangkrai , Chunhua Shen , Anton van den Hengel

Sharing information between multiple tasks enables algorithms to achieve good generalization performance even from small amounts of training data. However, in a realistic scenario of multi-task learning not all tasks are equally related to…

Machine Learning · Statistics 2014-12-04 Anastasia Pentina , Viktoriia Sharmanska , Christoph H. Lampert

In low-resource settings, model transfer can help to overcome a lack of labeled data for many tasks and domains. However, predicting useful transfer sources is a challenging problem, as even the most similar sources might lead to unexpected…

Computation and Language · Computer Science 2021-11-01 Lukas Lange , Jannik Strötgen , Heike Adel , Dietrich Klakow

Multi-class text classification is one of the key problems in machine learning and natural language processing. Emerging neural networks deal with the problem using a multi-output softmax layer and achieve substantial progress, but they do…

Computation and Language · Computer Science 2020-03-26 Haiyang Xu , Junwen Chen , Kun Han , Xiangang Li

Gradient-based learning algorithms have an implicit simplicity bias which in effect can limit the diversity of predictors being sampled by the learning procedure. This behavior can hinder the transferability of trained models by (i)…

Machine Learning · Computer Science 2022-11-24 Matteo Pagliardini , Martin Jaggi , François Fleuret , Sai Praneeth Karimireddy

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Gradient boosted decision trees are a popular machine learning technique, in part because of their ability to give good accuracy with small models. We describe two extensions to the standard tree boosting algorithm designed to increase this…

Machine Learning · Statistics 2017-11-01 Natalia Ponomareva , Thomas Colthurst , Gilbert Hendry , Salem Haykal , Soroush Radpour

Multitask learning is widely used in practice to train a low-resource target task by augmenting it with multiple related source tasks. Yet, naively combining all the source tasks with a target task does not always improve the prediction…

Machine Learning · Computer Science 2023-12-29 Dongyue Li , Huy L. Nguyen , Hongyang R. Zhang

In this study, we develop a method for multi-task manifold learning. The method aims to improve the performance of manifold learning for multiple tasks, particularly when each task has a small number of samples. Furthermore, the method also…

Machine Learning · Computer Science 2021-11-25 Hideaki Ishibashi , Kazushi Higa , Tetsuo Furukawa

Sharing parameters in multi-agent deep reinforcement learning has played an essential role in allowing algorithms to scale to a large number of agents. Parameter sharing between agents significantly decreases the number of trainable…

Multiagent Systems · Computer Science 2021-06-15 Filippos Christianos , Georgios Papoudakis , Arrasy Rahman , Stefano V. Albrecht

Despite the fact that different objects possess distinct class-specific features, they also usually share common patterns. Inspired by this observation, we propose a novel method to explicitly and simultaneously learn a set of common…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Tiep H. Vu , Vishal Monga

Few-shot learning is a challenging task since only few instances are given for recognizing an unseen class. One way to alleviate this problem is to acquire a strong inductive bias via meta-learning on similar tasks. In this paper, we show…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Wentao Chen , Chenyang Si , Wei Wang , Liang Wang , Zilei Wang , Tieniu Tan

Object detection is a task that performs position identification and label classification of objects in images or videos. The information obtained through this process plays an essential role in various tasks in the field of computer…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Heewon Lee , Sangtae Ahn