English
Related papers

Related papers: Harnessing Superclasses for Learning from Hierarch…

200 papers

Labeling a training set is often expensive and susceptible to errors, making the design of robust loss functions for label noise an important problem. The symmetry condition provides theoretical guarantees for robustness to such noise. In…

Machine Learning · Computer Science 2026-05-21 Alexandre Lemire Paquin , Brahim Chaib-Draa , Philippe Giguère

Average-K classification is an alternative to top-K classification in which the number of labels returned varies with the ambiguity of the input image but must average to K over all the samples. A simple method to solve this task is to…

Machine Learning · Computer Science 2023-04-03 Camille Garcin , Maximilien Servajean , Alexis Joly , Joseph Salmon

Softmax working with cross-entropy is widely used in classification, which evaluates the similarity between two discrete distribution columns (predictions and true labels). Inspired by chi-square test, we designed a new loss function called…

Machine Learning · Computer Science 2021-09-01 Zeyu Wang , Meiqing Wang

Deep learning work on musical instrument recognition has generally focused on instrument classes for which we have abundant data. In this work, we exploit hierarchical relationships between instruments in a few-shot learning setup to enable…

Sound · Computer Science 2021-08-02 Hugo Flores Garcia , Aldo Aguilar , Ethan Manilow , Bryan Pardo

The Softmax loss is one of the most widely employed surrogate objectives for classification and ranking tasks. To elucidate its theoretical properties, the Fenchel-Young framework situates it as a canonical instance within a broad family of…

Machine Learning · Computer Science 2026-02-02 Yuanhao Pu , Defu Lian , Enhong Chen

This paper presents a novel method for embedding transfer, a task of transferring knowledge of a learned embedding model to another. Our method exploits pairwise similarities between samples in the source embedding space as the knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

Metric learning is an important problem in machine learning. It aims to group similar examples together. Existing state-of-the-art metric learning approaches require class labels to learn a metric. As obtaining class labels in all…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Ujjal Kr Dutta , Mehrtash Harandi , Chellu Chandra Sekhar

We propose a novel approach for loss reserving based on deep neural networks. The approach allows for joint modeling of paid losses and claims outstanding, and incorporation of heterogeneous inputs. We validate the models on loss reserving…

Applications · Statistics 2019-09-17 Kevin Kuo

Using class labels to represent class similarity is a typical approach to training deep hashing systems for retrieval; samples from the same or different classes take binary 1 or 0 similarity values. This similarity does not model the full…

Information Retrieval · Computer Science 2019-08-16 Heikki Arponen , Tom E Bishop

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Multi-label ranking maps instances to a ranked set of predicted labels from multiple possible classes. The ranking approach for multi-label learning problems received attention for its success in multi-label classification, with one of the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Emine Dari , V. Bugra Yesilkaynak , Alican Mertan , Gozde Unal

This paper introduces a general multi-class approach to weakly supervised classification. Inferring the labels and learning the parameters of the model is usually done jointly through a block-coordinate descent algorithm such as…

Machine Learning · Computer Science 2012-07-03 Armand Joulin , Francis Bach

Label inventories for fine-grained entity typing have grown in size and complexity. Nonetheless, they exhibit a hierarchical structure. Hyperbolic spaces offer a mathematically appealing approach for learning hierarchical representations of…

Computation and Language · Computer Science 2020-10-06 Federico López , Michael Strube

Image classification is one of the most important areas in computer vision. Hierarchical multi-label classification applies when a multi-class image classification problem is arranged into smaller ones based upon a hierarchy or taxonomy.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Khondaker Tasrif Noor , Antonio Robles-Kelly , Brano Kusy

A common practice in most of deep convolutional neural architectures is to employ fully-connected layers followed by Softmax activation to minimize cross-entropy loss for the sake of classification. Recent studies show that substitution or…

Machine Learning · Computer Science 2017-10-23 Arash Shahriari

Manifold learning is used for dimensionality reduction, with the goal of finding a projection subspace to increase and decrease the inter- and intraclass variances, respectively. However, a bottleneck for subspace learning methods often…

Machine Learning · Computer Science 2021-05-26 Parisa Abdolrahim Poorheravi , Vincent Gaudet

In this paper, we investigate the usage of autoencoders in modeling textual data. Traditional autoencoders suffer from at least two aspects: scalability with the high dimensionality of vocabulary size and dealing with task-irrelevant words.…

Machine Learning · Computer Science 2015-12-15 Shuangfei Zhai , Zhongfei Zhang

Supervised contrastive learning (SCL) frameworks treat each class as independent and thus consider all classes to be equally important. This neglects the common scenario in which label hierarchy exists, where fine-grained classes under the…

Machine Learning · Computer Science 2024-02-02 Ruixue Lian , William A. Sethares , Junjie Hu

Deep convolutional neural networks (CNNs) trained with logistic and softmax losses have made significant advancement in visual recognition tasks in computer vision. When training data exhibit class imbalances, the class-wise reweighted…

Machine Learning · Computer Science 2020-03-06 Xiangrui Li , Xin Li , Deng Pan , Dongxiao Zhu

We consider multi-class classification where the predictor has a hierarchical structure that allows for a very large number of labels both at train and test time. The predictive power of such models can heavily depend on the structure of…

Machine Learning · Statistics 2017-03-06 Yacine Jernite , Anna Choromanska , David Sontag