English
Related papers

Related papers: Concentration Distribution Learning from Label Dis…

200 papers

This paper considers the problem of inferring image labels from images when only a few annotated examples are available at training time. This setup is often referred to as low-shot learning, where a standard approach is to re-train the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Matthijs Douze , Arthur Szlam , Bharath Hariharan , Hervé Jégou

In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial…

Computation and Language · Computer Science 2024-01-31 Lingyu Gao , Aditi Chaudhary , Krishna Srinivasan , Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

In-Context Learning (ICL) is an important paradigm for adapting Large Language Models (LLMs) to downstream tasks through a few demonstrations. Despite the great success of ICL, the limitation of the demonstration number may lead to…

Computation and Language · Computer Science 2024-01-10 Caoyun Fan , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

A significant issue in training deep neural networks to solve supervised learning tasks is the need for large numbers of labelled datapoints. The goal of semi-supervised learning is to leverage ubiquitous unlabelled data, together with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Chengxu Zhuang , Xuehao Ding , Divyanshu Murli , Daniel Yamins

The advancements in large language models (LLMs) have brought significant progress in NLP tasks. However, if a task cannot be fully described in prompts, the models could fail to carry out the task. In this paper, we propose a simple yet…

Computation and Language · Computer Science 2025-06-10 Hwiyeol Jo , Hyunwoo Lee , Kang Min Yoo , Taiwoo Park

There is a family of label modification approaches including self and non-self label correction (LC), and output regularisation. They are widely used for training robust deep neural networks (DNNs), but have not been mathematically and…

Machine Learning · Computer Science 2022-09-07 Xinshao Wang , Yang Hua , Elyor Kodirov , Sankha Subhra Mukherjee , David A. Clifton , Neil M. Robertson

Generalized Category Discovery (GCD) utilizes labeled samples of known classes to discover novel classes in unlabeled samples. Existing methods show effective performance on artificial datasets with balanced distributions. However,…

Artificial Intelligence · Computer Science 2025-07-31 Cuong Manh Hoang

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

Machine Learning · Statistics 2025-12-03 Ali Alvandi , Mina Rezaei

Domain adaptive semantic segmentation aims to learn a model with the supervision of source domain data, and produce satisfactory dense predictions on unlabeled target domain. One popular solution to this challenging task is self-training,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Ruihuang Li , Shuai Li , Chenhang He , Yabin Zhang , Xu Jia , Lei Zhang

Active learning aims to select samples to be annotated that yield the largest performance improvement for the learning algorithm. Many methods approach this problem by measuring the informativeness of samples and do this based on the…

Machine Learning · Computer Science 2021-08-02 Javad Zolfaghari Bengar , Bogdan Raducanu , Joost van de Weijer

Label distribution learning (LDL) requires the learner to predict the degree of correlation between each sample and each label. To achieve this, a crucial task during learning is to leverage the correlation among labels. Deep Forest (DF) is…

Machine Learning · Computer Science 2026-02-09 Jia-Le Xu , Shen-Huan Lyu , Yu-Nian Wang , Ning Chen , Zhihao Qu , Bin Tang , Baoliu Ye

Learning from Label Proportions (LLP) is a learning setting, where the training data is provided in groups, or "bags", and only the proportion of each class in each bag is known. The task is to learn a model to predict the class labels of…

Machine Learning · Statistics 2015-02-13 Felix X. Yu , Krzysztof Choromanski , Sanjiv Kumar , Tony Jebara , Shih-Fu Chang

Compared with single-label image classification, multi-label image classification is more practical and challenging. Some recent studies attempted to leverage the semantic information of categories for improving multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Fengtao Zhou , Sheng Huang , Yun Xing

Machine Learning (ML)-based detectors are becoming essential to counter the proliferation of malware. However, common ML algorithms are not designed to cope with the dynamic nature of real-world settings, where both legitimate and malicious…

We investigate Learning from Label Proportions (LLP), a partial information setting where examples in a training set are grouped into bags, and only aggregate label values in each bag are available. Despite the partial observability, the…

Machine Learning · Computer Science 2025-06-02 Robert Busa-Fekete , Travis Dick , Claudio Gentile , Haim Kaplan , Tomer Koren , Uri Stemmer

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

Neural networks trained on real-world datasets with long-tailed label distributions are biased towards frequent classes and perform poorly on infrequent classes. The imbalance in the ratio of positive and negative samples for each class…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Kevin Duarte , Yogesh S. Rawat , Mubarak Shah

This paper studies structured node classification on graphs, where the predictions should consider dependencies between the node labels. In particular, we focus on solving the problem for partially labeled graphs where it is essential to…

Machine Learning · Computer Science 2023-06-21 Hyosoon Jang , Seonghyun Park , Sangwoo Mo , Sungsoo Ahn

Instance-dependent Partial Label Learning (ID-PLL) aims to learn a multi-class predictive model given training instances annotated with candidate labels related to features, among which correct labels are hidden fixed but unknown. The…

Machine Learning · Computer Science 2024-10-29 Congyu Qiao , Ning Xu , Yihao Hu , Xin Geng