English
Related papers

Related papers: Revisiting Logistic-softmax Likelihood in Bayesian…

200 papers

Few-shot learning, a challenging task in machine learning, aims to learn a classifier adaptable to recognize new, unseen classes with limited labeled examples. Meta-learning has emerged as a prominent framework for few-shot learning. Its…

Machine Learning · Computer Science 2024-03-07 Weihao Jiang , Guodong Liu , Di He , Kun He

We introduce a new framework for studying meta-learning methods using PAC-Bayesian theory. Its main advantage over previous work is that it allows for more flexibility in how the transfer of knowledge between tasks is realized. For previous…

Machine Learning · Computer Science 2024-05-30 Hossein Zakerinia , Amin Behjati , Christoph H. Lampert

Few-shot fine-grained visual categorization (FS-FGVC) focuses on identifying various subcategories within a common superclass given just one or few support examples. Most existing methods aim to boost classification accuracy by enriching…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhiwen Yang , Jinglin Xu , Yuxin Pen

The existing event classification (EC) work primarily focuseson the traditional supervised learning setting in which models are unableto extract event mentions of new/unseen event types. Few-shot learninghas not been investigated in this…

Computation and Language · Computer Science 2020-06-22 Viet Dac Lai , Franck Dernoncourt , Thien Huu Nguyen

Few-shot relation classification seeks to classify incoming query instances after meeting only few support instances. This ability is gained by training with large amount of in-domain annotated data. In this paper, we tackle an even harder…

Computation and Language · Computer Science 2020-12-15 Xiaoqing Geng , Xiwen Chen , Kenny Q. Zhu , Libin Shen , Yinggong Zhao

Despite great popularity of applying softmax to map the non-normalised outputs of a neural network to a probability distribution over predicting classes, this normalised exponential transformation still seems to be artificial. A theoretic…

Machine Learning · Computer Science 2019-10-16 Zhenyue Qin , Dongwoo Kim

Meta-learning has emerged as an effective methodology to model several real-world tasks and problems due to its extraordinary effectiveness in the low-data regime. There are many scenarios ranging from the classification of rare diseases to…

Machine Learning · Computer Science 2023-12-29 Prabhat Agarwal , Shreya Singh

Machine learning techniques typically rely on large datasets to create accurate classifiers. However, there are situations when data is scarce and expensive to acquire. This is the case of studies that rely on state-of-the-art computational…

Machine Learning · Computer Science 2019-10-02 Francisco Sahli Costabal , Paris Perdikaris , Ellen Kuhl , Daniel E. Hurtado

In order to push the performance on realistic computer vision tasks, the number of classes in modern benchmark datasets has significantly increased in recent years. This increase in the number of classes comes along with increased ambiguity…

Machine Learning · Statistics 2016-04-14 Maksim Lapin , Matthias Hein , Bernt Schiele

This paper addresses the distributed stochastic minimax optimization problem subject to stochastic constraints. We propose a novel first-order Softmax-Weighted Switching Gradient method tailored for federated learning. Under full client…

Machine Learning · Computer Science 2026-03-09 Zhankun Luo , Antesh Upadhyay , Sang Bin Moon , Abolfazl Hashemi

The predominant method for computing confidence intervals (CI) in few-shot learning (FSL) is based on sampling the tasks with replacement, i.e.\ allowing the same samples to appear in multiple tasks. This makes the CI misleading in that it…

Machine Learning · Computer Science 2024-09-09 Raphael Lafargue , Luke Smith , Franck Vermet , Mathias Löwe , Ian Reid , Vincent Gripon , Jack Valmadre

Nowadays artificial neural network models achieve remarkable results in many disciplines. Functions mapping the representation provided by the model to the probability distribution are the inseparable aspect of deep learning solutions.…

Machine Learning · Computer Science 2023-04-24 Klaudia Bałazy , Łukasz Struski , Marek Śmieja , Jacek Tabor

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets. Current approaches primarily focus on detecting and removing duplicates, which risks the loss of valuable…

Computation and Language · Computer Science 2024-07-10 Nan He , Weichen Xiong , Hanwen Liu , Yi Liao , Lei Ding , Kai Zhang , Guohua Tang , Xiao Han , Wei Yang

Bayesian multinomial logistic regression provides a principled, interpretable approach to multiclass classification, but posterior sampling becomes increasingly expensive as the model dimension grows. Prior work has studied scalability in…

Computation · Statistics 2026-02-27 Jared D. Fisher , Kyle R. McEvoy

This work aims to develop a measure that can accurately rank the performance of various classifiers when they are tested on unlabeled data from out-of-distribution (OOD) distributions. We commence by demonstrating that conventional…

Machine Learning · Computer Science 2024-06-17 Weijie Tu , Weijian Deng , Liang Zheng , Tom Gedeon

We uncover an ever-overlooked deficiency in the prevailing Few-Shot Learning (FSL) methods: the pre-trained knowledge is indeed a confounder that limits the performance. This finding is rooted from our causal assumption: a Structural Causal…

Machine Learning · Computer Science 2020-12-07 Zhongqi Yue , Hanwang Zhang , Qianru Sun , Xian-Sheng Hua

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Few-shot image classification is challenging due to the lack of ample samples in each class. Such a challenge becomes even tougher when the number of classes is very large, i.e., the large-class few-shot scenario. In this novel scenario,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Bingcong Li , Bo Han , Zhuowei Wang , Jing Jiang , Guodong Long

Few-shot learning is an important research field of machine learning in which a classifier must be trained in such a way that it can adapt to new classes which are not included in the training set. However, only small amounts of examples of…

Machine Learning · Computer Science 2020-06-11 Andrei Boiarov , Oleg Granichin , Olga Granichina

The aim of this paper was to compare soft confusion matrix approach and Bayes metaclassifier under the multi-label classification framework. Although the methods were successfully applied under the multi-label classification framework, they…

Machine Learning · Computer Science 2019-01-28 Pawel Trajdos , Marcin Majak