English
Related papers

Related papers: A Primal-Dual Subgradient Approachfor Fair Meta Le…

200 papers

Few-shot learning algorithms aim to learn model parameters capable of adapting to unseen classes with the help of only a few labeled examples. A recent regularization technique - Manifold Mixup focuses on learning a general-purpose…

Machine Learning · Computer Science 2020-01-22 Puneet Mangla , Mayank Singh , Abhishek Sinha , Nupur Kumari , Vineeth N Balasubramanian , Balaji Krishnamurthy

Few-shot, fine-grained classification in computer vision poses significant challenges due to the need to differentiate subtle class distinctions with limited data. This paper presents a novel method that enhances the Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Eric Brouwer , Jan Erik van Woerden , Gertjan Burghouts , Matias Valdenegro-Toro , Marco Zullich

Large language models show impressive results on few-shot NLP tasks. However, these models are memory and computation-intensive. Meta-training allows one to leverage smaller models for few-shot generalization in a domain-general and…

Computation and Language · Computer Science 2023-07-04 Aaron Mueller , Kanika Narang , Lambert Mathias , Qifan Wang , Hamed Firooz

In the context of few-shot learning, it is currently believed that a fixed pre-trained (PT) model, along with fine-tuning the final layer during evaluation, outperforms standard meta-learning algorithms. We re-evaluate these claims under an…

Machine Learning · Computer Science 2025-09-24 Brando Miranda , Patrick Yu , Saumya Goyal , Yu-Xiong Wang , Sanmi Koyejo

Model generalizability to unseen datasets, concerned with in-the-wild robustness, is less studied for indoor single-image depth prediction. We leverage gradient-based meta-learning for higher generalizability on zero-shot cross-dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Cho-Ying Wu , Yiqi Zhong , Junying Wang , Ulrich Neumann

We extend first-order model agnostic meta-learning algorithms (including FOMAML and Reptile) to image segmentation, present a novel neural network architecture built for fast learning which we call EfficientLab, and leverage a formal…

Machine Learning · Computer Science 2020-05-11 Sean M. Hendryx , Andrew B. Leach , Paul D. Hein , Clayton T. Morrison

Traditional recognition methods typically require large, artificially-balanced training classes, while few-shot learning methods are tested on artificially small ones. In contrast to both extremes, real world recognition problems exhibit…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Davis Wertheimer , Bharath Hariharan

Few-shot learning deals with the fundamental and challenging problem of learning from a few annotated samples, while being able to generalize well on new tasks. The crux of few-shot learning is to extract prior knowledge from related tasks…

Machine Learning · Computer Science 2021-05-11 Yingjun Du , Haoliang Sun , Xiantong Zhen , Jun Xu , Yilong Yin , Ling Shao , Cees G. M. Snoek

The high cost of acquiring and annotating samples has made the `few-shot' learning problem of prime importance. Existing works mainly focus on improving performance on clean data and overlook robustness concerns on the data perturbed with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Gaurav Kumar Nayak , Ruchit Rawal , Inder Khatri , Anirban Chakraborty

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

Machine Learning · Computer Science 2020-07-17 Zhongjie Yu , Sebastian Raschka

Deep learning-based fault diagnosis (FD) approaches require a large amount of training data, which are difficult to obtain since they are located across different entities. Federated learning (FL) enables multiple clients to collaboratively…

Machine Learning · Computer Science 2023-10-16 Jixuan Cui , Jun Li , Zhen Mei , Kang Wei , Sha Wei , Ming Ding , Wen Chen , Song Guo

Data-Free Meta-Learning (DFML) aims to extract knowledge from a collection of pre-trained models without requiring the original data, presenting practical benefits in contexts constrained by data privacy concerns. Current DFML methods…

Machine Learning · Computer Science 2024-12-10 Yongxian Wei , Zixuan Hu , Zhenyi Wang , Li Shen , Chun Yuan , Dacheng Tao

Few-shot learning is a challenging problem that has attracted more and more attention recently since abundant training samples are difficult to obtain in practical applications. Meta-learning has been proposed to address this issue, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Xian Zhong , Cheng Gu , Wenxin Huang , Lin Li , Shuqin Chen , Chia-Wen Lin

Pre-trained Language Models (PLMs) can be accurately fine-tuned for downstream text processing tasks. Recently, researchers have introduced several parameter-efficient fine-tuning methods that optimize input prompts or adjust a small number…

Computation and Language · Computer Science 2024-06-07 Saeed Najafi , Alona Fyshe

Learning with few samples is a major challenge for parameter-rich models like deep networks. In contrast, people learn complex new concepts even from very few examples, suggesting that the sample complexity of learning can often be reduced.…

Machine Learning · Computer Science 2019-06-11 Roman Visotsky , Yuval Atzmon , Gal Chechik

Few-shot learning (FSL) aims to learn a classifier that can be easily adapted to recognize novel classes with only a few labeled examples. Some recent work about FSL has yielded promising classification performance, where the image-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jianpeng Yang , Yuhang Niu , Xuemei Xie , Guangming Shi

Metric learning aims to build a distance metric typically by learning an effective embedding function that maps similar objects into nearby points in its embedding space. Despite recent advances in deep metric learning, it remains…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Deunsol Jung , Dahyun Kang , Suha Kwak , Minsu Cho

The ability to learn new concepts with small amounts of data is a critical aspect of intelligence that has proven challenging for deep learning methods. Meta-learning has emerged as a promising technique for leveraging data from previous…

Machine Learning · Computer Science 2020-04-29 Mingzhang Yin , George Tucker , Mingyuan Zhou , Sergey Levine , Chelsea Finn

Few-shot learning problem focuses on recognizing unseen classes given a few labeled images. In recent effort, more attention is paid to fine-grained feature embedding, ignoring the relationship among different distance metrics. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Jinxiang Lai , Siqian Yang , Guannan Jiang , Xi Wang , Yuxi Li , Zihui Jia , Xiaochen Chen , Jun Liu , Bin-Bin Gao , Wei Zhang , Yuan Xie , Chengjie Wang

The ability to incrementally learn new classes is vital to all real-world artificial intelligence systems. A large portion of high-impact applications like social media, recommendation systems, E-commerce platforms, etc. can be represented…

Machine Learning · Computer Science 2021-12-28 Zhen Tan , Kaize Ding , Ruocheng Guo , Huan Liu