English
Related papers

Related papers: Curriculum Meta-Learning for Few-shot Classificati…

200 papers

The representations of the Earth's surface vary from one geographic region to another. For instance, the appearance of urban areas differs between continents, and seasonality influences the appearance of vegetation. To capture the diversity…

Machine Learning · Computer Science 2020-04-29 Marc Rußwurm , Sherrie Wang , Marco Körner , David Lobell

Large language models show impressive results on few-shot NLP tasks. However, these models are memory and computation-intensive. Meta-training allows one to leverage smaller models for few-shot generalization in a domain-general and…

Computation and Language · Computer Science 2023-07-04 Aaron Mueller , Kanika Narang , Lambert Mathias , Qifan Wang , Hamed Firooz

Humans exhibit a remarkable ability to learn quickly from a limited number of labeled samples, a capability that starkly contrasts with that of current machine learning systems. Unsupervised Few-Shot Learning (U-FSL) seeks to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li , Ruixuan Li

Neural Machine Translation (NMT) models are typically trained on heterogeneous data that are concatenated and randomly shuffled. However, not all of the training data are equally useful to the model. Curriculum training aims to present the…

Computation and Language · Computer Science 2022-03-29 Tasnim Mohiuddin , Philipp Koehn , Vishrav Chaudhary , James Cross , Shruti Bhosale , Shafiq Joty

The great majority of languages in the world are considered under-resourced for the successful application of deep learning methods. In this work, we propose a meta-learning approach to document classification in limited-resource setting…

Computation and Language · Computer Science 2021-04-27 Niels van der Heijden , Helen Yannakoudakis , Pushkar Mishra , Ekaterina Shutova

Artificial intelligence nowadays plays an increasingly prominent role in our life since decisions that were once made by humans are now delegated to automated systems. A machine learning algorithm trained based on biased data, however,…

Machine Learning · Computer Science 2020-09-29 Chen Zhao , Changbin Li , Jincheng Li , Feng Chen

The rapid development of artificial intelligence and deep learning has provided many opportunities to further enhance the safety, stability, and accuracy of industrial Cyber-Physical Systems (CPS). As indispensable components to many…

Machine Learning · Computer Science 2021-06-25 Shen Zhang , Fei Ye , Bingnan Wang , Thomas G. Habetler

In this paper, we investigate the feasibility of applying few-shot learning algorithms to a speech task. We formulate a user-defined scenario of spoken term classification as a few-shot learning problem. In most few-shot learning studies,…

Computation and Language · Computer Science 2020-09-15 Yangbin Chen , Tom Ko , Lifeng Shang , Xiao Chen , Xin Jiang , Qing Li

Meta-Learning (ML) has proven to be a useful tool for training Few-Shot Learning (FSL) algorithms by exposure to batches of tasks sampled from a meta-dataset. However, the standard training procedure overlooks the dynamic nature of the…

Machine Learning · Computer Science 2021-04-13 Mateusz Ochal , Massimiliano Patacchiola , Amos Storkey , Jose Vazquez , Sen Wang

Magnetic Resonance (MR) images suffer from various types of artifacts due to motion, spatial resolution, and under-sampling. Conventional deep learning methods deal with removing a specific type of artifact, leading to separately trained…

Image and Video Processing · Electrical Eng. & Systems 2023-04-14 Arun Palla , Sriprabha Ramanarayanan , Keerthi Ram , Mohanasankar Sivaprakasam

Few-shot learning is a challenging problem where the goal is to achieve generalization from only few examples. Model-agnostic meta-learning (MAML) tackles the problem by formulating prior knowledge as a common initialization across tasks,…

Machine Learning · Computer Science 2020-06-17 Sungyong Baik , Seokil Hong , Kyoung Mu Lee

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

In this paper, we explore meta-learning for few-shot text classification. Meta-learning has shown strong performance in computer vision, where low-level patterns are transferable across learning tasks. However, directly applying this…

Computation and Language · Computer Science 2020-02-19 Yujia Bao , Menghua Wu , Shiyu Chang , Regina Barzilay

Few-shot learning (FSL) has attracted increasing attention in recent years but remains challenging, due to the intrinsic difficulty in learning to generalize from a few examples. This paper proposes an adaptive margin principle to improve…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Aoxue Li , Weiran Huang , Xu Lan , Jiashi Feng , Zhenguo Li , Liwei Wang

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Few-shot learning (FSL) has attracted considerable attention recently. Among existing approaches, the metric-based method aims to train an embedding network that can make similar samples close while dissimilar samples as far as possible and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio

We explore different curriculum learning methods for training convolutional neural networks on the task of deformable pairwise 3D medical image registration. To the best of our knowledge, we are the first to attempt to improve performance…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Mihail Burduja , Radu Tudor Ionescu

Various automatic curriculum learning (ACL) methods have been proposed to improve the sample efficiency and final performance of deep reinforcement learning (DRL). They are designed to control how a DRL agent collects data, which is…

Machine Learning · Computer Science 2022-10-26 Jikun Kang , Miao Liu , Abhinav Gupta , Chris Pal , Xue Liu , Jie Fu

Few-shot image classification is challenging due to the lack of ample samples in each class. Such a challenge becomes even tougher when the number of classes is very large, i.e., the large-class few-shot scenario. In this novel scenario,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Bingcong Li , Bo Han , Zhuowei Wang , Jing Jiang , Guodong Long

The success of deep learning methods hinges on the availability of large training datasets annotated for the task of interest. In contrast to human intelligence, these methods lack versatility and struggle to learn and adapt quickly to new…

Computation and Language · Computer Science 2020-10-13 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova