English
Related papers

Related papers: A Unified Framework with Meta-dropout for Few-shot…

200 papers

Federated learning (FL) is a popular framework for training an AI model using distributed mobile data in a wireless network. It features data parallelism by distributing the learning task to multiple edge devices while attempting to…

Machine Learning · Computer Science 2022-02-08 Dingzhu Wen , Ki-Jun Jeon , Kaibin Huang

The ability to learn from a small number of examples has been a difficult problem in machine learning since its inception. While methods have succeeded with large amounts of training data, research has been underway in how to accomplish…

Machine Learning · Computer Science 2017-08-24 Nathan Hilliard , Nathan O. Hodas , Courtney D. Corley

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

Machine Learning · Statistics 2020-09-10 Heinke Hihn , Daniel A. Braun

Currently, the state-of-the-art methods treat few-shot semantic segmentation task as a conditional foreground-background segmentation problem, assuming each class is independent. In this paper, we introduce the concept of meta-class, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhonghua Wu , Xiangxi Shi , Guosheng lin , Jianfei Cai

Deep neural networks require large training sets but suffer from high computational cost and long training times. Training on much smaller training sets while maintaining nearly the same accuracy would be very beneficial. In the few-shot…

Machine Learning · Computer Science 2021-08-09 Ilia Sucholutsky , Matthias Schonlau

Meta learning is a promising technique for solving few-shot fault prediction problems, which have attracted the attention of many researchers in recent years. Existing meta-learning methods for time series prediction, which predominantly…

Machine Learning · Computer Science 2023-11-07 Hai Su , Jiajun Hu , Songsen Yu

While deep learning has achieved remarkable results on various applications, it is usually data hungry and struggles to learn over non-stationary data stream. To solve these two limits, the deep learning model should not only be able to…

Machine Learning · Computer Science 2019-09-05 Canyu Le , Xihan Wei , Biao Wang , Lei Zhang , Zhonggui Chen

Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is still constrained by several factors, such as (i) low-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Gongjie Zhang , Zhipeng Luo , Kaiwen Cui , Shijian Lu , Eric P. Xing

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

Machine Learning · Computer Science 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi

Future deep learning systems call for techniques that can deal with the evolving nature of temporal data and scarcity of annotations when new problems occur. As a step towards this goal, we present FUSION (Few-shot UnSupervIsed cONtinual…

Machine Learning · Computer Science 2022-05-04 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

Training deep neural networks from few examples is a highly challenging and key problem for many computer vision tasks. In this context, we are targeting knowledge transfer from a set with abundant data to other sets with few available…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard , Andrei Bursuc

Deep learning models perform best when tested on target (test) data domains whose distribution is similar to the set of source (train) domains. However, model generalization can be hindered when there is significant difference in the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Pulkit Khandelwal , Paul Yushkevich

Deep Neural Networks have shown great promise on a variety of downstream applications; but their ability to adapt and generalize to new data and tasks remains a challenge. However, the ability to perform few or zero-shot adaptation to novel…

Machine Learning · Computer Science 2020-10-14 Samarth Sinha , Karsten Roth , Anirudh Goyal , Marzyeh Ghassemi , Hugo Larochelle , Animesh Garg

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

Deep neural networks are typically trained by uniformly sampling large datasets across epochs, despite evidence that not all samples contribute equally throughout learning. Recent work shows that progressively reducing the amount of…

Machine Learning · Computer Science 2026-04-15 Amar Gahir , Varshil Patel , Shreyank N Gowda

One-shot learning is usually tackled by using generative models or discriminative embeddings. Discriminative methods based on deep learning, which are very effective in other learning scenarios, are ill-suited for one-shot learning as they…

Computer Vision and Pattern Recognition · Computer Science 2016-06-17 Luca Bertinetto , João F. Henriques , Jack Valmadre , Philip H. S. Torr , Andrea Vedaldi

Dropout is often used in deep neural networks to prevent over-fitting. Conventionally, dropout training invokes \textit{random drop} of nodes from the hidden layers of a Neural Network. It is our hypothesis that a guided selection of nodes…

Machine Learning · Computer Science 2018-12-11 Rohit Keshari , Richa Singh , Mayank Vatsa

Few-shot learning aims to recognize novel queries with limited support samples by learning from base knowledge. Recent progress in this setting assumes that the base knowledge and novel query samples are distributed in the same domains,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yifan Zhao , Tong Zhang , Jia Li , Yonghong Tian

Deep graph generative modeling has gained enormous attraction in recent years due to its impressive ability to directly learn the underlying hidden graph distribution. Despite their initial success, these techniques, like much of the…

Machine Learning · Computer Science 2023-12-15 Sahil Manchanda , Shubham Gupta , Sayan Ranu , Srikanta Bedathur

When a large feedforward neural network is trained on a small training set, it typically performs poorly on held-out test data. This "overfitting" is greatly reduced by randomly omitting half of the feature detectors on each training case.…

Neural and Evolutionary Computing · Computer Science 2012-07-04 Geoffrey E. Hinton , Nitish Srivastava , Alex Krizhevsky , Ilya Sutskever , Ruslan R. Salakhutdinov