中文
相关论文

相关论文: Omni-Training: Bridging Pre-Training and Meta-Trai…

200 篇论文

Few-shot learning focuses on learning a new visual concept with very limited labelled examples. A successful approach to tackle this problem is to compare the similarity between examples in a learned metric space based on convolutional…

机器学习 · 计算机科学 2024-02-06 Heda Song , Mercedes Torres Torres , Ender Özcan , Isaac Triguero

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

机器学习 · 计算机科学 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Few-shot learning aims to transfer the knowledge acquired from training on a diverse set of tasks to unseen tasks from the same task distribution with a limited amount of labeled data. The underlying requirement for effective few-shot…

机器学习 · 计算机科学 2023-05-09 Shounak Datta , Sankha Subhra Mullick , Anish Chakrabarty , Swagatam Das

Deep neural networks often encounter significant performance drops while facing with domain shifts between training (source) and test (target) data. To address this issue, Test Time Adaptation (TTA) methods have been proposed to adapt…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Siqi Luo , Yi Xin , Yuntao Du , Tao Tan , Guangtao Zhai , Xiaohong Liu

In a world where new domains are constantly discovered and machine learning (ML) is applied to automate new tasks every day, challenges arise with the number of samples available to train ML models. While the traditional ML training relies…

机器学习 · 计算机科学 2025-04-08 Andrea Gajic , Sudip Vhaduri

Despite its astounding success in learning deeper multi-dimensional data, the performance of deep learning declines on new unseen tasks mainly due to its focus on same-distribution prediction. Moreover, deep learning is notorious for poor…

机器学习 · 计算机科学 2023-03-15 Hassan Gharoun , Fereshteh Momenifar , Fang Chen , Amir H. Gandomi

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

机器学习 · 计算机科学 2019-10-04 Akihiro Nakamura , Tatsuya Harada

Deep neural networks (DNNs) have achieved state-of-the-art results on time series classification (TSC) tasks. In this work, we focus on leveraging DNNs in the often-encountered practical scenario where access to labeled training data is…

机器学习 · 计算机科学 2021-03-05 Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff , Vishnu Tv

Transfer learning is widely used to adapt large pretrained models to new tasks with only a small amount of new data. However, a challenge persists -- the features from the original task often do not fully cover what is needed for unseen…

机器学习 · 计算机科学 2026-02-10 Xingyu Alice Yang , Jianyu Zhang , Léon Bottou

In the low-data regime, it is difficult to train good supervised models from scratch. Instead practitioners turn to pre-trained models, leveraging transfer learning. Ensembling is an empirically and theoretically appealing way to construct…

机器学习 · 计算机科学 2020-10-20 Basil Mustafa , Carlos Riquelme , Joan Puigcerver , André Susano Pinto , Daniel Keysers , Neil Houlsby

Few-shot learning aims to adapt knowledge learned from previous tasks to novel tasks with only a limited amount of labeled data. Research literature on few-shot learning exhibits great diversity, while different algorithms often excel at…

计算机视觉与模式识别 · 计算机科学 2021-09-14 Chi Zhang , Henghui Ding , Guosheng Lin , Ruibo Li , Changhu Wang , Chunhua Shen

Few-shot learning for neural networks (NNs) is an important problem that aims to train NNs with a few data. The main challenge is how to avoid overfitting since over-parameterized NNs can easily overfit to such small dataset. Previous work…

机器学习 · 计算机科学 2023-02-10 Daiki Chijiwa , Shin'ya Yamaguchi , Atsutoshi Kumagai , Yasutoshi Ida

Supervised deep learning-based approaches have been applied to task-oriented dialog and have proven to be effective for limited domain and language applications when a sufficient number of training examples are available. In practice, these…

计算与语言 · 计算机科学 2022-07-20 Oralie Cattan , Christophe Servan , Sophie Rosset

Recent years have witnessed an abundance of new publications and approaches on meta-learning. This community-wide enthusiasm has sparked great insights but has also created a plethora of seemingly different frameworks, which can be hard to…

机器学习 · 计算机科学 2020-02-04 Wei-Lun Chao , Han-Jia Ye , De-Chuan Zhan , Mark Campbell , Kilian Q. Weinberger

Few-shot models aim at making predictions using a minimal number of labeled examples from a given task. The main challenge in this area is the one-shot setting where only one element represents each class. We propose HyperShot - the fusion…

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

计算机视觉与模式识别 · 计算机科学 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the exploitation of lexical features and their distributional…

计算与语言 · 计算机科学 2021-07-27 ChengCheng Han , Zeqiu Fan , Dongxiang Zhang , Minghui Qiu , Ming Gao , Aoying Zhou

Graph representation learning, a critical step in graph-centric tasks, has seen significant advancements. Earlier techniques often operate in an end-to-end setting, which heavily rely on the availability of ample labeled data. This…

机器学习 · 计算机科学 2024-09-23 Xingtong Yu , Yuan Fang , Zemin Liu , Yuxia Wu , Zhihao Wen , Jianyuan Bo , Xinming Zhang , Steven C. H. Hoi

The rapid advancement of deep learning models often attributes to their ability to leverage massive training data. In contrast, such privilege has not yet fully benefited 3D deep learning, mainly due to the limited availability of…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Xiaoyang Wu , Zhuotao Tian , Xin Wen , Bohao Peng , Xihui Liu , Kaicheng Yu , Hengshuang Zhao

Meta-learning approaches have shown great success in vision and language domains. However, few studies discuss the practice of meta-learning for large-scale industrial applications. Although e-commerce companies have spent many efforts on…

机器学习 · 计算机科学 2020-10-12 Hao Gong , Qifang Zhao , Tianyu Li , Derek Cho , DuyKhuong Nguyen