中文
相关论文

相关论文: Diverse Distributions of Self-Supervised Tasks for…

200 篇论文

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

机器学习 · 计算机科学 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

Continual learning strives to ensure stability in solving previously seen tasks while demonstrating plasticity in a novel domain. Recent advances in continual learning are mostly confined to a supervised learning setting, especially in NLP…

机器学习 · 计算机科学 2024-06-03 Stella Ho , Ming Liu , Shang Gao , Longxiang Gao

Learning what to share between tasks has been a topic of great importance recently, as strategic sharing of knowledge has been shown to improve downstream task performance. This is particularly important for multilingual applications, as…

计算与语言 · 计算机科学 2020-10-06 Farhad Nooralahzadeh , Giannis Bekoulis , Johannes Bjerva , Isabelle Augenstein

Meta learning has attracted much attention recently in machine learning community. Contrary to conventional machine learning aiming to learn inherent prediction rules to predict labels for new query data, meta learning aims to learn the…

机器学习 · 计算机科学 2023-07-04 Jun Shu , Deyu Meng , Zongben Xu

This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing and robotics. Unlike…

机器学习 · 计算机科学 2020-10-27 Huimin Peng

Metalearning and multitask learning are two frameworks for solving a group of related learning tasks more efficiently than we could hope to solve each of the individual tasks on their own. In multitask learning, we are given a fixed set of…

机器学习 · 计算机科学 2024-04-02 Maryam Aliakbarpour , Konstantina Bairaktari , Gavin Brown , Adam Smith , Nathan Srebro , Jonathan Ullman

Meta-learning is widely used in few-shot classification and function regression due to its ability to quickly adapt to unseen tasks. However, it has not yet been well explored on regression tasks with high dimensional inputs such as images.…

计算机视觉与模式识别 · 计算机科学 2022-03-10 Ning Gao , Hanna Ziesche , Ngo Anh Vien , Michael Volpp , Gerhard Neumann

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

计算机视觉与模式识别 · 计算机科学 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

Meta-learning empowers learning systems with the ability to acquire knowledge from multiple tasks, enabling faster adaptation and generalization to new tasks. This review provides a comprehensive technical overview of meta-learning,…

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

Meta-learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient-based meta-learning algorithms are a specific sub-class that excel at quick adaptation to new tasks with limited…

机器学习 · 计算机科学 2020-10-20 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

Meta-learning is a general approach to equip machine learning models with the ability to handle few-shot scenarios when dealing with many tasks. Most existing meta-learning methods work based on the assumption that all tasks are of equal…

机器学习 · 计算机科学 2024-10-25 Zhaofeng Si , Shu Hu , Kaiyi Ji , Siwei Lyu

Albeit the universal representational power of pre-trained language models, adapting them onto a specific NLP task still requires a considerably large amount of labeled data. Effective task fine-tuning meets challenges when only a few…

机器学习 · 计算机科学 2021-09-10 Srinagesh Sharma , Guoqing Zheng , Ahmed Hassan Awadallah

Meta-learning has become a practical approach towards few-shot image classification, where "a strategy to learn a classifier" is meta-learned on labeled base classes and can be applied to tasks with novel classes. We remove the requirement…

计算机视觉与模式识别 · 计算机科学 2022-06-10 Han-Jia Ye , Lu Han , De-Chuan Zhan

While neural networks are powerful function approximators, they suffer from catastrophic forgetting when the data distribution is not stationary. One particular formalism that studies learning under non-stationary distribution is provided…

机器学习 · 统计学 2019-06-13 Xu He , Jakub Sygnowski , Alexandre Galashov , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

机器学习 · 计算机科学 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the availability of big datasets. One effective strategy to mitigate the issue of insufficient data…

机器学习 · 计算机科学 2026-05-14 Chaozhi Zhang , Lin Liu , Xiaoqun Zhang

Meta learning is a promising technique for solving few-shot fault prediction problems, which have attracted the attention of many researchers in recent years. Existing meta-learning methods for time series prediction, which predominantly…

机器学习 · 计算机科学 2023-11-07 Hai Su , Jiajun Hu , Songsen Yu

Existing meta-learning based few-shot learning (FSL) methods typically adopt an episodic training strategy whereby each episode contains a meta-task. Across episodes, these tasks are sampled randomly and their relationships are ignored. In…

机器学习 · 计算机科学 2020-09-29 Nanyi Fei , Zhiwu Lu , Yizhao Gao , Jia Tian , Tao Xiang , Ji-Rong Wen

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

机器学习 · 计算机科学 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li