中文
相关论文

相关论文: Meta-training with Demonstration Retrieval for Eff…

200 篇论文

Meta-learning approaches enable machine learning systems to adapt to new tasks given few examples by leveraging knowledge from related tasks. However, a large number of meta-training tasks are still required for generalization to unseen…

机器学习 · 计算机科学 2024-10-24 Seanie Lee , Bruno Andreis , Kenji Kawaguchi , Juho Lee , Sung Ju Hwang

Self-supervised pre-training of transformer models has shown enormous success in improving performance on a number of downstream tasks. However, fine-tuning on a new task still requires large amounts of task-specific labelled data to…

计算与语言 · 计算机科学 2020-11-17 Trapit Bansal , Rishikesh Jha , Andrew McCallum

Meta-learning offers a promising avenue for few-shot learning (FSL), enabling models to glean a generalizable feature embedding through episodic training on synthetic FSL tasks in a source domain. Yet, in practical scenarios where the…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Fei Zhou , Peng Wang , Lei Zhang , Zhenghua Chen , Wei Wei , Chen Ding , Guosheng Lin , Yanning Zhang

Deep neural networks (DNNs) have achieved state-of-the-art results on time series classification (TSC) tasks. In this work, we focus on leveraging DNNs in the often-encountered practical scenario where access to labeled training data is…

机器学习 · 计算机科学 2021-03-05 Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff , Vishnu Tv

Low-shot relation extraction~(RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, which seem to be with…

计算与语言 · 计算机科学 2022-03-24 Fangchao Liu , Hongyu Lin , Xianpei Han , Boxi Cao , Le Sun

Resembling the rapid learning capability of human, few-shot learning empowers vision systems to understand new concepts by training with few samples. Leading approaches derived from meta-learning on images with a single visual object.…

计算机视觉与模式识别 · 计算机科学 2020-03-17 Xiaopeng Yan , Ziliang Chen , Anni Xu , Xiaoxi Wang , Xiaodan Liang , Liang Lin

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

机器学习 · 计算机科学 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

Compared to humans, machine learning models generally require significantly more training examples and fail to extrapolate from experience to solve previously unseen challenges. To help close this performance gap, we augment single-task…

机器学习 · 计算机科学 2018-07-27 Tailin Wu , John Peurifoy , Isaac L. Chuang , Max Tegmark

Data availability has dramatically increased in recent years, driving model-based control methods to exploit learning techniques for improving the system description, and thus control performance. Two key factors that hinder the practical…

系统与控制 · 电气工程与系统科学 2022-11-22 Elena Arcari , Andrea Carron , Melanie N. Zeilinger

Language models, especially pre-trained large language models, have showcased remarkable abilities as few-shot in-context learners (ICL), adept at adapting to new tasks with just a few demonstrations in the input context. However, the…

计算与语言 · 计算机科学 2024-03-26 Man Luo , Xin Xu , Yue Liu , Panupong Pasupat , Mehran Kazemi

Meta-learning and other approaches to few-shot learning are widely studied for image recognition, and are increasingly applied to other vision tasks such as pose estimation and dense prediction. This naturally raises the question of whether…

计算机视觉与模式识别 · 计算机科学 2023-05-15 Ondrej Bohdal , Yinbing Tian , Yongshuo Zong , Ruchika Chavhan , Da Li , Henry Gouk , Li Guo , Timothy Hospedales

Meta-learning is a popular framework for learning with limited data in which an algorithm is produced by training over multiple few-shot learning tasks. For classification problems, these tasks are typically constructed by sampling a small…

机器学习 · 计算机科学 2021-10-08 Amrith Setlur , Oscar Li , Virginia Smith

Meta-learning (ML) has emerged as a promising learning method under resource constraints such as few-shot learning. ML approaches typically propose a methodology to learn generalizable models. In this work-in-progress paper, we put the…

机器学习 · 计算机科学 2022-03-07 Aroof Aimen , Sahil Sidheekh , Vineet Madan , Narayanan C. Krishnan

Controlling the generative model to adapt a new domain with limited samples is a difficult challenge and it is receiving increasing attention. Recently, methods based on meta-learning have shown promising results for few-shot domain…

计算与语言 · 计算机科学 2023-09-07 Pengsen Cheng , Jinqiao Dai , Jiamiao Liu , Jiayong Liu , Peng Jia

Meta-learning is a powerful paradigm for tackling few-shot tasks. However, recent studies indicate that models trained with the whole-class training strategy can achieve comparable performance to those trained with meta-learning in few-shot…

机器学习 · 计算机科学 2025-09-17 Yunchuan Guan , Yu Liu , Ke Zhou , Zhiqi Shen , Jenq-Neng Hwang , Serge Belongie , Lei Li

Few-shot learning-the ability to train models with access to limited data-has become increasingly popular in the natural language processing (NLP) domain, as large language models such as GPT and T0 have been empirically shown to achieve…

软件工程 · 计算机科学 2023-06-16 Robert Kraig Helmeczi , Mucahit Cevik , Savas Yıldırım

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the exploitation of lexical features and their distributional…

计算与语言 · 计算机科学 2021-07-27 ChengCheng Han , Zeqiu Fan , Dongxiang Zhang , Minghui Qiu , Ming Gao , Aoying Zhou

Transductive inference is an effective means of tackling the data deficiency problem in few-shot learning settings. A popular transductive inference technique for few-shot metric-based approaches, is to update the prototype of each class…

机器学习 · 计算机科学 2020-06-25 Seong Min Kye , Hae Beom Lee , Hoirin Kim , Sung Ju Hwang

Meta-learning for few-shot learning allows a machine to leverage previously acquired knowledge as a prior, thus improving the performance on novel tasks with only small amounts of data. However, most mainstream models suffer from…

机器学习 · 计算机科学 2019-11-13 Yadan Luo , Zi Huang , Zheng Zhang , Ziwei Wang , Mahsa Baktashmotlagh , Yang Yang

Large pre-trained models can dramatically reduce the amount of task-specific data required to solve a problem, but they often fail to capture domain-specific nuances out of the box. The Web likely contains the information necessary to excel…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Hamed Damirchi , Cristian Rodríguez-Opazo , Ehsan Abbasnejad , Damien Teney , Javen Qinfeng Shi , Stephen Gould , Anton van den Hengel