English
Related papers

Related papers: Meta-DM: Applications of Diffusion Models on Few-S…

200 papers

Few-shot learning (FSL) is a central problem in meta-learning, where learners must efficiently learn from few labeled examples. Within FSL, feature pre-training has recently become an increasingly popular strategy to significantly improve…

Machine Learning · Computer Science 2023-11-07 Ruohan Wang , Isak Falk , Massimiliano Pontil , Carlo Ciliberto

Few-shot learning remains challenging for meta-learning that learns a learning algorithm (meta-learner) from many related tasks. In this work, we argue that this is due to the lack of a good representation for meta-learning, and propose…

Machine Learning · Computer Science 2018-02-13 Fengwei Zhou , Bin Wu , Zhenguo Li

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

Over the past few years, significant advancements have been made in the field of machine learning (ML) to address resource management, interference management, autonomy, and decision-making in wireless networks. Traditional ML approaches…

Machine Learning · Computer Science 2023-11-07 Xiaonan Liu , Yansha Deng , Arumugam Nallanathan , Mehdi Bennis

The use of meta-learning and transfer learning in the task of few-shot image classification is a well researched area with many papers showcasing the advantages of transfer learning over meta-learning in cases where data is plentiful and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Joshua Ball

With the continuous development of natural language processing (NLP) technology, text classification tasks have been widely used in multiple application fields. However, obtaining labeled data is often expensive and difficult, especially in…

Computation and Language · Computer Science 2025-02-14 Jia Gao , Shuangquan Lyu , Guiran Liu , Binrong Zhu , Hongye Zheng , Xiaoxuan Liao

Diffusion Models~(DMs) have emerged as the dominant approach in Generative Artificial Intelligence (GenAI), owing to their remarkable performance in tasks such as text-to-image synthesis. However, practical DMs, such as stable diffusion,…

Machine Learning · Computer Science 2025-08-18 Xuhui Fan , Zhangkai Wu , Hongyu Wu

Diffusion Models (DMs), also referred to as score-based diffusion models, utilize neural networks to specify score functions. Unlike most other probabilistic models, DMs directly model the score functions, which makes them more flexible to…

Machine Learning · Computer Science 2023-04-11 Weijian Luo

Few-Shot Learning (FSL) is a topic of rapidly growing interest. Typically, in FSL a model is trained on a dataset consisting of many small tasks (meta-tasks) and learns to adapt to novel tasks that it will encounter during test time. This…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Sivan Doveh , Eli Schwartz , Chao Xue , Rogerio Feris , Alex Bronstein , Raja Giryes , Leonid Karlinsky

Few-Shot Learning is the challenge of training a model with only a small amount of data. Many solutions to this problem use meta-learning algorithms, i.e. algorithms that learn to learn. By sampling few-shot tasks from a larger dataset, we…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Etienne Bennequin

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

In recent years, One-shot Federated Learning methods based on Diffusion Models have garnered increasing attention due to their remarkable performance. However, most of these methods require the deployment of foundation models on client…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mingzhao Yang , Shangchao Su , Bin Li , Xiangyang Xue

Few-shot learning (FSL) aims to generate a classifier using limited labeled examples. Many existing works take the meta-learning approach, constructing a few-shot learner that can learn from few-shot examples to generate a classifier.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Han-Jia Ye , Lu Ming , De-Chuan Zhan , Wei-Lun Chao

While many deep learning methods have seen significant success in tackling the problem of domain adaptation and few-shot learning separately, far fewer methods are able to jointly tackle both problems in Cross-Domain Few-Shot Learning…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 John Cai , Bill Cai , Sheng Mei Shen

Modern successes of diffusion models in learning complex, high-dimensional data distributions are attributed, in part, to their capability to construct diffusion processes with analytic transition kernels and score functions. The…

Machine Learning · Statistics 2024-03-01 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou , Molei Tao

We are interested in developing a unified machine learning model over many mobile devices for practical learning tasks, where each device only has very few training data. This is a commonly encountered situation in mobile computing…

Machine Learning · Computer Science 2021-04-02 Chenyou Fan , Jianwei Huang

Diffusion models (DMs) have achieved state-of-the-art results for image synthesis tasks as well as density estimation. Applied in the latent space of a powerful pretrained autoencoder (LDM), their immense computational requirements can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jeremias Traub

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

The Diffusion Model has not only garnered noteworthy achievements in the realm of image generation but has also demonstrated its potential as an effective pretraining method utilizing unlabeled data. Drawing from the extensive potential…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Muzhi Zhu , Yang Liu , Zekai Luo , Chenchen Jing , Hao Chen , Guangkai Xu , Xinlong Wang , Chunhua Shen

Existing meta-learning based few-shot learning (FSL) methods typically adopt an episodic training strategy whereby each episode contains a meta-task. Across episodes, these tasks are sampled randomly and their relationships are ignored. In…

Machine Learning · Computer Science 2020-09-29 Nanyi Fei , Zhiwu Lu , Yizhao Gao , Jia Tian , Tao Xiang , Ji-Rong Wen