中文
相关论文

相关论文: DRESS: Disentangled Representation-based Self-Supe…

200 篇论文

Meta-learning provides a promising way for learning to efficiently learn and achieves great success in many applications. However, most meta-learning literature focuses on dealing with tasks from a same domain, making it brittle to…

机器学习 · 计算机科学 2021-07-26 Pinzhuo Tian , Yao Gao

Meta-learning is a general approach to equip machine learning models with the ability to handle few-shot scenarios when dealing with many tasks. Most existing meta-learning methods work based on the assumption that all tasks are of equal…

机器学习 · 计算机科学 2024-10-25 Zhaofeng Si , Shu Hu , Kaiyi Ji , Siwei Lyu

Unsupervised meta-learning aims to learn feature representations from unsupervised datasets that can transfer to downstream tasks with limited labeled data. In this paper, we propose a novel approach to unsupervised meta-learning that…

机器学习 · 计算机科学 2025-02-11 Anna Vettoruzzo , Lorenzo Braccaioli , Joaquin Vanschoren , Marlena Nowaczyk

Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduction in few-shot…

机器学习 · 计算机科学 2020-06-23 Carlos Medina , Arnout Devos , Matthias Grossglauser

Meta-learning algorithms adapt quickly to new tasks that are drawn from the same task distribution as the training tasks. The mechanism leading to fast adaptation is the conditioning of a downstream predictive model on the inferred…

Learning the generalizable feature representation is critical for few-shot image classification. While recent works exploited task-specific feature embedding using meta-tasks for few-shot learning, they are limited in many challenging tasks…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Hao Cheng , Yufei Wang , Haoliang Li , Alex C. Kot , Bihan Wen

Few-shot learning remains challenging for meta-learning that learns a learning algorithm (meta-learner) from many related tasks. In this work, we argue that this is due to the lack of a good representation for meta-learning, and propose…

机器学习 · 计算机科学 2018-02-13 Fengwei Zhou , Bin Wu , Zhenguo Li

Test-time task adaptation in few-shot learning aims to adapt a pre-trained task-agnostic model for capturing taskspecific knowledge of the test task, rely only on few-labeled support samples. Previous approaches generally focus on…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Ji Zhang , Lianli Gao , Xu Luo , Hengtao Shen , Jingkuan Song

The focus of recent meta-learning research has been on the development of learning algorithms that can quickly adapt to test time tasks with limited data and low computational cost. Few-shot learning is widely used as one of the standard…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Yonglong Tian , Yue Wang , Dilip Krishnan , Joshua B. Tenenbaum , Phillip Isola

Vision transformers combined with self-supervised learning have enabled the development of models which scale across large datasets for several downstream tasks like classification, segmentation and detection. The low-shot learning…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Srinivasa Rao Nandam , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

Few-shot text classification has recently been promoted by the meta-learning paradigm which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. Despite their success,…

计算与语言 · 计算机科学 2023-05-17 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

In modern supervised learning, there are a large number of tasks, but many of them are associated with only a small amount of labeled data. These include data from medical image processing and robotic interaction. Even though each…

机器学习 · 计算机科学 2020-02-21 Weihao Kong , Raghav Somani , Zhao Song , Sham Kakade , Sewoong Oh

Intelligent perception and interaction with the world hinges on internal representations that capture its underlying structure (''disentangled'' or ''abstract'' representations). Disentangled representations serve as world models, isolating…

机器学习 · 计算机科学 2025-03-04 Pantelis Vafidis , Aman Bhargava , Antonio Rangel

Meta-learning aims at learning quickly on novel tasks with limited data by transferring generic experience learned from previous tasks. Naturally, few-shot learning has been one of the most popular applications for meta-learning. However,…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Yudong Chen , Chaoyu Guan , Zhikun Wei , Xin Wang , Wenwu Zhu

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

机器学习 · 计算机科学 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

A mainstream type of current self-supervised learning methods pursues a general-purpose representation that can be well transferred to downstream tasks, typically by optimizing on a given pretext task such as instance discrimination. In…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Xin Liu , Zhongdao Wang , Yali Li , Shengjin Wang

An effective approach in meta-learning is to utilize multiple "train tasks" to learn a good initialization for model parameters that can help solve unseen "test tasks" with very few samples by fine-tuning from this initialization. Although…

机器学习 · 计算机科学 2021-06-30 Nikunj Saunshi , Arushi Gupta , Wei Hu

Deep-embedding methods aim to discover representations of a domain that make explicit the domain's class structure and thereby support few-shot learning. Disentangling methods aim to make explicit compositional or factorial structure. We…

机器学习 · 计算机科学 2018-05-22 Karl Ridgeway , Michael C. Mozer

Representation learning based on multi-task pretraining has become a powerful approach in many domains. In particular, task-aware representation learning aims to learn an optimal representation for a specific target task by sampling data…

机器学习 · 计算机科学 2023-06-16 Yifang Chen , Yingbing Huang , Simon S. Du , Kevin Jamieson , Guanya Shi

Few-shot classification and meta-learning methods typically struggle to generalize across diverse domains, as most approaches focus on a single dataset, failing to transfer knowledge across various seen and unseen domains. Existing…

机器学习 · 计算机科学 2025-10-07 Kristi Topollai , Anna Choromanska