English
Related papers

Related papers: Diversity Helps: Unsupervised Few-shot Learning vi…

200 papers

Prior work on language models (LMs) shows that training on a large number of diverse tasks improves few-shot learning (FSL) performance on new tasks. We take this to the extreme, automatically extracting 413,299 tasks from internet tables -…

Computation and Language · Computer Science 2022-08-09 Jun Shern Chan , Michael Pieler , Jonathan Jao , Jérémy Scheurer , Ethan Perez

Unsupervised representation learning approaches aim to learn discriminative feature representations from unlabeled data, without the requirement of annotating every sample. Enabling unsupervised representation learning is extremely crucial…

Machine Learning · Computer Science 2023-08-04 Qianwen Meng , Hangwei Qian , Yong Liu , Yonghui Xu , Zhiqi Shen , Lizhen Cui

For video models to be transferred and applied seamlessly across video tasks in varied environments, Video Unsupervised Domain Adaptation (VUDA) has been introduced to improve the robustness and transferability of video models. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuecong Xu , Jianfei Yang , Yunjiao Zhou , Zhenghua Chen , Min Wu , Xiaoli Li

Both few-shot learning and domain adaptation sub-fields in Computer Vision have seen significant recent progress in terms of the availability of state-of-the-art algorithms and datasets. Frameworks have been developed for each sub-field;…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Bharadwaj Ravichandran , Alexander Lynch , Sarah Brockman , Brandon RichardWebster , Dawei Du , Anthony Hoogs , Christopher Funk

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Breakthroughs in unsupervised domain adaptation (uDA) can help in adapting models from a label-rich source domain to unlabeled target domains. Despite these advancements, there is a lack of research on how uDA algorithms, particularly those…

Machine Learning · Computer Science 2021-12-28 Shaoduo Gan , Akhil Mathur , Anton Isopoussu , Fahim Kawsar , Nadia Berthouze , Nicholas Lane

Unsupervised image-to-image translation methods have received a lot of attention in the last few years. Multiple techniques emerged tackling the initial challenge from different perspectives. Some focus on learning as much as possible from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Luca Barras , Samuel Chassot , Daniel Filipe Nunes Silva

Unsupervised domain adaption (UDA) is a transfer learning task where the data and annotations of the source domain are available but only have access to the unlabeled target data during training. Most previous methods try to minimise the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Xinyao Shu , Shiyang Yan , Zhenyu Lu , Xinshao Wang , Yuan Xie

Existing few-shot learning (FSL) methods rely on training with a large labeled dataset, which prevents them from leveraging abundant unlabeled data. From an information-theoretic perspective, we propose an effective unsupervised FSL method,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Yuning Lu , Liangjian Wen , Jianzhuang Liu , Yajing Liu , Xinmei Tian

Unsupervised Domain Adaptation (UDA) is a popular technique that aims to reduce the domain shift between two data distributions. It was successfully applied in computer vision and natural language processing. In the current work, we explore…

Computation and Language · Computer Science 2023-08-07 Răzvan-Alexandru Smădu , Sebastian-Vasile Echim , Dumitru-Clementin Cercel , Iuliana Marin , Florin Pop

The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light of this, most…

Machine Learning · Computer Science 2021-04-06 Bo Li , Yezhen Wang , Shanghang Zhang , Dongsheng Li , Trevor Darrell , Kurt Keutzer , Han Zhao

Time series forecasting, particularly in few-shot learning scenarios, is challenging due to the limited availability of high-quality training data. To address this, we present a pilot study on using reinforcement learning (RL) for time…

Machine Learning · Computer Science 2025-05-23 Haochen Yuan , Yutong Wang , Yihong Chen , Yunbo Wang , Xiaokang Yang

Machine learning algorithms typically assume that training and test examples are drawn from the same distribution. However, distribution shift is a common problem in real-world applications and can cause models to perform dramatically worse…

Machine Learning · Computer Science 2022-06-22 Huaxiu Yao , Yu Wang , Sai Li , Linjun Zhang , Weixin Liang , James Zou , Chelsea Finn

Few-shot dataset generalization is a challenging variant of the well-studied few-shot classification problem where a diverse training set of several datasets is given, for the purpose of training an adaptable model that can then learn…

Machine Learning · Computer Science 2021-06-22 Eleni Triantafillou , Hugo Larochelle , Richard Zemel , Vincent Dumoulin

This paper presents a classification framework based on learnable data augmentation to tackle the One-Shot Unsupervised Domain Adaptation (OS-UDA) problem. OS-UDA is the most challenging setting in Domain Adaptation, as only one single…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Julio Ivan Davila Carrazco , Pietro Morerio , Alessio Del Bue , Vittorio Murino

Cross-lingual representation learning transfers knowledge from resource-rich data to resource-scarce ones to improve the semantic understanding abilities of different languages. However, previous works rely on shallow unsupervised data…

Computation and Language · Computer Science 2024-06-25 Dongyang Li , Taolin Zhang , Jiali Deng , Longtao Huang , Chengyu Wang , Xiaofeng He , Hui Xue

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

Few shot learning is an important problem in machine learning as large labelled datasets take considerable time and effort to assemble. Most few-shot learning algorithms suffer from one of two limitations- they either require the design of…

Machine Learning · Computer Science 2022-04-12 Shakti Kumar , Hussain Zaidi

Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry. Their data curation poses the challenges of expensive human labeling, inadequate computing resources and larger experiment turn around…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Vishal Kaushal , Rishabh Iyer , Suraj Kothawade , Rohan Mahadev , Khoshrav Doctor , Ganesh Ramakrishnan

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio