English
Related papers

Related papers: Selecting task with optimal transport self-supervi…

200 papers

Instruction tuning has been proven effective in enhancing zero-shot generalization across various tasks and in improving the performance of specific tasks. For task-specific improvements, strategically selecting and training on related…

Computation and Language · Computer Science 2024-10-18 Changho Lee , Janghoon Han , Seonghyeon Ye , Stanley Jungkyu Choi , Honglak Lee , Kyunghoon Bae

Recent progress in few-shot learning promotes a more realistic cross-domain setting, where the source and target datasets are from different domains. Due to the domain gap and disjoint label spaces between source and target datasets, their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Pan Li , Shaogang Gong , Chengjie Wang , Yanwei Fu

Just like other few-shot learning problems, few-shot segmentation aims to minimize the need for manual annotation, which is particularly costly in segmentation tasks. Even though the few-shot setting reduces this cost for novel test…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mustafa Sercan Amac , Ahmet Sencan , Orhun Bugra Baran , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

In this paper, we propose a new feature selection method for unsupervised domain adaptation based on the emerging optimal transportation theory. We build upon a recent theoretical analysis of optimal transport in domain adaptation and show…

Machine Learning · Computer Science 2018-06-29 Léo Gautheron , Ievgen Redko , Carole Lartizien

We study the question: How can we select the right data for fine-tuning to a specific task? We call this data selection problem active fine-tuning and show that it is an instance of transductive active learning, a novel generalization of…

Machine Learning · Computer Science 2024-06-24 Jonas Hübotter , Bhavya Sukhija , Lenart Treven , Yarden As , Andreas Krause

Few-shot learning has made impressive strides in addressing the crucial challenges of recognizing unknown samples from novel classes in target query sets and managing visual shifts between domains. However, existing techniques fall short…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Debabrata Pal , Deeptej More , Sai Bhargav , Dipesh Tamboli , Vaneet Aggarwal , Biplab Banerjee

We propose TAROT, a targeted data selection framework grounded in optimal transport theory. Previous targeted data selection methods primarily rely on influence-based greedy heuristics to enhance domain-specific performance. While effective…

Machine Learning · Computer Science 2025-07-04 Lan Feng , Fan Nie , Yuejiang Liu , Alexandre Alahi

Optimal transport (OT) is a powerful framework to compare probability measures, a fundamental task in many statistical and machine learning problems. Substantial advances have been made in designing OT variants which are either…

Machine Learning · Computer Science 2025-02-04 Clément Bonet , Kimia Nadjahi , Thibault Séjourné , Kilian Fatras , Nicolas Courty

Optimal transport (OT) is a widely used technique for distribution alignment, with applications throughout the machine learning, graphics, and vision communities. Without any additional structural assumptions on trans-port, however, OT can…

Machine Learning · Computer Science 2021-07-20 Chi-Heng Lin , Mehdi Azabou , Eva L. Dyer

Multitask learning can be effective when features useful in one task are also useful for other tasks, and the group lasso is a standard method for selecting a common subset of features. In this paper, we are interested in a less restrictive…

Machine Learning · Computer Science 2013-11-25 Nikhil Rao , Christopher Cox , Robert Nowak , Timothy Rogers

Most few-shot learning techniques are pre-trained on a large, labeled "base dataset". In problem domains where such large labeled datasets are not available for pre-training (e.g., X-ray, satellite images), one must resort to pre-training…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Cheng Perng Phoo , Bharath Hariharan

Traditional semantic segmentation tasks require a large number of labels and are difficult to identify unlearned categories. Few-shot semantic segmentation (FSS) aims to use limited labeled support images to identify the segmentation of new…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xianglin Wang , Xiaoliu Luo , Taiping Zhang

Few-shot segmentation is a task to segment objects or regions of novel classes within an image given only a few annotated examples. In the generalized setting, the task extends to segment both the base and the novel classes. The main…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Steve Andreas Immanuel , Hagai Raja Sinulingga

The goal of fine-grained few-shot learning is to recognize sub-categories under the same super-category by learning few labeled samples. Most of the recent approaches adopt a single similarity measure, that is, global or local measure…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yan Qi , Han Sun , Ningzhong Liu , Huiyu Zhou

Few-shot learning (FSL) aims to learn novel tasks with very few labeled samples by leveraging experience from \emph{related} training tasks. In this paper, we try to understand FSL by delving into two key questions: (1) How to quantify the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Minyang Hu , Hong Chang , Zong Guo , Bingpeng Ma , Shiguan Shan , Xilin Chen

A particularly successful class of approaches for few-shot learning combines language models with prompts -- hand-crafted task descriptions that complement data samples. However, designing prompts by hand for each task commonly requires…

Computation and Language · Computer Science 2023-10-24 Rami Aly , Xingjian Shi , Kaixiang Lin , Aston Zhang , Andrew Gordon Wilson

Learning accurate classifiers for novel categories from very few examples, known as few-shot image classification, is a challenging task in statistical machine learning and computer vision. The performance in few-shot classification suffers…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Saba Ghaffari , Ehsan Saleh , David Forsyth , Yu-xiong Wang

Reinforcement learning and planning methods require an objective or reward function that encodes the desired behavior. Yet, in practice, there is a wide range of scenarios where an objective is difficult to provide programmatically, such as…

Machine Learning · Computer Science 2018-10-02 Annie Xie , Avi Singh , Sergey Levine , Chelsea Finn

Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available…

Machine Learning · Computer Science 2017-11-15 Eleni Triantafillou , Richard Zemel , Raquel Urtasun

Few-shot learning aims to learn classifiers for new classes with only a few training examples per class. Most existing few-shot learning approaches belong to either metric-based meta-learning or optimization-based meta-learning category,…

Machine Learning · Computer Science 2019-08-28 Duo Wang , Yu Cheng , Mo Yu , Xiaoxiao Guo , Tao Zhang