English
Related papers

Related papers: Selecting task with optimal transport self-supervi…

200 papers

This thesis examines self-attention training through the lens of Optimal Transport (OT) and develops an OT-based alternative for tabular classification. The study tracks intermediate projections of the self-attention layer during training…

Machine Learning · Statistics 2026-02-19 Alessandro Quadrio , Antonio Candelieri

Although vital to computer vision systems, few-shot action recognition is still not mature despite the wide research of few-shot image classification. Popular few-shot learning algorithms extract a transferable embedding from seen classes…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Su Lu , Han-Jia Ye , De-Chuan Zhan

Few-shot learning is a relatively new technique that specializes in problems where we have little amounts of data. The goal of these methods is to classify categories that have not been seen before with just a handful of samples. Recent…

The Self-Optimal-Transport (SOT) feature transform is designed to upgrade the set of features of a data instance to facilitate downstream matching or grouping related tasks. The transformed set encodes a rich representation of high order…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Daniel Shalam , Simon Korman

In few-shot classification, the primary goal is to learn representations from a few samples that generalize well for novel classes. In this paper, we propose an efficient low displacement rank (LDR) regularization strategy termed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Uche Osahor , Nasser M. Nasrabadi

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

Machine Learning · Computer Science 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou

Automated surgical skill assessment (SSA) is a central task in surgical computer vision. Developing robust SSA models is challenging due to the scarcity of skill annotations, which are time-consuming to produce and require expert consensus.…

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Optimal transport (OT) finds a least cost transport plan between two probability distributions using a cost matrix defined on pairs of points. Unlike standard OT, which infers unstructured pointwise mappings, low-rank optimal transport…

Machine Learning · Computer Science 2026-03-05 Henri Schmidt , Peter Halmos , Ben Raphael

Graph few-shot learning has garnered significant attention for its ability to rapidly adapt to downstream tasks with limited labeled data, sparking considerable interest among researchers. Recent advancements in graph few-shot learning…

Machine Learning · Computer Science 2025-01-13 Yonghao Liu , Fausto Giunchiglia , Ximing Li , Lan Huang , Xiaoyue Feng , Renchu Guan

In many practical few-shot learning problems, even though labeled examples are scarce, there are abundant auxiliary datasets that potentially contain useful information. We propose the problem of extended few-shot learning to study these…

Machine Learning · Computer Science 2021-07-06 Reza Esfandiarpoor , Amy Pu , Mohsen Hajabdollahi , Stephen H. Bach

Optimal transport (OT) is a powerful geometric tool for comparing two distributions and has been employed in various machine learning applications. In this work, we propose a novel OT formulation that takes feature correlations into account…

Machine Learning · Computer Science 2021-10-08 Pratik Jawanpuria , N T V Satyadev , Bamdev Mishra

Few-shot text classification has recently been promoted by the meta-learning paradigm which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. Despite their success,…

Computation and Language · Computer Science 2023-05-17 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

While few-shot learning (FSL) aims for rapid generalization to new concepts with little supervision, self-supervised learning (SSL) constructs supervisory signals directly computed from unlabeled data. Exploiting the complementarity of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zhengyu Chen , Jixie Ge , Heshen Zhan , Siteng Huang , Donglin Wang

Shared training approaches, such as multi-task learning (MTL) and gradient-based meta-learning, are widely used in various machine learning applications, but they often suffer from negative transfer, leading to performance degradation in…

Machine Learning · Computer Science 2024-12-10 Anshul Thakur , Yichen Huang , Soheila Molaei , Yujiang Wang , David A. Clifton

Black-box adversarial attacks that minimize only the ground-truth confidence suffer from class drift: perturbations wander through the feature space without committing to a specific adversarial class, wasting queries on diffuse, undirected…

Machine Learning · Computer Science 2026-05-26 Florent Tariolle , Florian Yger

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange

Few-Shot Learning (FSL) is a topic of rapidly growing interest. Typically, in FSL a model is trained on a dataset consisting of many small tasks (meta-tasks) and learns to adapt to novel tasks that it will encounter during test time. This…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Sivan Doveh , Eli Schwartz , Chao Xue , Rogerio Feris , Alex Bronstein , Raja Giryes , Leonid Karlinsky

Few-shot object detection, learning to adapt to the novel classes with a few labeled data, is an imperative and long-lasting problem due to the inherent long-tail distribution of real-world data and the urgent demands to cut costs of data…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Leng Jiaxu , Chen Taiyue , Gao Xinbo , Yu Yongtao , Wang Ye , Gao Feng , Wang Yue