English
Related papers

Related papers: Contrastive Prototype Learning with Augmented Embe…

200 papers

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Tianyu Guo , Hong Liu , Zhan Chen , Mengyuan Liu , Tao Wang , Runwei Ding

Few-shot learning (FSL) is the task of learning to recognize previously unseen categories of images from a small number of training examples. This is a challenging task, as the available examples may not be enough to unambiguously determine…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Kun Yan , Zied Bouraoui , Ping Wang , Shoaib Jameel , Steven Schockaert

Few-shot learning has emerged as a powerful paradigm for training models with limited labeled data, addressing challenges in scenarios where large-scale annotation is impractical. While extensive research has been conducted in the image…

Few-shot class-incremental learning is to recognize the new classes given few samples and not forget the old classes. It is a challenging task since representation optimization and prototype reorganization can only be achieved under little…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Kai Zhu , Yang Cao , Wei Zhai , Jie Cheng , Zheng-Jun Zha

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jianyi Li , Guizhong Liu

Rehearsal-based continual learning (CL) mitigates catastrophic forgetting by maintaining a subset of samples from previous tasks for replay. Existing studies primarily focus on optimizing memory storage through coreset selection strategies.…

Machine Learning · Computer Science 2026-04-13 Minh-Duong Nguyen , Thien-Thanh Dao , Le-Tuan Nguyen , Dung D. Le , Kok-Seng Wong

Text embedding models play a crucial role in natural language processing, particularly in information retrieval, and their importance is further highlighted with the recent utilization of RAG (Retrieval- Augmented Generation). This study…

Information Retrieval · Computer Science 2024-12-24 Jeongsu Yu

Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-02-21 Jiawei Yang , Hanbo Chen , Jiangpeng Yan , Xiaoyu Chen , Jianhua Yao

In machine learning applications, gradual data ingress is common, especially in audio processing where incremental learning is vital for real-time analytics. Few-shot class-incremental learning addresses challenges arising from limited…

Sound · Computer Science 2024-08-08 Riyansha Singh , Parinita Nema , Vinod K Kurmi

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Federated Learning (FL) allows collaborative machine learning training without sharing private data. Numerous studies have shown that one significant factor affecting the performance of federated learning models is the heterogeneity of data…

Machine Learning · Computer Science 2024-09-30 Liang Kuang , Kuangpu Guo , Jian Liang , Jianguo Zhang

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei

The focus of recent meta-learning research has been on the development of learning algorithms that can quickly adapt to test time tasks with limited data and low computational cost. Few-shot learning is widely used as one of the standard…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Yonglong Tian , Yue Wang , Dilip Krishnan , Joshua B. Tenenbaum , Phillip Isola

Transformations in the input space of Deep Neural Networks (DNN) lead to unintended changes in the feature space. Almost perceptually identical inputs, such as adversarial examples, can have significantly distant feature representations. On…

Machine Learning · Computer Science 2022-11-29 Iordanis Fostiropoulos , Laurent Itti

Supervised-contrastive loss (SCL) is an alternative to cross-entropy (CE) for classification tasks that makes use of similarities in the embedding space to allow for richer representations. In this work, we propose methods to engineer the…

Machine Learning · Computer Science 2023-10-03 Jaidev Gill , Vala Vakilian , Christos Thrampoulidis

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

Machine Learning · Computer Science 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

Contrastive learning has achieved remarkable success on various high-level tasks, but there are fewer contrastive learning-based methods proposed for low-level tasks. It is challenging to adopt vanilla contrastive learning technologies…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Gang Wu , Junjun Jiang , Xianming Liu

With the rapid advancements in wireless communication technology, automatic modulation recognition (AMR) plays a critical role in ensuring communication security and reliability. However, numerous challenges, including higher performance…

Machine Learning · Computer Science 2025-02-27 Dongwei Xu , Yutao Zhu , Yao Lu , Youpeng Feng , Yun Lin , Qi Xuan

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami