English
Related papers

Related papers: Patch-Based Contrastive Learning and Memory Consol…

200 papers

Though neural networks have achieved much progress in various applications, it is still highly challenging for them to learn from a continuous stream of tasks without forgetting. Continual learning, a new learning paradigm, aims to solve…

Machine Learning · Computer Science 2019-05-13 Ju Xu , Jin Ma , Zhanxing Zhu

Semi-supervised learning has become increasingly popular in medical image segmentation due to its ability to leverage large amounts of unlabeled data to extract additional information. However, most existing semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shengbo Gao , Ziji Zhang , Jiechao Ma , Zihao Li , Shu Zhang

Graph continual learning (GCL) aims to learn from a continuous sequence of graph-based tasks. Regularization methods are vital for preventing catastrophic forgetting in GCL, particularly in the challenging replay-free, class-incremental…

Machine Learning · Computer Science 2025-09-17 Jie Yin , Ke Sun , Han Wu

Recognizing underwater targets from acoustic signals is a challenging task owing to the intricate ocean environments and variable underwater channels. While deep learning-based systems have become the mainstream approach for underwater…

Sound · Computer Science 2024-02-21 Yuan Xie , Jiawei Ren , Ji Xu

We propose a novel clustering approach for point-cloud segmentation based on supervised contrastive metric learning (CML). Rather than predicting cluster assignments or object-centric variables, the method learns a latent representation in…

High Energy Physics - Experiment · Physics 2026-03-25 Max Marriott-Clarke , Lazar Novakovic , Elizabeth Ratzer , Robert J. Bainbridge , Loukas Gouskos , Benedikt Maier

In this work, we devote ourselves to the challenging task of Unsupervised Multi-view Representation Learning (UMRL), which requires learning a unified feature representation from multiple views in an unsupervised manner. Existing UMRL…

Machine Learning · Computer Science 2023-03-09 Yiyang Zhou , Qinghai Zheng , Shunshun Bai , Jihua Zhu

Contrastive learning has shown impressive success in enhancing feature discriminability for various visual tasks in a self-supervised manner, but the standard contrastive paradigm (features+$\ell_{2}$ normalization) has limited benefits…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junjie Li , Yixin Zhang , Zilei Wang , Saihui Hou , Keyu Tu , Man Zhang

Unsupervised anomalous sound detection aims to detect unknown anomalous sounds by training a model using only normal audio data. Despite advancements in self-supervised methods, the issue of frequent false alarms when handling samples of…

Sound · Computer Science 2025-09-19 Shun Huang , Zhihua Fang , Liang He

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

Clustering is a widely used unsupervised learning technique involving an intensive discrete optimization problem. Associative Memory models or AMs are differentiable neural networks defining a recursive dynamical system, which have been…

Machine Learning · Computer Science 2023-06-07 Bishwajit Saha , Dmitry Krotov , Mohammed J. Zaki , Parikshit Ram

Online continual learning for image classification studies the problem of learning to classify images from an online stream of data and tasks, where tasks may include new classes (class incremental) or data nonstationarity (domain…

Machine Learning · Computer Science 2021-10-06 Zheda Mai , Ruiwen Li , Jihwan Jeong , David Quispe , Hyunwoo Kim , Scott Sanner

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

We introduce Patch Aligned Contrastive Learning (PACL), a modified compatibility function for CLIP's contrastive loss, intending to train an alignment between the patch tokens of the vision encoder and the CLS token of the text encoder.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Jishnu Mukhoti , Tsung-Yu Lin , Omid Poursaeed , Rui Wang , Ashish Shah , Philip H. S. Torr , Ser-Nam Lim

Multiview clustering (MVC) aims to reveal the underlying structure of multiview data by categorizing data samples into clusters. Deep learning-based methods exhibit strong feature learning capabilities on large-scale datasets. For most…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jie Chen , Hua Mao , Wai Lok Woo , Xi Peng

Continual Learning (CL) aims to learn from a non-stationary data stream where the underlying distribution changes over time. While recent advances have produced efficient memory-free methods in the offline CL (offCL) setting, where tasks…

Machine Learning · Computer Science 2025-06-10 Nicolas Michel , Maorong Wang , Jiangpeng He , Toshihiko Yamasaki

In online continual learning, a neural network incrementally learns from a non-i.i.d. data stream. Nearly all online continual learning methods employ experience replay to simultaneously prevent catastrophic forgetting and underfitting on…

Machine Learning · Computer Science 2024-07-22 Jason Yoo , Yunpeng Liu , Frank Wood , Geoff Pleiss

Vision systems mounted on home robots need to interact with unseen classes in changing environments. Robots have limited computational resources, labelled data and storage capability. These requirements pose some unique challenges: models…

Robotics · Computer Science 2023-07-20 Umberto Michieli , Mete Ozay

Online continual learning in the wild is a very difficult task in machine learning. Non-stationarity in online continual learning potentially brings about catastrophic forgetting in neural networks. Specifically, online continual learning…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Muhammad Rifki Kurniawan , Xing Wei , Yihong Gong

Early prediction of severe clinical deterioration and remaining length of stay can enable timely intervention and better resource allocation in high-acuity settings such as the ICU. This has driven the development of machine learning models…

Machine Learning · Computer Science 2026-04-21 Zhongyuan Liang , Junhyung Jo , Hyang-Jung Lee , Sang Kyu Kim , Irene Y. Chen

Recently, graph contrastive learning (GCL) has emerged as one of the optimal solutions for node-level and supervised tasks. However, for structure-related and unsupervised tasks such as graph clustering, current GCL algorithms face…

Social and Information Networks · Computer Science 2025-09-25 Yuecheng Li , Lele Fu , Sheng Huang , Chuan Chen , Lei Yang , Zibin Zheng