English
Related papers

Related papers: CIL: Contrastive Instance Learning Framework for D…

200 papers

Multiple instance learning (MIL) significantly reduced annotation costs via bag-level weak labels for large-scale images, such as histopathological whole slide images (WSIs). However, its adaptability to continual tasks with minimal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Byung Hyun Lee , Wongi Jeong , Woojae Han , Kyoungbun Lee , Se Young Chun

The dynamic environment of laboratories and clinics, with streams of data arriving on a daily basis, requires regular updates of trained machine learning models for consistent performance. Continual learning is supposed to help train models…

Machine Learning · Computer Science 2025-08-12 Zahra Ebrahimi , Raheleh Salehi , Nassir Navab , Carsten Marr , Ario Sadafi

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Lexical difficulty prediction is a fundamental problem in language learning and readability assessment, requiring models to estimate word difficulty across different first-language (L1) backgrounds. However, existing approaches rely on…

Computation and Language · Computer Science 2026-05-12 Wicaksono Leksono Muhamad , Joanito Agili Lopo , Tsamarah Rana Nugraha , Ahmad Cahyono Adi , Muhammad Oriza Nurfajri

Adversarial Imitation Learning (AIL) allows the agent to reproduce expert behavior with low-dimensional states and actions. However, challenges arise in handling visual states due to their less distinguishable representation compared to…

Machine Learning · Computer Science 2024-01-23 Yunke Wang , Linwei Tao , Bo Du , Yutian Lin , Chang Xu

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

Representation learning has been evolving from traditional supervised training to Contrastive Learning (CL) and Masked Image Modeling (MIM). Previous works have demonstrated their pros and cons in specific scenarios, i.e., CL and supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Bowen Shi , Xiaopeng Zhang , Yaoming Wang , Jin Li , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

Machine Learning · Computer Science 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

Machine Learning · Computer Science 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

The long-tailed image classification task remains important in the development of deep neural networks as it explicitly deals with large imbalances in the class frequencies of the training data. While uncommon in engineered datasets, this…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Marc-Antoine Lavoie , Steven Waslander

We propose a new formulation of Multiple-Instance Learning (MIL), in which a unit of data consists of a set of instances called a bag. The goal is to find a good classifier of bags based on the similarity with a "shapelet" (or pattern),…

Machine Learning · Computer Science 2020-10-14 Daiki Suehiro , Kohei Hatano , Eiji Takimoto , Shuji Yamamoto , Kenichi Bannai , Akiko Takeda

We propose a novel framework to classify large-scale time series data with long duration. Long time seriesclassification (L-TSC) is a challenging problem because the dataoften contains a large amount of irrelevant information to…

Artificial Intelligence · Computer Science 2021-11-23 Yuansheng Zhu , Weishi Shi , Deep Shankar Pandey , Yang Liu , Xiaofan Que , Daniel E. Krutz , Qi Yu

Class Incremental Learning (CIL) requires models to continuously learn new classes without forgetting previously learned ones, while maintaining stable performance across all possible class sequences. In real-world settings, the order in…

Machine Learning · Computer Science 2026-03-05 Guannan Lai , Da-Wei Zhou , Xin Yang , Han-Jia Ye

Recently, information retrieval has seen the emergence of dense retrievers, using neural networks, as an alternative to classical sparse methods based on term-frequency. These models have obtained state-of-the-art results on datasets and…

Information Retrieval · Computer Science 2022-08-30 Gautier Izacard , Mathilde Caron , Lucas Hosseini , Sebastian Riedel , Piotr Bojanowski , Armand Joulin , Edouard Grave

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Person re-identification (ReID) aims at searching the same identity person among images captured by various cameras. Unsupervised person ReID attracts a lot of attention recently, due to it works without intensive manual annotation and thus…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Bo Pang , Deming Zhai , Junjun Jiang , Xianming Liu

Understanding surgical scenes can provide better healthcare quality for patients, especially with the vast amount of video data that is generated during MIS. Processing these videos generates valuable assets for training sophisticated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Fatmaelzahraa Ali Ahmed , Muhammad Arsalan , Abdulaziz Al-Ali , Khalid Al-Jalham , Shidin Balakrishnan

Class-incremental learning (CIL) enables models to learn new classes progressively while preserving knowledge of previously learned ones. Recent advances in this field have shifted towards parameter-efficient fine-tuning techniques, with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Haoran Chen , Ping Wang , Zihan Zhou , Xu Zhang , Zuxuan Wu , Yu-Gang Jiang

Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In order to alleviate this critical problem…

Information Retrieval · Computer Science 2022-10-11 Chengwei Hu , Deqing Yang , Haoliang Jin , Zhen Chen , Yanghua Xiao

Class incremental learning (CIL) aims to recognize both the old and new classes along the increment tasks. Deep neural networks in CIL suffer from catastrophic forgetting and some approaches rely on saving exemplars from previous tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiuwei Chen , Xiaobin Chang