English
Related papers

Related papers: Contrastive Continual Learning for Model Adaptabil…

200 papers

Channel equalization is fundamental for mitigating distortions such as frequency-selective fading and inter-symbol interference. Unlike standard supervised learning approaches that require costly retraining or fine-tuning for each new task,…

Machine Learning · Computer Science 2025-10-13 Jiachen Jiang , Zhen Qin , Zhihui Zhu

Online Continual Learning (OCL) is a critical area in machine learning, focusing on enabling models to adapt to evolving data streams in real-time while addressing challenges such as catastrophic forgetting and the stability-plasticity…

Real-world applications of large language models (LLMs) in computational social science (CSS) tasks primarily depend on the effectiveness of instruction tuning (IT) or in-context learning (ICL). While IT has shown highly effective at…

Computation and Language · Computer Science 2024-09-24 Taihang Wang , Xiaoman Xu , Yimin Wang , Ye Jiang

Learning continuously during all model lifetime is fundamental to deploy machine learning solutions robust to drifts in the data distribution. Advances in Continual Learning (CL) with recurrent neural networks could pave the way to a large…

Machine Learning · Computer Science 2021-08-03 Andrea Cossu , Antonio Carta , Vincenzo Lomonaco , Davide Bacciu

Contrastive learning has shown to be effective to learn representations from time series in a self-supervised way. However, contrasting similar time series instances or values from adjacent timestamps within a time series leads to ignore…

Machine Learning · Computer Science 2026-01-15 Seunghan Lee , Taeyoung Park , Kibok Lee

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

Machine Learning · Computer Science 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Unpaired image-to-image translation aims to find a mapping between the source domain and the target domain. To alleviate the problem of the lack of supervised labels for the source images, cycle-consistency based methods have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Yupei Lin , Sen Zhang , Tianshui Chen , Yongyi Lu , Guangping Li , Yukai Shi

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

Recognizing underwater targets from acoustic signals is a challenging task owing to the intricate ocean environments and variable underwater channels. While deep learning-based systems have become the mainstream approach for underwater…

Sound · Computer Science 2024-02-21 Yuan Xie , Jiawei Ren , Ji Xu

With the rapid development of storage and computing power on mobile devices, it becomes critical and popular to deploy models on devices to save onerous communication latencies and to capture real-time features. While quite a lot of works…

Machine Learning · Computer Science 2021-06-18 Jiangchao Yao , Feng Wang , KunYang Jia , Bo Han , Jingren Zhou , Hongxia Yang

The expansion of Internet of Things (IoT) devices has increased the attack surface of networks, necessitating a robust and adaptive intrusion detection systems. Machine learning based systems have been considered promising in enhancing the…

Cryptography and Security · Computer Science 2026-03-13 Muaan Ur Rehman , Hayretdin Bahsi , Rajesh Kalakoti

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

Machine Learning · Computer Science 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

Users' interactions with items are driven by various intents (e.g., preparing for holiday gifts, shopping for fishing equipment, etc.).However, users' underlying intents are often unobserved/latent, making it challenging to leverage such…

Artificial Intelligence · Computer Science 2022-02-08 Yongjun Chen , Zhiwei Liu , Jia Li , Julian McAuley , Caiming Xiong

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Internet of Things (IoT) sensors in smart buildings are becoming increasingly ubiquitous, making buildings more livable, energy efficient, and sustainable. These devices sense the environment and generate multivariate temporal data of…

Machine Learning · Computer Science 2021-06-25 Raed Abdel Sater , A. Ben Hamza

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Bin Xiao , Ce Liu , Lu Yuan , Jianfeng Gao

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Information between different augmented views of the same instance.…

Information Retrieval · Computer Science 2024-01-01 Huiyuan Chen , Vivian Lai , Hongye Jin , Zhimeng Jiang , Mahashweta Das , Xia Hu

Federated Continual Learning (FCL) aims to enable sequentially privacy-preserving model training on streams of incoming data that vary in edge devices by preserving previous knowledge while adapting to new data. Current FCL literature…

Machine Learning · Computer Science 2025-10-15 Yichen Li , Yuying Wang , Jiahua Dong , Haozhao Wang , Yining Qi , Rui Zhang , Ruixuan Li