English
Related papers

Related papers: MalCL: Leveraging GAN-Based Generative Replay to C…

200 papers

Generative Adversarial networks (GANs) have obtained remarkable success in many unsupervised learning tasks and unarguably, clustering is an important unsupervised learning problem. While one can potentially exploit the latent-space…

Machine Learning · Computer Science 2019-01-29 Sudipto Mukherjee , Himanshu Asnani , Eugene Lin , Sreeram Kannan

Learning multiple tasks sequentially without forgetting previous knowledge, called Continual Learning(CL), remains a long-standing challenge for neural networks. Most existing methods rely on additional network capacity or data replay. In…

Machine Learning · Computer Science 2022-02-01 Hao Liu , Huaping Liu

Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge transfer (KT) across tasks. However, most existing techniques…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Nianzu Ma , Hu Xu , Lei Shu

It is known that the inconsistent distribution and representation of different modalities, such as image and text, cause the heterogeneity gap that makes it challenging to correlate such heterogeneous data. Generative adversarial networks…

Multimedia · Computer Science 2018-04-27 Yuxin Peng , Jinwei Qi , Yuxin Yuan

Class-Incremental Learning aims to update a deep classifier to learn new categories while maintaining or improving its accuracy on previously observed classes. Common methods to prevent forgetting previously learned classes include…

Machine Learning · Computer Science 2024-07-02 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Mert Kilickaya , Joaquin Vanschoren

Continual Learning (CL) aims to incrementally update a trained model on new tasks without forgetting the acquired knowledge of old ones. Existing CL methods usually reduce forgetting with task priors, \ie using task identity or a subset of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Tao Zhuo , Zhiyong Cheng , Hehe Fan , Mohan Kankanhalli

Generative retrieval (GR) directly predicts the identifiers of relevant documents (i.e., docids) based on a parametric model. It has achieved solid performance on many ad-hoc retrieval tasks. So far, these tasks have assumed a static…

Information Retrieval · Computer Science 2025-09-30 Jiangui Chen , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Wei Chen , Yixing Fan , Xueqi Cheng

Whole slide image (WSI) classification has emerged as a powerful tool in computational pathology, but remains constrained by domain shifts, e.g., due to different organs, diseases, or institution-specific variations. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Pratibha Kumari , Daniel Reisenbüchler , Afshin Bozorgpour , Nadine S. Schaadt , Friedrich Feuerhake , Dorit Merhof

In an era of escalating cyber threats, malware poses significant risks to individuals and organizations, potentially leading to data breaches, system failures, and substantial financial losses. This study addresses the urgent need for…

Cryptography and Security · Computer Science 2025-01-28 Marzieh Esnaashari , Nima Moradi

Neural networks can achieve excellent results in a wide variety of applications. However, when they attempt to sequentially learn, they tend to learn the new task while catastrophically forgetting previous ones. We propose a model that…

Machine Learning · Computer Science 2020-12-18 Craig Atkinson , Brendan McCane , Lech Szymanski , Anthony Robins

In unsupervised data generation tasks, besides the generation of a sample based on previous observations, one would often like to give hints to the model in order to bias the generation towards desirable metrics. We propose a method that…

Despite the great success of pre-trained language models, it is still a challenge to use these models for continual learning, especially for the class-incremental learning (CIL) setting due to catastrophic forgetting (CF). This paper…

Computation and Language · Computer Science 2023-07-21 Yijia Shao , Yiduo Guo , Dongyan Zhao , Bing Liu

Malware detectors based on machine learning are vulnerable to adversarial attacks. Generative Adversarial Networks (GAN) are architectures based on Neural Networks that could produce successful adversarial samples. The interest towards this…

Cryptography and Security · Computer Science 2021-09-29 Renjith G , Sonia Laudanna , Aji S , Corrado Aaron Visaggio , Vinod P

Catastrophic forgetting of previous knowledge is a critical issue in continual learning typically handled through various regularization strategies. However, existing methods struggle especially when several incremental steps are performed.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Chang Liu , Giulia Rizzoli , Francesco Barbato , Andrea Maracani , Marco Toldo , Umberto Michieli , Yi Niu , Pietro Zanuttigh

Continual learning (CL) enables animals to learn new tasks without erasing prior knowledge. CL in artificial neural networks (NNs) is challenging due to catastrophic forgetting, where new learning degrades performance on older tasks. While…

Machine Learning · Computer Science 2025-01-28 Haozhe Shan , Qianyi Li , Haim Sompolinsky

Continual (or "incremental") learning approaches are employed when additional knowledge or tasks need to be learned from subsequent batches or from streaming data. However these approaches are typically adversary agnostic, i.e., they do not…

Machine Learning · Computer Science 2021-02-17 Muhammad Umer , Robi Polikar

Generalized Category Discovery (GCD) is an emerging and challenging open-world problem that has garnered increasing attention in recent years. Most existing GCD methods focus on discovering categories in static images. However, relying…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zhang Jing , Pu Nan , Xie Yu Xiang , Guo Yanming , Lu Qianqi , Zou Shiwei , Yan Jie , Chen Yan

The intrinsic capability to continuously learn a changing data stream is a desideratum of deep neural networks (DNNs). However, current DNNs suffer from catastrophic forgetting, which interferes with remembering past knowledge. To mitigate…

Machine Learning · Computer Science 2026-02-03 Nghia D. Nguyen , Hieu Trung Nguyen , Ang Li , Hoang Pham , Viet Anh Nguyen , Khoa D. Doan

User modeling in large e-commerce platforms aims to optimize user experiences by incorporating various customer activities. Traditional models targeting a single task often focus on specific business metrics, neglecting the comprehensive…

Information Retrieval · Computer Science 2025-02-28 Mingdai Yang , Fan Yang , Yanhui Guo , Shaoyuan Xu , Tianchen Zhou , Yetian Chen , Simone Shao , Jia Liu , Yan Gao

Continual learning seeks to enable machine learning systems to solve an increasing corpus of tasks sequentially. A critical challenge for continual learning is forgetting, where the performance on previously learned tasks decreases as new…

Machine Learning · Computer Science 2025-06-06 Yasaman Mahdaviyeh , James Lucas , Mengye Ren , Andreas S. Tolias , Richard Zemel , Toniann Pitassi