English
Related papers

Related papers: Continual Learning: Forget-free Winning Subnetwork…

200 papers

Few-shot class-incremental learning (FSCIL) is a paradigm where a model, initially trained on a dataset of base classes, must adapt to an expanding problem space by recognizing novel classes with limited data. We focus on the challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jack Foster , Kirill Paramonov , Mete Ozay , Umberto Michieli

Over-parameterized neural networks incur prohibitive memory and computational costs for resource-constrained deployment. The Strong Lottery Ticket (SLT) hypothesis suggests that randomly initialized networks contain sparse subnetworks…

Machine Learning · Computer Science 2026-03-11 Itamar Tsayag , Ofir Lindenbaum

Class-Incremental Learning (CIL) aims to prevent catastrophic forgetting of previously learned classes while sequentially incorporating new ones. The more challenging Few-shot CIL (FSCIL) setting further complicates this by providing only a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhiwu Wang , Yichen Wu , Renzhen Wang , Haokun Lin , Quanziang Wang , Qian Zhao , Deyu Meng

Few-shot class incremental learning (FSCIL) portrays the problem of learning new concepts gradually, where only a few examples per concept are available to the learner. Due to the limited number of examples for training, the techniques…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Ali Cheraghian , Shafin Rahman , Pengfei Fang , Soumava Kumar Roy , Lars Petersson , Mehrtash Harandi

Few-Shot Class-Incremental Learning (FSCIL) faces a critical challenge: balancing the retention of prior knowledge with the acquisition of new classes. Existing methods either freeze the backbone to prevent catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Xiaojie Li , Jianlong Wu , Yue Yu , Liqiang Nie , Min Zhang

We explore the use of FCNNs (Fully Connected Neural Networks) for designing end-to-end communication systems without taking any inspiration from existing classical communications models or error control coding. This work relies solely on…

Machine Learning · Computer Science 2024-09-10 Sudharsan Senthil , Shubham Paul , Nambi Seshadri , R. David Koilpillai

Deep reinforcement learning (RL) agents that exist in high-dimensional state spaces, such as those composed of images, have interconnected learning burdens. Agents must learn an action-selection policy that completes their given task, which…

Machine Learning · Computer Science 2021-10-12 Trevor McInroe , Lukas Schäfer , Stefano V. Albrecht

Fluid antenna systems (FAS) signify a pivotal advancement in 6G communication by enhancing spectral efficiency and robustness. However, obtaining accurate channel state information (CSI) in FAS poses challenges due to its complex physical…

Signal Processing · Electrical Eng. & Systems 2026-02-02 Yuan Gao , Yiming Liu , Runze Yu , Shengli Liu , Yanliang Jin , Shunqing Zhang , Shugong Xu , Xiaoli Chu

Few-shot class-incremental learning (FSCIL) is proposed to continually learn from novel classes with only a few samples after the (pre-)training on base classes with sufficient data. However, this remains a challenge. In contrast, humans…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yixiong Zou , Shanghang Zhang , Haichen Zhou , Yuhua Li , Ruixuan Li

Semantic segmentation is a pixel-level prediction task to classify each pixel of the input image. Deep learning models, such as convolutional neural networks (CNNs), have been extremely successful in achieving excellent performances in this…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Nadeem Atif , Saquib Mazhar , Debajit Sarma , M. K. Bhuyan , Shaik Rafi Ahamed

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Melani Sanchez-Garcia , Tushar Chauhan , Benoit R. Cottereau , Michael Beyeler

Fourier Neural Operators (FNOs) excel on tasks using functional data, such as those originating from partial differential equations. Such characteristics render them an effective approach for simulating the time evolution of quantum…

Recently, deep learning based video super-resolution (SR) methods have achieved promising performance. To simultaneously exploit the spatial and temporal information of videos, employing 3-dimensional (3D) convolutions is a natural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Sheng Li , Fengxiang He , Bo Du , Lefei Zhang , Yonghao Xu , Dacheng Tao

Few-shot class-incremental Learning (FSCIL) enables models to learn new classes from limited data while retaining performance on previously learned classes. Traditional FSCIL methods often require fine-tuning parameters with limited new…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Jizhou Han , Chenhao Ding , Yuhang He , Songlin Dong , Qiang Wang , Xinyuan Gao , Yihong Gong

This paper introduces an incremental training framework for compressing popular Deep Neural Network (DNN) based unfolded multiple-input-multiple-output (MIMO) detection algorithms like DetNet. The idea of incremental training is explored to…

Information Theory · Computer Science 2021-04-19 Nancy Nayak , Thulasi Tholeti , Muralikrishnan Srinivasan , Sheetal Kalyani

Continual learning on edge devices poses unique challenges due to stringent resource constraints. This paper introduces a novel method that leverages stochastic competition principles to promote sparsity, significantly reducing deep network…

Machine Learning · Computer Science 2024-07-16 Theodoros Christophides , Kyriakos Tolias , Sotirios Chatzis

Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well known in contrast to Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes and classes growing…

Machine Learning · Computer Science 2024-11-12 Yayong Li , Peyman Moghadam , Can Peng , Nan Ye , Piotr Koniusz

Continual offline reinforcement learning (CORL) aims to learn a sequence of tasks from datasets collected over time while preserving performance on previously learned tasks. This setting corresponds to domains where new tasks arise over…

Machine Learning · Computer Science 2026-04-29 Dominik Żurek , Kamil Faber , Marcin Pietron , Paweł Gajewski , Roberto Corizzo

Wireless signal recognition (WSR) is crucial in modern and future wireless communication networks since it aims to identify the properties of the received signal in a no-collaborative manner. However, it is challenging to accurately…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Hao Zhang , Fuhui Zhou , Qihui Wu , Chau Yuen

Convolution neural networks (CNNs) have achieved remarkable success, but typically accompany high computation cost and numerous redundant weight parameters. To reduce the FLOPs, structure pruning is a popular approach to remove the entire…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Bo Ji , Tianyi Chen