English
Related papers

Related papers: Continual Learning: Forget-free Winning Subnetwork…

200 papers

Few-shot class-incremental learning (FSCIL) aims to learn progressively about new classes with very few labeled samples, without forgetting the knowledge of already learnt classes. FSCIL suffers from two major challenges: (i) over-fitting…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jayateja Kalla , Soma Biswas

Modern deep learning models operating on multi-modal visual signals often rely on inductive biases that are poorly aligned with the physical processes governing signal formation, leading to brittle performance under cross-spectral and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Georgios Voulgaris

Few-Shot Semantic Segmentation (FSS), which focuses on segmenting new classes in images using only a limited number of annotated examples, has recently progressed in data-scarce domains. However, in this work, we show that the existing FSS…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Zhuohao Li , Zhicheng Huang , Wenchao Liu , Zhuxin Zhang , Jianming Miao

Surface-from-gradients (SfG) aims to recover a three-dimensional (3D) surface from its gradients. Traditional methods encounter significant challenges in achieving high accuracy and handling high-resolution inputs, particularly facing the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Jiaqi Leng , Yakun Ju , Yuanxu Duan , Jiangnan Zhang , Qingxuan Lv , Zuxuan Wu , Hao Fan

Implicit Neural Networks (INRs) have emerged as powerful representations to encode all forms of data, including images, videos, audios, and scenes. With video, many INRs for video have been proposed for the compression task, and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shishira R Maiya , Anubhav Gupta , Matthew Gwilliam , Max Ehrlich , Abhinav Shrivastava

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

The Recurrent Neural Network-Transducer (RNN-T) is widely adopted in end-to-end (E2E) automatic speech recognition (ASR) tasks but depends heavily on large-scale, high-quality annotated data, which are often costly and difficult to obtain.…

Computation and Language · Computer Science 2025-11-07 Dongji Gao , Chenda Liao , Changliang Liu , Matthew Wiesner , Leibny Paola Garcia , Daniel Povey , Sanjeev Khudanpur , Jian Wu

While semi-supervised learning (SSL) has yielded promising results, the more realistic SSL scenario remains to be explored, in which the unlabeled data exhibits extremely high recognition difficulty, e.g., fine-grained visual classification…

Machine Learning · Computer Science 2023-12-20 Yue Duan , Zhen Zhao , Lei Qi , Luping Zhou , Lei Wang , Yinghuan Shi

Weakly supervised salient object detection (WSOD) targets to train a CNNs-based saliency network using only low-cost annotations. Existing WSOD methods take various techniques to pursue single "high-quality" pseudo label from low-cost…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Yongri Piao , Jian Wang , Miao Zhang , Huchuan Lu

Learning maps between function spaces with a strong inductive bias is a central challenge in soft computing, especially when training data are scarce and standard deep architectures overfit. We introduce a \emph{neural integral operator}…

Machine Learning · Computer Science 2026-05-26 Emanuele Zappala , Alice Giola , Andreas Kramer , Saugat Acharya , Enrico Greco

Advances in lightweight neural networks have revolutionized computer vision in a broad range of IoT applications, encompassing remote monitoring and process automation. However, the detection of small objects, which is crucial for many of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Liam Boyle , Nicolas Baumann , Seonyeong Heo , Michele Magno

Federated Class-Incremental Learning (FCIL) enables Class-Incremental Learning (CIL) from distributed data. Existing FCIL methods typically integrate old knowledge preservation into local client training. However, these methods cannot avoid…

Machine Learning · Computer Science 2026-01-27 Zenghao Guan , Guojun Zhu , Yucan Zhou , Wu Liu , Weiping Wang , Jiebo Luo , Xiaoyan Gu

Few-shot class-incremental learning (FSCIL) aims to mitigate the catastrophic forgetting issue when a model is incrementally trained on limited data. However, many of these works lack effective exploration of prior knowledge, rendering them…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Wan Xu , Tianyu Huang , Tianyu Qu , Guanglei Yang , Yiwen Guo , Wangmeng Zuo

Networks of spiking neurons and Winner-Take-All spiking circuits (WTA-SNNs) can detect information encoded in spatio-temporal multi-valued events. These are described by the timing of events of interest, e.g., clicks, as well as by…

Machine Learning · Computer Science 2020-04-21 Hyeryung Jang , Nicolas Skatchkovsky , Osvaldo Simeone

The recent advancements in deep learning have allowed for numerous applications in computed tomography (CT), with potential to improve diagnostic accuracy, speed of interpretation, and clinical efficiency. However, the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Hyunkwang Lee , Myeongchan Kim , Synho Do

Large-scale pre-training has recently revolutionized vision-and-language (VL) research. Models such as LXMERT and UNITER have significantly lifted the state of the art over a wide range of VL tasks. However, the large number of parameters…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Zhe Gan , Yen-Chun Chen , Linjie Li , Tianlong Chen , Yu Cheng , Shuohang Wang , Jingjing Liu , Lijuan Wang , Zicheng Liu

Weight Space Learning (WSL), which frames neural network weights as a data modality, is an emerging field with potential for tasks like meta-learning or transfer learning. Particularly, Implicit Neural Representations (INRs) provide a…

Machine Learning · Computer Science 2026-02-02 Tianming Qiu , Christos Sonis , Hao Shen

While many FSCIL studies have been undertaken, achieving satisfactory performance, especially during incremental sessions, has remained challenging. One prominent challenge is that the encoder, trained with an ample base session training…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 In-Ug Yoon , Tae-Min Choi , Sun-Kyung Lee , Young-Min Kim , Jong-Hwan Kim

In this paper, we introduce a Deep Neural Network (DNN) to maximize the Proportional Fairness (PF) of the Spectral Efficiency (SE) of uplinks in Cell-Free (CF) massive Multiple-Input Multiple-Output (MIMO) systems. The problem of maximizing…

Information Theory · Computer Science 2021-10-12 Le Ty Khanh , Pham Quoc Viet , Ha Hoang Kha , Nguyen Minh Hoang

Children possess the ability to learn multiple cognitive tasks sequentially, which is a major challenge toward the long-term goal of artificial general intelligence. Existing continual learning frameworks are usually applicable to Deep…

Artificial Intelligence · Computer Science 2023-08-10 Bing Han , Feifei Zhao , Yi Zeng , Wenxuan Pan , Guobin Shen