English
Related papers

Related papers: MGSER-SAM: Memory-Guided Soft Experience Replay wi…

200 papers

The challenge of overfitting, in which the model memorizes the training data and fails to generalize to test data, has become increasingly significant in the training of large neural networks. To tackle this challenge, Sharpness-Aware…

Machine Learning · Computer Science 2023-10-12 Zixiang Chen , Junkai Zhang , Yiwen Kou , Xiangning Chen , Cho-Jui Hsieh , Quanquan Gu

Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data…

Machine Learning · Computer Science 2023-03-08 Stella Ho , Ming Liu , Lan Du , Longxiang Gao , Yong Xiang

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

It is commonly believed that gradient compression in federated learning (FL) enjoys significant improvement in communication efficiency with negligible performance degradation. In this paper, we find that gradient compression induces…

Machine Learning · Computer Science 2026-02-13 Yujie Gu , Richeng Jin , Zhaoyang Zhang , Huaiyu Dai

Artificial intelligence (AI) and neuroscience share a rich history, with advancements in neuroscience shaping the development of AI systems capable of human-like knowledge retention. Leveraging insights from neuroscience and existing…

Machine Learning · Computer Science 2024-04-24 Hikmat Khan , Nidhal Carla Bouaynaya , Ghulam Rasool

While most continual learning methods focus on mitigating forgetting and improving accuracy, they often overlook the critical aspect of network calibration, despite its importance. Neural collapse, a phenomenon where last-layer features…

Machine Learning · Computer Science 2026-04-23 Trung-Anh Dang , Vincent Nguyen , Ngoc-Son Vu , Christel Vrain

Sharpness-Aware Minimization (SAM) is a recent training method that relies on worst-case weight perturbations which significantly improves generalization in various settings. We argue that the existing justifications for the success of SAM…

Machine Learning · Computer Science 2022-06-14 Maksym Andriushchenko , Nicolas Flammarion

Deep neural networks (DNNs) have demonstrated promising results in various complex tasks. However, current DNNs encounter challenges with over-parameterization, especially when there is limited training data available. To enhance the…

Machine Learning · Computer Science 2023-08-22 Xingyu Li , Bo Tang

In continual learning, the learner learns multiple tasks in sequence, with data being acquired only once for each task. Catastrophic forgetting is a major challenge to continual learning. To reduce forgetting, some existing rehearsal-based…

Machine Learning · Computer Science 2023-10-13 Zihao Xu , Xuan Tang , Yufei Shi , Jianfeng Zhang , Jian Yang , Mingsong Chen , Xian Wei

In continual learning, the learner faces a stream of data whose distribution changes over time. Modern neural networks are known to suffer under this setting, as they quickly forget previously acquired knowledge. To address such…

Machine Learning · Computer Science 2021-03-03 Arslan Chaudhry , Albert Gordo , Puneet K. Dokania , Philip Torr , David Lopez-Paz

Deep pretrained language models have achieved great success in the way of pretraining first and then fine-tuning. But such a sequential transfer learning paradigm often confronts the catastrophic forgetting problem and leads to sub-optimal…

Computation and Language · Computer Science 2020-04-28 Sanyuan Chen , Yutai Hou , Yiming Cui , Wanxiang Che , Ting Liu , Xiangzhan Yu

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges…

Machine Learning · Computer Science 2022-07-26 Kun Wu , Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang , Dejun Yang

Graph Neural Networks (GNNs) have recently received significant research attention due to their superior performance on a variety of graph-related learning tasks. Most of the current works focus on either static or dynamic graph settings,…

Machine Learning · Computer Science 2021-02-09 Fan Zhou , Chengtai Cao

Sharpness-aware minimization (SAM) methods have gained increasing popularity by formulating the problem of minimizing both loss value and loss sharpness as a minimax objective. In this work, we increase the efficiency of the maximization…

Machine Learning · Computer Science 2024-05-17 Gonçalo Mordido , Pranshu Malviya , Aristide Baratin , Sarath Chandar

Sharpness-Aware Minimization (SAM) has recently emerged as an effective technique for improving DNN robustness to input variations. However, its interplay with the compactness requirements of on-device DNN deployments remains less explored.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Jialuo He , Huangxun Chen

Existing work in continual learning (CL) focuses on mitigating catastrophic forgetting, i.e., model performance deterioration on past tasks when learning a new task. However, the training efficiency of a CL system is under-investigated,…

Machine Learning · Computer Science 2022-09-21 Zifeng Wang , Zheng Zhan , Yifan Gong , Geng Yuan , Wei Niu , Tong Jian , Bin Ren , Stratis Ioannidis , Yanzhi Wang , Jennifer Dy

Sharpness-Aware Minimization (SAM) is an optimization technique designed to improve generalization by favoring flatter loss minima. To achieve this, SAM optimizes a modified objective that penalizes sharpness, using computationally…

Machine Learning · Computer Science 2024-11-05 Nalin Tiwary , Siddarth Aananth

Learning and adapting to new distributions or learning new tasks sequentially without forgetting the previously learned knowledge is a challenging phenomenon in continual learning models. Most of the conventional deep learning models are…

Machine Learning · Computer Science 2019-05-27 Honglin Li , Shirin Enshaeifar , Frieder Ganz , Payam Barnaghi

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

In online continual learning, a neural network incrementally learns from a non-i.i.d. data stream. Nearly all online continual learning methods employ experience replay to simultaneously prevent catastrophic forgetting and underfitting on…

Machine Learning · Computer Science 2024-07-22 Jason Yoo , Yunpeng Liu , Frank Wood , Geoff Pleiss