中文
相关论文

相关论文: GradMix: Gradient-based Selective Mixup for Robust…

200 篇论文

Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure,…

机器学习 · 计算机科学 2023-11-21 Tiantian Zhang , Kevin Zehua Shen , Zichuan Lin , Bo Yuan , Xueqian Wang , Xiu Li , Deheng Ye

Data augmentation plays a pivotal role in enhancing and diversifying training data. Nonetheless, consistently improving model performance in varied learning scenarios, especially those with inherent data biases, remains challenging. To…

机器学习 · 计算机科学 2024-06-04 Xiaoling Zhou , Wei Ye , Zhemg Lee , Rui Xie , Shikun Zhang

Class imbalance is a problem of significant importance in applied deep learning where trained models are exploited for decision support and automated decisions in critical areas such as health and medicine, transportation, and finance. The…

机器学习 · 计算机科学 2020-12-07 Colin Bellinger , Roberto Corizzo , Nathalie Japkowicz

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

机器学习 · 计算机科学 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Class incremental learning refers to a special multi-class classification task, in which the number of classes is not fixed but is increasing with the continual arrival of new data. Existing researches mainly focused on solving catastrophic…

机器学习 · 计算机科学 2019-05-21 Xu Zhang , Yang Yao , Baile Xu , Lekun Mao , Furao Shen , Jian Zhao , Qingwei Lin

Mixup is a popular data augmentation technique for training deep neural networks where additional samples are generated by linearly interpolating pairs of inputs and their labels. This technique is known to improve the generalization…

Neural networks notoriously suffer from the problem of catastrophic forgetting, the phenomenon of forgetting the past knowledge when acquiring new knowledge. Overcoming catastrophic forgetting is of significant importance to emulate the…

机器学习 · 计算机科学 2021-04-20 Christian Simon , Piotr Koniusz , Mehrtash Harandi

Catastrophic forgetting is a significant challenge in the field of machine learning, particularly in neural networks. When a neural network learns to perform well on a new task, it often forgets its previously acquired knowledge or…

机器学习 · 计算机科学 2023-12-04 Nuri Korhan , Ceren Öner

In pathology image analysis, obtaining and maintaining high-quality annotated samples is an extremely labor-intensive task. To overcome this challenge, mixing-based methods have emerged as effective alternatives to traditional preprocessing…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Tianyi Zhang , Zhiling Yan , Chunhui Li , Nan Ying , Yanli Lei , Yunlu Feng , Yu Zhao , Guanglei Zhang

Catastrophic forgetting of previous knowledge is a critical issue in continual learning typically handled through various regularization strategies. However, existing methods struggle especially when several incremental steps are performed.…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Chang Liu , Giulia Rizzoli , Francesco Barbato , Andrea Maracani , Marco Toldo , Umberto Michieli , Yi Niu , Pietro Zanuttigh

Standard deep learning-based classification approaches require collecting all samples from all classes in advance and are trained offline. This paradigm may not be practical in real-world clinical applications, where new classes are…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Sana Ayromlou , Purang Abolmaesumi , Teresa Tsang , Xiaoxiao Li

Mixup is a popular data augmentation method, with many variants subsequently proposed. These methods mainly create new examples via convex combination of random data pairs and their corresponding one-hot labels. However, most of them adhere…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Shaoyu Zhang , Chen Chen , Xiujuan Zhang , Silong Peng

Data augmentation is a widely used technique to address the problem of text classification when there is a limited amount of training data. Recent work often tackles this problem using large language models (LLMs) like GPT3 that can…

计算与语言 · 计算机科学 2023-10-24 Gaurav Sahu , Olga Vechtomova , Dzmitry Bahdanau , Issam H. Laradji

Deep neural networks tend to memorize noisy labels, severely degrading their generalization performance. Although Mixup has demonstrated effectiveness in improving generalization and robustness, existing Mixup-based methods typically…

机器学习 · 计算机科学 2025-09-16 Qiuhao Liu , Ling Li , Yao Lu , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Task-free online continual learning aims to alleviate catastrophic forgetting of the learner on a non-iid data stream. Experience Replay (ER) is a SOTA continual learning method, which is broadly used as the backbone algorithm for other…

机器学习 · 计算机科学 2021-08-24 Zhiyi Chen , Tong Lin

Efficient continual learning techniques have been a topic of significant research over the last few years. A fundamental problem with such learning is severe degradation of performance on previously learned tasks, known also as catastrophic…

机器学习 · 计算机科学 2024-03-05 Tammuz Dubnov , Vishal Thengane

Current deep learning models often suffer from catastrophic forgetting of old knowledge when continually learning new knowledge. Existing strategies to alleviate this issue often fix the trade-off between keeping old knowledge (stability)…

计算机视觉与模式识别 · 计算机科学 2023-01-19 Kanghao Chen , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Mixup is a widely adopted data augmentation technique known for enhancing the generalization of machine learning models by interpolating between data points. Despite its success and popularity, limited attention has been given to…

机器学习 · 计算机科学 2025-03-05 Chungpa Lee , Jongho Im , Joseph H. T. Kim

High-quality and challenging event stream datasets play an important role in the design of an efficient event-driven mechanism that mimics the brain. Although event cameras can provide high dynamic range and low-energy event stream data,…

神经与进化计算 · 计算机科学 2022-05-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

Linear mixed models are widely used for clustered data, but their reliance on parametric forms limits flexibility in complex and high-dimensional settings. In contrast, gradient boosting methods achieve high predictive accuracy through…

机器学习 · 统计学 2025-11-04 Mitchell L. Prevett , Francis K. C. Hui , Zhi Yang Tho , A. H. Welsh , Anton H. Westveld