English
Related papers

Related papers: Large Scale Incremental Learning

200 papers

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

Model learning from class imbalanced training data is a long-standing and significant challenge for machine learning. In particular, existing deep learning methods consider mostly either class balanced data or moderately imbalanced data in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Qi Dong , Shaogang Gong , Xiatian Zhu

Class incremental learning refers to a special multi-class classification task, in which the number of classes is not fixed but is increasing with the continual arrival of new data. Existing researches mainly focused on solving catastrophic…

Machine Learning · Computer Science 2019-05-21 Xu Zhang , Yang Yao , Baile Xu , Lekun Mao , Furao Shen , Jian Zhao , Qingwei Lin

In this paper, we address the incremental classifier learning problem, which suffers from catastrophic forgetting. The main reason for catastrophic forgetting is that the past data are not available during learning. Typical approaches keep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yue Wu , Yinpeng Chen , Lijuan Wang , Yuancheng Ye , Zicheng Liu , Yandong Guo , Zhengyou Zhang , Yun Fu

In most real-world scenarios, labeled training datasets are highly class-imbalanced, where deep neural networks suffer from generalizing to a balanced testing criterion. In this paper, we explore a novel yet simple way to alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Jaehyung Kim , Jongheon Jeong , Jinwoo Shin

Deep learning has shown its human-level performance in various applications. However, current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes. This poses a challenge particularly…

Machine Learning · Computer Science 2022-04-29 Yang Yang , Zhiying Cui , Junjie Xu , Changhong Zhong , Wei-Shi Zheng , Ruixuan Wang

In real-world clinical settings, data distributions evolve over time, with a continuous influx of new, limited disease cases. Therefore, class incremental learning is of great significance, i.e., deep learning models are required to learn…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Yifei Yao , Hanrong Zhang

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Few-Shot Learning (FSL) algorithms are commonly trained through Meta-Learning (ML), which exposes models to batches of tasks sampled from a meta-dataset to mimic tasks seen during evaluation. However, the standard training procedures…

Machine Learning · Computer Science 2024-10-28 Mateusz Ochal , Massimiliano Patacchiola , Amos Storkey , Jose Vazquez , Sen Wang

Complementary-label learning (CLL) is a weakly supervised paradigm where instances are labeled with classes they do not belong to. Despite a decade of research, CLL methods remain competitive mainly on 10-class classification, with scaling…

Machine Learning · Computer Science 2026-05-19 Tan-Ha Mai , Chao-Kai Chiang , Han-Hwa Shih , Gang Niu , Masashi Sugiyama , Hsuan-Tien Lin

Data imbalance between common and rare diseases during model training often causes intelligent diagnosis systems to have biased predictions towards common diseases. The state-of-the-art approaches apply a two-stage learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Chenghua Zeng , Huijuan Lu , Kanghao Chen , Ruixuan Wang , Wei-Shi Zheng

The accurate automated classification of variable stars into their respective sub-types is difficult. Machine learning based solutions often fall foul of the imbalanced learning problem, which causes poor generalisation performance in…

Instrumentation and Methods for Astrophysics · Physics 2020-03-18 Zafiirah Hosenie , Robert Lyon , Benjamin Stappers , Arrykrishna Mootoovaloo , Vanessa McBride

Building an echocardiography view classifier that maintains performance in real-life cases requires diverse multi-site data, and frequent updates with newly available data to mitigate model drift. Simply fine-tuning on new datasets results…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Kit M. Bransby , Woo-jin Cho Kim , Jorge Oliveira , Alex Thorley , Arian Beqiri , Alberto Gomez , Agisilaos Chartsias

Continual learning (CL) aims to empower models to learn new tasks without forgetting previously acquired knowledge. Most prior works concentrate on the techniques of architectures, replay data, regularization, \etc. However, the category…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Bolin Ni , Hongbo Zhao , Chenghao Zhang , Ke Hu , Gaofeng Meng , Zhaoxiang Zhang , Shiming Xiang

Real-world datasets are often highly class-imbalanced, which can adversely impact the performance of deep learning models. The majority of research on training neural networks under class imbalance has focused on specialized loss functions,…

Machine Learning · Computer Science 2023-12-06 Ravid Shwartz-Ziv , Micah Goldblum , Yucen Lily Li , C. Bayan Bruss , Andrew Gordon Wilson

We tackle catastrophic forgetting problem in the context of class-incremental learning for video recognition, which has not been explored actively despite the popularity of continual learning. Our framework addresses this challenging task…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Jaeyoo Park , Minsoo Kang , Bohyung Han

As part of autonomous car driving systems, semantic segmentation is an essential component to obtain a full understanding of the car's environment. One difficulty, that occurs while training neural networks for this purpose, is class…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Robin Chan , Matthias Rottmann , Fabian Hüger , Peter Schlicht , Hanno Gottschalk

In many real-life tasks of application of supervised learning approaches, all the training data are not available at the same time. The examples are lifelong image classification or recognition of environmental objects during interaction of…

Machine Learning · Computer Science 2020-06-15 Miltiadis Poursanidis , Jenny Benois-Pineau , Akka Zemmari , Boris Mansenca , Aymar de Rugy

The ability to learn from incrementally arriving data is essential for any life-long learning system. However, standard deep neural networks forget the knowledge about the old tasks, a phenomenon called catastrophic forgetting, when trained…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Haseeb Shah , Khurram Javed , Faisal Shafait

Automated Machine Learning has grown very successful in automating the time-consuming, iterative tasks of machine learning model development. However, current methods struggle when the data is imbalanced. Since many real-world datasets are…

Machine Learning · Computer Science 2022-11-02 Prabhant Singh , Joaquin Vanschoren