中文
相关论文

相关论文: TaE: Task-aware Expandable Representation for Long…

200 篇论文

In scenarios with long-tailed distributions, the model's ability to identify tail classes is limited due to the under-representation of tail samples. Class rebalancing, information augmentation, and other techniques have been proposed to…

机器学习 · 计算机科学 2023-10-17 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Lingling Li

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

机器学习 · 计算机科学 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Class-Incremental Learning (CIL) aims to solve the neural networks' catastrophic forgetting problem, which refers to the fact that once the network updates on a new task, its performance on previously-learned tasks drops dramatically. Most…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Libo Huang , Yan Zeng , Chuanguang Yang , Zhulin An , Boyu Diao , Yongjun Xu

Learning from real-world data is frequently hindered by the compound challenge of long-tailed class distributions and noisy annotations. Existing methods partially address these issues but typically ignore the non-uniform impact of label…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Mengke Li , Haiquan Ling , Lihao Chen , Yang Lu , Yiqun Zhang , Hui Huang

A major open problem on the road to artificial intelligence is the development of incrementally learning systems that learn about more and more concepts over time from a stream of data. In this work, we introduce a new training strategy,…

计算机视觉与模式识别 · 计算机科学 2017-04-17 Sylvestre-Alvise Rebuffi , Alexander Kolesnikov , Georg Sperl , Christoph H. Lampert

In the context of the long-tail scenario, models exhibit a strong demand for high-quality data. Data-centric approaches aim to enhance both the quantity and quality of data to improve model performance. Among these approaches, information…

计算机视觉与模式识别 · 计算机科学 2023-11-06 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Puhua Chen

In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training.…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Xinyuan Gao , Songlin Dong , Yuhang He , Xing Wei , Yihong Gong

Task-incremental learning involves the challenging problem of learning new tasks continually, without forgetting past knowledge. Many approaches address the problem by expanding the structure of a shared neural network as tasks arrive, but…

机器学习 · 计算机科学 2020-11-24 Azhar Shaikh , Nishant Sinha

Class-incremental continual learning is a core step towards developing artificial intelligence systems that can continuously adapt to changes in the environment by learning new concepts without forgetting those previously learned. This is…

机器学习 · 计算机科学 2023-07-07 Evelyn Chee , Mong Li Lee , Wynne Hsu

The problem of long-tailed recognition, where the number of examples per class is highly unbalanced, is considered. While training with class-balanced sampling has been shown effective for this problem, it is known to over-fit to few-shot…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Bo Liu , Haoxiang Li , Hao Kang , Gang Hua , Nuno Vasconcelos

Deep neural networks frequently suffer from performance degradation when the training data is long-tailed because several majority classes dominate the training, resulting in a biased model. Recent studies have made a great effort in…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Mengke Li , Yiu-ming Cheung , Juyong Jiang

Deep learning-based models encounter challenges when processing long-tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Changyao Tian , Wenhai Wang , Xizhou Zhu , Jifeng Dai , Yu Qiao

Non-exemplar class-incremental learning is to recognize both the old and new classes when old class samples cannot be saved. It is a challenging task since representation optimization and feature retention can only be achieved under…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Kai Zhu , Wei Zhai , Yang Cao , Jiebo Luo , Zheng-Jun Zha

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

计算机视觉与模式识别 · 计算机科学 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

Large Language Models (LLMs) require precise alignment with complex instructions to optimize their performance in real-world applications. As the demand for refined instruction tuning data increases, traditional methods that evolve simple…

计算机与社会 · 计算机科学 2024-10-07 Jiuding Yang , Shengyao Lu , Weidong Guo , Xiangyang Li , Kaitong Yang , Yu Xu , Di Niu

Unsupervised learning is becoming more and more important recently. As one of its key components, the autoencoder (AE) aims to learn a latent feature representation of data which is more robust and discriminative. However, most AE based…

机器学习 · 计算机科学 2019-04-02 Jingcai Guo , Song Guo

Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Linlan Huang , Xusheng Cao , Haori Lu , Xialei Liu

Real-world data tends to follow a long-tailed distribution, where the class imbalance results in dominance of the head classes during training. In this paper, we propose a frustratingly simple but effective step-wise learning framework to…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Long-tailed relation classification is a challenging problem as the head classes may dominate the training phase, thereby leading to the deterioration of the tail performance. Existing solutions usually address this issue via…

机器学习 · 计算机科学 2023-01-26 Haiyang Yu , Ningyu Zhang , Shumin Deng , Zonggang Yuan , Yantao Jia , Huajun Chen

Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Tianhong Li , Peng Cao , Yuan Yuan , Lijie Fan , Yuzhe Yang , Rogerio Feris , Piotr Indyk , Dina Katabi