中文
相关论文

相关论文: Class-Adaptive Sampling Policy for Efficient Conti…

200 篇论文

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Jiangpeng He , Fengqing Zhu

Continuously acquiring new knowledge from a dynamic environment is a fundamental capability for animals, facilitating their survival and ability to address various challenges. This capability is referred to as continual learning, which…

机器学习 · 计算机科学 2025-01-14 RunQing Wu , KaiHui Huang , HanYi Zhang , QiHe Liu , GuoJin Yu , JingSong Deng , Fei Ye

Multi-view action clustering leverages the complementary information from different camera views to enhance the clustering performance. Although existing approaches have achieved significant progress, they assume all camera views are…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Xiaoqiang Yan , Yingtao Gan , Yiqiao Mao , Yangdong Ye , Hui Yu

The continual learning (CL) ability is vital for deploying large language models (LLMs) in the dynamic world. Existing methods devise the learning module to acquire task-specific knowledge with parameter-efficient tuning (PET) block and the…

计算与语言 · 计算机科学 2024-06-07 Weixiang Zhao , Shilong Wang , Yulin Hu , Yanyan Zhao , Bing Qin , Xuanyu Zhang , Qing Yang , Dongliang Xu , Wanxiang Che

Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help…

计算与语言 · 计算机科学 2023-05-12 Zixuan Ke , Bing Liu

We develop a new continual meta-learning method to address challenges in sequential multi-task learning. In this setting, the agent's goal is to achieve high reward over any sequence of tasks quickly. Prior meta-reinforcement learning…

机器学习 · 计算机科学 2021-12-09 Glen Berseth , Zhiwei Zhang , Grace Zhang , Chelsea Finn , Sergey Levine

Acquiring new knowledge without forgetting what has been learned in a sequence of tasks is the central focus of continual learning (CL). While tasks arrive sequentially, the training data are often prepared and annotated independently,…

机器学习 · 计算机科学 2024-01-31 Thuy-Trang Vu , Shahram Khadivi , Mahsa Ghorbanali , Dinh Phung , Gholamreza Haffari

Sampling strategies have been widely applied in many recommendation systems to accelerate model learning from implicit feedback data. A typical strategy is to draw negative instances with uniform distribution, which however will severely…

信息检索 · 计算机科学 2020-11-17 Jiawei Chen , Chengquan Jiang , Can Wang , Sheng Zhou , Yan Feng , Chun Chen , Martin Ester , Xiangnan He

Continual learning is inherently a constrained learning problem. The goal is to learn a predictor under a no-forgetting requirement. Although several prior studies formulate it as such, they do not solve the constrained problem explicitly.…

机器学习 · 计算机科学 2024-06-03 Juan Elenter , Navid NaderiAlizadeh , Tara Javidi , Alejandro Ribeiro

Deep learning approaches are nowadays ubiquitously used to tackle computer vision tasks such as semantic segmentation, requiring large datasets and substantial computational power. Continual learning for semantic segmentation (CSS) is an…

计算机视觉与模式识别 · 计算机科学 2021-03-12 Arthur Douillard , Yifu Chen , Arnaud Dapogny , Matthieu Cord

The goal of continual learning is to provide intelligent agents that are capable of learning continually a sequence of tasks using the knowledge obtained from previous tasks while performing well on prior tasks. However, a key challenge in…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Ya-nan Han , Jian-wei Liu

Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Linlan Huang , Xusheng Cao , Haori Lu , Xialei Liu

Continual learning, also known as lifelong learning or incremental learning, refers to the process by which a model learns from a stream of incoming data over time. A common problem in continual learning is the classification layer's bias…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Haoran Chen , Micah Goldblum , Zuxuan Wu , Yu-Gang Jiang

Meta-learning aims to learn general knowledge with diverse training tasks conducted from limited data, and then transfer it to new tasks. It is commonly believed that increasing task diversity will enhance the generalization ability of…

机器学习 · 计算机科学 2024-06-04 Jingyao Wang , Wenwen Qiang , Xingzhe Su , Changwen Zheng , Fuchun Sun , Hui Xiong

Continual learning -- accumulating knowledge from a sequence of learning experiences -- is an important yet challenging problem. In this paradigm, the model's performance for previously encountered instances may substantially drop as…

机器学习 · 计算机科学 2022-07-14 Yasin Findik , Farhad Pourkamali-Anaraki

Continual learning poses a fundamental challenge for modern machine learning systems, requiring models to adapt to new tasks while retaining knowledge from previous ones. Addressing this challenge necessitates the development of efficient…

机器学习 · 计算机科学 2024-04-10 Jędrzej Kozal , Jan Wasilewski , Bartosz Krawczyk , Michał Woźniak

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to…

机器学习 · 计算机科学 2024-02-07 Liyuan Wang , Xingxing Zhang , Hang Su , Jun Zhu

The continual learning (CL) paradigm aims to enable neural networks to learn tasks continually in a sequential fashion. The fundamental challenge in this learning paradigm is catastrophic forgetting previously learned tasks when the model…

机器学习 · 计算机科学 2021-04-15 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

The mainstream paradigm behind continual learning has been to adapt the model parameters to non-stationary data distributions, where catastrophic forgetting is the central challenge. Typical methods rely on a rehearsal buffer or known task…

Rehearsal-based techniques are commonly used to mitigate catastrophic forgetting (CF) in Incremental learning (IL). The quality of the exemplars selected is important for this purpose and most methods do not ensure the appropriate diversity…

机器学习 · 计算机科学 2023-12-18 Sahil Nokhwal , Nirman Kumar