中文
相关论文

相关论文: Mitigating Task-Order Sensitivity and Forgetting v…

200 篇论文

Hierarchical Text Classification (HTC) aims to categorize text data based on a structured label hierarchy, resulting in predicted labels forming a sub-hierarchy tree. The semantics of the text should align with the semantics of the labels…

计算与语言 · 计算机科学 2024-09-04 Ashish Kumar , Durga Toshniwal

In this paper, we propose a continual learning (CL) technique that is beneficial to sequential task learners by improving their retained accuracy and reducing catastrophic forgetting. The principal target of our approach is the automatic…

机器学习 · 计算机科学 2021-01-19 Ammar Shaker , Shujian Yu , Francesco Alesiani

Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using…

计算与语言 · 计算机科学 2024-06-21 Simon Yu , Jie He , Víctor Gutiérrez-Basulto , Jeff Z. Pan

The Multi-Task Learning (MTL) technique has been widely studied by word-wide researchers. The majority of current MTL studies adopt the hard parameter sharing structure, where hard layers tend to learn general representations over all tasks…

信息检索 · 计算机科学 2021-01-25 Dehong Gao , Wenjing Yang , Huiling Zhou , Yi Wei , Yi Hu , Hao Wang

This paper focuses on an under-explored yet important problem: Federated Class-Continual Learning (FCCL), where new classes are dynamically added in federated learning. Existing FCCL works suffer from various limitations, such as requiring…

机器学习 · 计算机科学 2023-08-21 Jie Zhang , Chen Chen , Weiming Zhuang , Lingjuan Lv

Class incremental learning (CIL) requires an agent to learn distinct tasks consecutively with knowledge retention against forgetting. Problems impeding the practical applications of CIL methods are twofold: (1) non-i.i.d batch streams and…

机器学习 · 计算机科学 2025-10-27 Junda Wang , Minghui Hu , Ning Li , Abdulaziz Al-Ali , Ponnuthurai Nagaratnam Suganthan

The task of Long-tailed Class Incremental Learning (LT-CIL) addresses the sequential learning of new classes from datasets with imbalanced class distributions. This scenario intensifies the fundamental problem of catastrophic forgetting,…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Taigo Sakai , Kazuhiro Hotta

Continual learning (CL) enables animals to learn new tasks without erasing prior knowledge. CL in artificial neural networks (NNs) is challenging due to catastrophic forgetting, where new learning degrades performance on older tasks. While…

机器学习 · 计算机科学 2025-01-28 Haozhe Shan , Qianyi Li , Haim Sompolinsky

Cooperative Multi-Agent Reinforcement Learning (MARL) solves complex tasks that require coordination from multiple agents, but is often limited to either local (independent learning) or global (centralized learning) perspectives. In this…

机器学习 · 计算机科学 2026-02-26 David Eckel , Henri Meeß

Recently, continual learning (CL) has gained significant interest because it enables deep learning models to acquire new knowledge without forgetting previously learnt information. However, most existing works require knowing the task…

机器学习 · 计算机科学 2022-07-13 Fei Ye , Adrian G. Bors

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences. In this paper, we introduce the novel problem of…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Enrico Fini , Stéphane Lathuilière , Enver Sangineto , Moin Nabi , Elisa Ricci

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

机器学习 · 计算机科学 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

As an effective learning paradigm against insufficient training samples, Multi-Task Learning (MTL) encourages knowledge sharing across multiple related tasks so as to improve the overall performance. In MTL, a major challenge springs from…

机器学习 · 计算机科学 2020-04-30 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

Multi-task learning (MTL) has emerged as a pivotal paradigm in machine learning by leveraging shared structures across multiple related tasks. Despite its empirical success, the development of likelihood-based efficiently solvable…

机器学习 · 计算机科学 2026-05-07 Shihong Ding , Fangyu Du , Cong Fang

In Continual Learning (CL), a model is required to learn a stream of tasks sequentially without significant performance degradation on previously learned tasks. Current approaches fail for a long sequence of tasks from diverse domains and…

机器学习 · 计算机科学 2023-05-29 Iordanis Fostiropoulos , Jiaye Zhu , Laurent Itti

Human Motion Prediction (HMP) aims to predict future poses at different moments according to past motion sequences. Previous approaches have treated the prediction of various moments equally, resulting in two main limitations: the learning…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Jianwei Tang , Jiangxin Sun , Xiaotong Lin , Lifang Zhang , Wei-Shi Zheng , Jian-Fang Hu

Existing deep multitask learning (MTL) approaches align layers shared between tasks in a parallel ordering. Such an organization significantly constricts the types of shared structure that can be learned. The necessity of parallel ordering…

机器学习 · 计算机科学 2018-02-14 Elliot Meyerson , Risto Miikkulainen

Deep neural networks trained with backpropagation have achieved outstanding performance in vision tasks but remain biologically implausible, computationally demanding, and difficult to interpret. The Forward-Forward (FF) algorithm offers a…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Jie-En Yao , Hong-En Chen , C. -C. Jay Kuo

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

机器学习 · 计算机科学 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen

In-context learning (ICL) has become a classic approach for enabling LLMs to handle various tasks based on a few input-output examples. The effectiveness of ICL heavily relies on the quality of these examples, and previous works which…

计算与语言 · 计算机科学 2025-07-25 Yifu Chen , Bingchen Huang , Zhiling Wang , Yuanchao Du , Junfeng Luo , Lei Shen , Zhineng chen