English
Related papers

Related papers: Towards Robust Graph Incremental Learning on Evolv…

200 papers

Many deep learning applications, like keyword spotting, require the incorporation of new concepts (classes) over time, referred to as Class Incremental Learning (CIL). The major challenge in CIL is catastrophic forgetting, i.e., preserving…

Machine Learning · Computer Science 2022-04-28 Dong Ma , Chi Ian Tang , Cecilia Mascolo

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made…

Computation and Language · Computer Science 2025-12-24 Zuo Wang , Ye Yuan

To mitigate the suboptimal nature of graph structure, Graph Structure Learning (GSL) has emerged as a promising approach to improve graph structure and boost performance in downstream tasks. Despite the proposal of numerous GSL methods, the…

Machine Learning · Computer Science 2024-06-14 Zhiyao Zhou , Sheng Zhou , Bochao Mao , Jiawei Chen , Qingyun Sun , Yan Feng , Chun Chen , Can Wang

To improve the performance of Graph Neural Networks (GNNs), Graph Structure Learning (GSL) has been extensively applied to reconstruct or refine original graph structures, effectively addressing issues like heterophily, over-squashing, and…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Zhuofan Zhang , Ziming Wang , Xiang Li , Sitao Luan , Xiaojiang Peng , Lihui Chen

Artificial neural networks thrive in solving the classification problem for a particular rigid task, acquiring knowledge through generalized learning behaviour from a distinct training phase. The resulting network resembles a static entity…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Matthias De Lange , Rahaf Aljundi , Marc Masana , Sarah Parisot , Xu Jia , Ales Leonardis , Gregory Slabaugh , Tinne Tuytelaars

We propose a new \emph{Transformed Risk Minimization} (TRM) framework as an extension of classical risk minimization. In TRM, we optimize not only over predictive models, but also over data transformations; specifically over distributions…

Machine Learning · Computer Science 2023-10-09 Evangelos Chatzipantazis , Stefanos Pertigkiozoglou , Kostas Daniilidis , Edgar Dobriban

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

Machine Learning · Computer Science 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

Although well-trained deep neural networks have shown remarkable performance on numerous tasks, they rapidly forget what they have learned as soon as they begin to learn with additional data with the previous data stop being provided. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Byungju Kim , Jaeyoung Lee , Kyungsu Kim , Sungjin Kim , Junmo Kim

Adapting to concept drift is a challenging task in machine learning, which is usually tackled using incremental learning techniques that periodically re-fit a learning model leveraging newly available data. A primary limitation of these…

Class-Incremental Learning (CIL) aims to train a reliable model with the streaming data, which emerges unknown classes sequentially. Different from traditional closed set learning, CIL has two main challenges: 1) Novel class detection. The…

Machine Learning · Computer Science 2020-09-01 Yang Yang , Zhen-Qiang Sun , HengShu Zhu , Yanjie Fu , Hui Xiong , Jian Yang

Deep learning models suffer from catastrophic forgetting when trained in an incremental learning setting. In this work, we propose a novel approach to address the task incremental learning problem, which involves training a model on new…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Pravendra Singh , Pratik Mazumder , Piyush Rai , Vinay P. Namboodiri

Multi-sourced datasets are common in studies of variable interactions, for example, individual-level fMRI integration, cross-domain recommendation, etc, where each source induces a related but distinct dependency structure. Joint learning…

Methodology · Statistics 2025-12-08 Shixiang Liu , Yanhang Zhang , Zhifan Li , Jianxin Yin

We present a novel methodology to jointly perform multi-task learning and infer intrinsic relationship among tasks by an interpretable and sparse graph. Unlike existing multi-task learning methodologies, the graph structure is not assumed…

Machine Learning · Computer Science 2020-09-15 Shujian Yu , Francesco Alesiani , Ammar Shaker , Wenzhe Yin

Spatiotemporal prediction over graphs (STPG) is challenging, because real-world data suffers from the Out-of-Distribution (OOD) generalization problem, where test data follow different distributions from training ones. To address this…

Machine Learning · Computer Science 2025-01-03 Zhaobin Mo , Haotian Xiang , Xuan Di

This paper presents a practical and simple yet efficient method to effectively deal with the catastrophic forgetting for Class Incremental Learning (CIL) tasks. CIL tends to learn new concepts perfectly, but not at the expense of…

Machine Learning · Computer Science 2021-03-30 Bahram Mohammadi , Mohammad Sabokrou

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Sparse graph recovery methods work well where the data follows their assumptions but often they are not designed for doing downstream probabilistic queries. This limits their adoption to only identifying connections among the input…

Machine Learning · Computer Science 2024-10-23 Harsh Shrivastava , Urszula Chajewska

We propose Improved Memories Learning (IMeL), a novel algorithm that turns reinforcement learning (RL) into a supervised learning (SL) problem and delimits the role of neural networks (NN) to interpolation. IMeL consists of two components.…

Machine Learning · Computer Science 2020-08-25 Francesco Varoli , Guido Novati , Pantelis R. Vlachas , Petros Koumoutsakos

Enabling robots to perform complex dynamic tasks such as picking up an object in one sweeping motion or pushing off a wall to quickly turn a corner is a challenging problem. The dynamic interactions implicit in these tasks are critical…

Robotics · Computer Science 2022-10-03 Saumya Saxena , Oliver Kroemer

Graph prediction problems prevail in data analysis and machine learning. The inverse prediction problem, namely to infer input data from given output labels, is of emerging interest in various applications. In this work, we develop…

Machine Learning · Statistics 2022-11-22 Chen Xu , Xiuyuan Cheng , Yao Xie