English
Related papers

Related papers: Learning to Propagate for Graph Meta-Learning

200 papers

Meta-learning, or "learning to learn," is a subfield of machine learning where the goal is to develop models and algorithms that can learn from various tasks and improve their learning process over time. Unlike traditional machine learning…

Machine Learning · Computer Science 2024-07-23 Mouad El Bouchattaoui

Gradient-based meta-learning methods leverage gradient descent to learn the commonalities among various tasks. While previous such methods have been successful in meta-learning tasks, they resort to simple gradient descent during…

Machine Learning · Statistics 2018-06-15 Yoonho Lee , Seungjin Choi

This paper studies the problem of learning message propagation strategies for graph neural networks (GNNs). One of the challenges for graph neural networks is that of defining the propagation strategy. For instance, the choices of…

Machine Learning · Computer Science 2023-10-03 Teng Xiao , Zhengyu Chen , Donglin Wang , Suhang Wang

In this paper, we propose a learning algorithm that enables a model to quickly exploit commonalities among related tasks from an unseen task distribution, before quickly adapting to specific tasks from that same distribution. We investigate…

Machine Learning · Computer Science 2021-07-21 Arnout Devos , Yatin Dandi

Graph neural networks (GNNs) have been used to tackle the few-shot learning (FSL) problem and shown great potentials under the transductive setting. However under the inductive setting, existing GNN based methods are less competitive. This…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Tianyuan Yu , Sen He , Yi-Zhe Song , Tao Xiang

Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels are scarce during training. An effective approach to…

Machine Learning · Computer Science 2020-02-20 Weihua Hu , Bowen Liu , Joseph Gomes , Marinka Zitnik , Percy Liang , Vijay Pande , Jure Leskovec

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Meta-learning is a powerful paradigm for few-shot learning. Although with remarkable success witnessed in many applications, the existing optimization based meta-learning models with over-parameterized neural networks have been evidenced to…

Machine Learning · Computer Science 2020-07-23 Hongduan Tian , Bo Liu , Xiao-Tong Yuan , Qingshan Liu

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on hand-engineered…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

Transferring learned models to novel tasks is a challenging problem, particularly if only very few labeled examples are available. Although this few-shot learning setup has received a lot of attention recently, most proposed methods focus…

Machine Learning · Computer Science 2020-09-16 Xiahan Shi , Leonard Salewski , Martin Schiegg , Zeynep Akata , Max Welling

Learning from set-structured data is a fundamental problem that has recently attracted increasing attention, where a series of summary networks are introduced to deal with the set input. In fact, many meta-learning problems can be treated…

Machine Learning · Computer Science 2023-03-08 Dandan Guo , Long Tian , Minghe Zhang , Mingyuan Zhou , Hongyuan Zha

Graph neural networks (GNNs) are important tools for transductive learning tasks, such as node classification in graphs, due to their expressive power in capturing complex interdependency between nodes. To enable graph neural network…

Machine Learning · Computer Science 2022-05-17 Man Wu , Shirui Pan , Lan Du , Xingquan Zhu

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

Graph neural networks (GNNs) have brought revolutionary advancements to the field of link prediction (LP), providing powerful tools for mining potential relationships in graphs. However, existing methods face challenges when dealing with…

Machine Learning · Computer Science 2025-12-30 Huashen Lu , Wensheng Gan , Guoting Chen , Zhichao Huang , Philip S. Yu

The ability to learn new concepts with small amounts of data is a critical aspect of intelligence that has proven challenging for deep learning methods. Meta-learning has emerged as a promising technique for leveraging data from previous…

Machine Learning · Computer Science 2020-04-29 Mingzhang Yin , George Tucker , Mingyuan Zhou , Sergey Levine , Chelsea Finn

While Graph Neural Network (GNN) has shown superiority in learning node representations of homogeneous graphs, leveraging GNN on heterogeneous graphs remains a challenging problem. The dominating reason is that GNN learns node…

Social and Information Networks · Computer Science 2020-09-22 Ziyue Qiao , Pengyang Wang , Yanjie Fu , Yi Du , Pengfei Wang , Yuanchun Zhou

Graph neural networks (GNNs) is widely used to learn a powerful representation of graph-structured data. Recent work demonstrates that transferring knowledge from self-supervised tasks to downstream tasks could further improve graph…

Machine Learning · Computer Science 2021-07-21 Xueting Han , Zhenhuan Huang , Bang An , Jing Bai

In conventional distributed learning over a network, multiple agents collaboratively build a common machine learning model. However, due to the underlying non-i.i.d. data distribution among agents, the unified learning model becomes…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-28 Zhuojun Tian , Zhaoyang Zhang , Zhaohui Yang , Richeng Jin , Huaiyu Dai