English
Related papers

Related papers: Bridging Input Feature Spaces Towards Graph Founda…

200 papers

Foundation models have emerged as critical components in a variety of artificial intelligence applications, and showcase significant success in natural language processing and several other domains. Meanwhile, the field of graph machine…

Machine Learning · Computer Science 2025-03-11 Jiawei Liu , Cheng Yang , Zhiyuan Lu , Junze Chen , Yibo Li , Mengmei Zhang , Ting Bai , Yuan Fang , Lichao Sun , Philip S. Yu , Chuan Shi

Finding a new mathematical representations for graph, which allows direct comparison between different graph structures, is an open-ended research direction. Having such a representation is the first prerequisite for a variety of machine…

Methodology · Statistics 2014-04-21 Anshumali Shrivastava , Ping Li

Progress on graph foundation models is hindered by benchmark practices that conflate the contributions of node features and graph structure, making it hard to tell whether a model actually learns from connectivity, or whether it even needs…

Machine Learning · Computer Science 2026-05-08 Richard von Moos , Mathieu Alain , Bastian Rieck

There exist many problem domains where the interpretability of neural network models is essential for deployment. Here we introduce a recurrent architecture composed of input-switched affine transformations - in other words an RNN without…

Artificial Intelligence · Computer Science 2017-06-14 Jakob N. Foerster , Justin Gilmer , Jan Chorowski , Jascha Sohl-Dickstein , David Sussillo

The task of fully inductive link prediction in knowledge graphs has gained significant attention, with various graph neural networks being proposed to address it. This task presents greater challenges than traditional inductive link…

Machine Learning · Computer Science 2025-01-15 Jincheng Zhou , Yucheng Zhang , Jianfei Gao , Yangze Zhou , Bruno Ribeiro

Data inconsistency and bias are inevitable among different facial expression recognition (FER) datasets due to subjective annotating process and different collecting conditions. Recent works resort to adversarial mechanisms that learn…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Yuan Xie , Tianshui Chen , Tao Pu , Hefeng Wu , Liang Lin

We introduce a novel embedding method diverging from conventional approaches by operating within function spaces of finite dimension rather than finite vector space, thus departing significantly from standard knowledge graph embedding…

Machine Learning · Statistics 2024-09-25 Louis Mozart Kamdem Teyou , Caglar Demir , Axel-Cyrille Ngonga Ngomo

By recursively summing node features over entire neighborhoods, spatial graph convolution operators have been heralded as key to the success of Graph Neural Networks (GNNs). Yet, despite the multiplication of GNN methods across tasks and…

Machine Learning · Computer Science 2022-07-14 Sowon Jeong , Claire Donnat

Graph convolution networks (GCNs) have been enormously successful in learning representations over several graph-based machine learning tasks. Specific to learning rich node representations, most of the methods have solely relied on the…

Machine Learning · Computer Science 2022-11-03 Ashish Tiwari , Sresth Tosniwal , Shanmuganathan Raman

Graph neural networks (GNNs) have become increasingly popular in modeling graph-structured data due to their ability to learn node representations by aggregating local structure information. However, it is widely acknowledged that the test…

Machine Learning · Computer Science 2024-03-07 Donglin Xia , Xiao Wang , Nian Liu , Chuan Shi

With the rising interest in graph representation learning, a variety of approaches have been proposed to effectively capture a graph's properties. While these approaches have improved performance in graph machine learning tasks compared to…

Machine Learning · Computer Science 2019-10-09 Antonia Gogoglou , C. Bayan Bruss , Keegan E. Hines

Many modern learning tasks require models that can take inputs of varying sizes. Consequently, dimension-independent architectures have been proposed for domains where the inputs are graphs, sets, and point clouds. Recent work on graph…

Machine Learning · Computer Science 2026-02-12 Eitan Levin , Yuxin Ma , Mateo Díaz , Soledad Villar

Graphical models have been popularly used for capturing conditional independence structure in multivariate data, which are often built upon independent and identically distributed observations, limiting their applicability to complex…

Methodology · Statistics 2025-07-03 Yuwen Wang , Changyu Liu , Xin He , Junhui Wang

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

Machine Learning · Computer Science 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

Graph representation learning has recently been applied to a broad spectrum of problems ranging from computer graphics and chemistry to high energy physics and social media. The popularity of graph neural networks has sparked interest, both…

Machine Learning · Computer Science 2020-11-05 Fabrizio Frasca , Emanuele Rossi , Davide Eynard , Ben Chamberlain , Michael Bronstein , Federico Monti

Transfer learning aims to enhance performance on a target task by using knowledge from related tasks. However, when the source and target tasks are not closely aligned, it can lead to reduced performance, known as negative transfer. Unlike…

Machine Learning · Computer Science 2024-05-07 Zehong Wang , Zheyuan Zhang , Chuxu Zhang , Yanfang Ye

We propose a generalization of transformer neural network architecture for arbitrary graphs. The original transformer was designed for Natural Language Processing (NLP), which operates on fully connected graphs representing all connections…

Machine Learning · Computer Science 2021-01-26 Vijay Prakash Dwivedi , Xavier Bresson

Recent advances in CV and NLP have inspired researchers to develop general-purpose graph foundation models through pre-training across diverse domains. However, a fundamental challenge arises from the substantial differences in graph…

Social and Information Networks · Computer Science 2025-06-02 Shuo Wang , Bokui Wang , Zhixiang Shen , Boyan Deng , Zhao Kang

Annotating histopathological images is a time-consuming andlabor-intensive process, which requires broad-certificated pathologistscarefully examining large-scale whole-slide images from cells to tissues.Recent frontiers of transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Dou Xu , Chang Cai , Chaowei Fang , Bin Kong , Jihua Zhu , Zhongyu Li

We show that standard Transformers without graph-specific modifications can lead to promising results in graph learning both in theory and practice. Given a graph, we simply treat all nodes and edges as independent tokens, augment them with…

Machine Learning · Computer Science 2022-10-25 Jinwoo Kim , Tien Dat Nguyen , Seonwoo Min , Sungjun Cho , Moontae Lee , Honglak Lee , Seunghoon Hong