English
Related papers

Related papers: Graph Foundation Models: Concepts, Opportunities a…

200 papers

To develop a preliminary understanding towards Graph Foundation Models, we study the extent to which pretrained Graph Neural Networks can be applied across datasets, an effort requiring to be agnostic to dataset-specific features and their…

Graphs are widely used as a popular representation of the network structure of connected data. Graph data can be found in a broad spectrum of application domains such as social systems, ecosystems, biological networks, knowledge graphs, and…

Machine Learning · Computer Science 2021-05-04 Feng Xia , Ke Sun , Shuo Yu , Abdul Aziz , Liangtian Wan , Shirui Pan , Huan Liu

Multimodal models are expected to be a critical component to future advances in artificial intelligence. This field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural…

Computation and Language · Computer Science 2024-06-11 Sai Munikoti , Ian Stewart , Sameera Horawalavithana , Henry Kvinge , Tegan Emerson , Sandra E Thompson , Karl Pazdernik

Graph learning has rapidly evolved into a critical subfield of machine learning and artificial intelligence (AI). Its development began with early graph-theoretic methods, gaining significant momentum with the advent of graph neural…

Machine Learning · Computer Science 2025-11-10 Feng Xia , Ciyuan Peng , Jing Ren , Falih Gozi Febrinanto , Renqiang Luo , Vidya Saikrishna , Shuo Yu , Xiangjie Kong

Graph Neural Networks (GNNs) have become the leading paradigm for learning on (static) graph-structured data. However, many real-world systems are dynamic in nature, since the graph and node/edge attributes change over time. In recent…

Graph neural networks (GNN) have shown outstanding applications in many fields where data is fundamentally represented as graphs (e.g., chemistry, biology, recommendation systems). In this vein, communication networks comprise many…

Graphs provide a natural description of the complex relationships among objects, and play a pivotal role in communications, transportation, social computing, the life sciences, etc. Currently, there is strong agreement that Graph Foundation…

Machine Learning · Computer Science 2026-03-24 Philip S. Yu , Li Sun

Foundation models, first introduced in 2021, refer to large-scale pretrained models (e.g., large language models (LLMs) and vision-language models (VLMs)) that learn from extensive unlabeled datasets through unsupervised methods, enabling…

Graph Neural Networks (GNNs) have emerged as a powerful tool to capture intricate network patterns, achieving success across different domains. However, existing GNNs require careful domain-specific architecture designs and training from…

Machine Learning · Computer Science 2025-05-30 Jingzhe Liu , Haitao Mao , Zhikai Chen , Bingheng Li , Wenqi Fan , Mingxuan Ju , Tong Zhao , Neil Shah , Jiliang Tang

Artificial intelligence (AI) has emerged as a pivotal enabler for next-generation wireless communication systems. However, conventional AI-based models encounter several limitations, such as heavy reliance on labeled data, limited…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Jun Jiang , Yuan Gao , Xinyi Wu , Shugong Xu

As data continues to grow in volume and complexity across domains such as finance, manufacturing, and healthcare, effective anomaly detection is essential for identifying irregular patterns that may signal critical issues. Recently,…

Machine Learning · Computer Science 2025-06-16 Jing Ren , Tao Tang , Hong Jia , Ziqi Xu , Haytham Fayek , Xiaodong Li , Suyu Ma , Xiwei Xu , Feng Xia

Graph Neural Networks (GNNs) have recently emerged as a robust framework for graph-structured data. They have been applied to many problems such as knowledge graph analysis, social networks recommendation, and even Covid19 detection and…

Software Engineering · Computer Science 2022-01-04 Thanh-Dat Nguyen , Thanh Le-Cong , ThanhVu H. Nguyen , Xuan-Bach D. Le , Quyet-Thang Huynh

Graphs are ubiquitous in nature and can therefore serve as models for many practical but also theoretical problems. For this purpose, they can be defined as many different types which suitably reflect the individual contexts of the…

Machine Learning · Computer Science 2023-04-27 Josephine M. Thomas , Alice Moallemy-Oureh , Silvia Beddar-Wiesing , Clara Holzhüter

Mechanics-related problems often present unique challenges in achieving accurate geometric and physical representations, particularly for non-uniform structures. Graph neural networks (GNNs) have emerged as a promising tool to tackle these…

Machine Learning · Computer Science 2024-07-17 Yingxue Zhao , Haoran Li , Haosu Zhou , Hamid Reza Attar , Tobias Pfaff , Nan Li

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

Machine Learning · Computer Science 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

Although data that can be naturally represented as graphs is widespread in real-world applications across diverse industries, popular graph ML benchmarks for node property prediction only cover a surprisingly narrow set of data domains, and…

Machine Learning · Computer Science 2026-05-05 Gleb Bazhenov , Oleg Platonov , Liudmila Prokhorenkova

Foundation models are pretrained on large-scale corpora to learn generalizable patterns across domains and tasks -- such as contours, textures, and edges in images, or tokens and sentences in text. In contrast, discovering such generalities…

Machine Learning · Computer Science 2025-05-27 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Nitesh V Chawla , Chuxu Zhang , Yanfang Ye

Foundation models can be disruptive for future AI development by scaling up deep learning in terms of model size and training data's breadth and size. These models achieve state-of-the-art performance (often through further adaptation) on a…

Artificial Intelligence · Computer Science 2022-12-20 Johannes Schneider

Graphs are important data representations for describing objects and their relationships, which appear in a wide diversity of real-world scenarios. As one of a critical problem in this area, graph generation considers learning the…

Machine Learning · Computer Science 2022-10-06 Xiaojie Guo , Liang Zhao

The advent of foundation models, which are pre-trained on vast datasets, has ushered in a new era of computer vision, characterized by their robustness and remarkable zero-shot generalization capabilities. Mirroring the transformative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Xu Liu , Tong Zhou , Yuanxin Wang , Yuping Wang , Qinjingwen Cao , Weizhi Du , Yonghuan Yang , Junjun He , Yu Qiao , Yiqing Shen