English
Related papers

Related papers: Topology Only Pre-Training: Towards Generalised Mu…

200 papers

Graph serves as a powerful tool for modeling data that has an underlying structure in non-Euclidean space, by encoding relations as edges and entities as nodes. Despite developments in learning from graph-structured data over the years, one…

Machine Learning · Computer Science 2022-12-20 Tianxiang Zhao , Dongsheng Luo , Xiang Zhang , Suhang Wang

Graph representation learning, a critical step in graph-centric tasks, has seen significant advancements. Earlier techniques often operate in an end-to-end setting, which heavily rely on the availability of ample labeled data. This…

Machine Learning · Computer Science 2024-09-23 Xingtong Yu , Yuan Fang , Zemin Liu , Yuxia Wu , Zhihao Wen , Jianyuan Bo , Xinming Zhang , Steven C. H. Hoi

We study the problem of learning features through self-supervision that are generalisable to multiple graphs. State-of-the-art graph self-supervision restricts training to only one graph, resulting in graph-specific models that are…

Machine Learning · Computer Science 2024-07-31 Laya Das , Sai Munikoti , Nrushad Joshi , Mahantesh Halappanavar

Unsupervised node representation learning aims to obtain meaningful node embeddings without relying on node labels. To achieve this, graph convolution, which aggregates information from neighboring nodes, is commonly employed to encode node…

Machine Learning · Computer Science 2025-12-18 Sunwoo Kim , Soo Yong Lee , Kyungho Kim , Hyunjin Hwang , Jaemin Yoo , Kijung Shin

The pre-training on the graph neural network model can learn the general features of large-scale networks or networks of the same type by self-supervised methods, which allows the model to work even when node labels are missing. However,…

Machine Learning · Computer Science 2022-04-19 Ke-jia Chen , Jiajun Zhang , Linpu Jiang , Yunyun Wang , Yuxuan Dai

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Link Prediction (LP) is a critical task in graph machine learning. While Graph Neural Networks (GNNs) have significantly advanced LP performance recently, existing methods face key challenges including limited supervision from sparse…

Machine Learning · Computer Science 2025-08-07 Yu Song , Zhigang Hua , Harry Shomer , Yan Xie , Jingzhe Liu , Bo Long , Hui Liu

Graph pre-training has been concentrated on graph-level tasks involving small graphs (e.g., molecular graphs) or learning node representations on a fixed graph. Extending graph pre-trained models to web-scale graphs with billions of nodes…

Machine Learning · Computer Science 2025-11-07 Yufei He , Zhenyu Hou , Yukuo Cen , Jun Hu , Feng He , Xu Cheng , Jie Tang , Bryan Hooi

Transfer learning is widely used to adapt large pretrained models to new tasks with only a small amount of new data. However, a challenge persists -- the features from the original task often do not fully cover what is needed for unseen…

Machine Learning · Computer Science 2026-02-10 Xingyu Alice Yang , Jianyu Zhang , Léon Bottou

Generalized from image and language translation, graph translation aims to generate a graph in the target domain by conditioning an input graph in the source domain. This promising topic has attracted fast-increasing attention recently.…

Graph is powerful for representing various types of real-world data. The topology (edges' presence) and edges' features of a graph decides the message passing mechanism among vertices within the graph. While most existing approaches only…

Machine Learning · Computer Science 2022-11-23 Siyang Song , Yuxin Song , Cheng Luo , Zhiyuan Song , Selim Kuzucu , Xi Jia , Zhijiang Guo , Weicheng Xie , Linlin Shen , Hatice Gunes

Annotating histopathological images is a time-consuming andlabor-intensive process, which requires broad-certificated pathologistscarefully examining large-scale whole-slide images from cells to tissues.Recent frontiers of transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Dou Xu , Chang Cai , Chaowei Fang , Bin Kong , Jihua Zhu , Zhongyu Li

Recently, the pretrain-finetuning paradigm has attracted tons of attention in graph learning community due to its power of alleviating the lack of labels problem in many real-world applications. Current studies use existing techniques, such…

Machine Learning · Computer Science 2022-05-11 Jiying Zhang , Xi Xiao , Long-Kai Huang , Yu Rong , Yatao Bian

Node classification on text-attributed graphs (TAGs) is a fundamental task with broad applications in citation analysis, social networks, and recommendation systems. Current GNN-based approaches suffer from shallow text encoding and heavy…

Computation and Language · Computer Science 2026-04-21 Ziqing Wang , Kaize Ding

The published literature on topology optimization has exploded over the last two decades to include methods that use shape and topological derivatives or evolutionary algorithms formulated on various geometric representations and…

Machine Learning · Computer Science 2021-02-16 MohammadMahdi Behzadi , Horea T. Ilies

Graphs are a central representation in biomedical research, capturing molecular interaction networks, gene regulatory circuits, cell--cell communication maps, and knowledge graphs. Despite their importance, currently there is not a broadly…

Machine Learning · Computer Science 2026-04-09 Sakib Mostafa , Lei Xing , Md. Tauhidul Islam

Graph convolution (GConv) is a widely used technique that has been demonstrated to be extremely effective for graph learning applications, most notably node categorization. On the other hand, many GConv-based models do not quantify the…

Machine Learning · Computer Science 2022-07-27 Zhiqian Chen , Zonghan Zhang

Recently, research on Text-Attributed Graphs (TAGs) has gained significant attention due to the prevalence of free-text node features in real-world applications and the advancements in Large Language Models (LLMs) that bolster TAG…

Machine Learning · Computer Science 2025-02-25 Yun Zhu , Haizhou Shi , Xiaotang Wang , Yongchao Liu , Yaoke Wang , Boci Peng , Chuntao Hong , Siliang Tang

Predicting drug response in patients from preclinical data remains a major challenge in precision oncology due to the substantial biological gap between in vitro cell lines and patient tumors. Rather than aiming to improve absolute in vitro…

Machine Learning · Computer Science 2026-03-18 Camille Jimenez Cortes , Philippe Lalanda , German Vega

Pre-training has shown success in different areas of machine learning, such as Computer Vision (CV), Natural Language Processing (NLP) and medical imaging. However, it has not been fully explored for clinical data analysis. Even though an…

Machine Learning · Computer Science 2022-06-10 Chantal Pellegrini , Anees Kazi , Nassir Navab