English
Related papers

Related papers: StairwayGraphNet for Inter- and Intra-modality Mul…

200 papers

Recent advances in multimodal single-cell technologies have enabled simultaneous acquisitions of multiple omics data from the same cell, providing deeper insights into cellular states and dynamics. However, it is challenging to learn the…

Machine Learning · Computer Science 2022-11-08 Hongzhi Wen , Jiayuan Ding , Wei Jin , Yiqi Wang , Yuying Xie , Jiliang Tang

Multi-domain graph pre-training is a crucial step in constructing foundational graph models with cross-domain generalization capabilities. However, existing methods predominantly rely on jointly training all source domain graphs, resulting…

Machine Learning · Computer Science 2026-05-26 Ziyu Zheng , Yaming Yang , Ziyu Guan , Wei Zhao , Xinyan Huang

Graph topology inference, i.e., learning graphs from a given set of nodal observations, is a significant task in many application domains. Existing approaches are mostly limited to learning a single graph assuming that the observed data is…

Signal Processing · Electrical Eng. & Systems 2024-01-26 Abdullah Karaaslanli , Selin Aviyente

Retrieving gene functional networks from knowledge databases presents a challenge due to the mismatch between disease networks and subtype-specific variations. Current solutions, including statistical and deep learning methods, often fail…

Machine Learning · Computer Science 2025-02-25 Ziwei Yang , Zheng Chen , Xin Liu , Rikuto Kotoge , Peng Chen , Yasuko Matsubara , Yasushi Sakurai , Jimeng Sun

-Background. Network neuroscience examines the brain as a complex system represented by a network (or connectome), providing deeper insights into the brain morphology and function, allowing the identification of atypical brain connectivity…

Neurons and Cognition · Quantitative Biology 2020-09-01 Mert Lostar , Islem Rekik

With the recent technological advances, biological datasets, often represented by networks (i.e., graphs) of interacting entities, proliferate with unprecedented complexity and heterogeneity. Although modern network science opens new…

Social and Information Networks · Computer Science 2021-04-09 Islem Rekik , Mustafa Burak Gurbuz

Multimodal data plays a critical role in web-based recommendation systems, where information from diverse modalities such as vision and text enhances representation learning. However, real-world multimodal datasets often suffer from…

Information Retrieval · Computer Science 2026-05-04 Yuan Li , Jun Hu , Jiaxin Jiang , Bryan Hooi , Bingsheng He

Recent advances in Multimodal Large Language Models (MLLMs) have significantly enhanced their capabilities; however, their spatial perception abilities remain a notable limitation. To address this challenge, multimodal data synthesis offers…

Computation and Language · Computer Science 2025-11-25 Yida Xue , Zhen Bi , Jinnan Yang , Jungang Lou , Kehai Chen , Min Zhang , Huajun Chen , Ningyu Zhang

Semantic segmentation relying solely on RGB data often struggles in challenging conditions such as low illumination and obscured views, limiting its reliability in critical applications like autonomous driving. To address this, integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Ce Zhang , Zifu Wan , Simon Stepputtis , Katia Sycara , Yaqi Xie

Federated graph learning (FGL) enables collaborative training on graph data across multiple clients. As graph data increasingly contain multimodal node attributes such as text and images, multimodal federated graph learning (MM-FGL) has…

Machine Learning · Computer Science 2026-05-13 Zekai Chen , Xun Wu , Xunkai Li , Yihan Sun , Rong-Hua Li , Guoren Wang

A morphological brain graph depicting a connectional fingerprint is of paramount importance for charting brain dysconnectivity patterns. Such data often has missing observations due to various reasons such as time-consuming and incomplete…

Social and Information Networks · Computer Science 2024-10-02 Oytun Demirbilek , Tingying Peng , Alaa Bessadok

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while…

Information Retrieval · Computer Science 2026-04-08 Sijun Dai , Qiang Huang , Xiaoxing You , Jun Yu

Graph anomaly detection technology has broad applications in financial fraud and risk control. However, existing graph anomaly detection methods often face significant challenges when dealing with complex and variable abnormal patterns, as…

Machine Learning · Computer Science 2025-12-30 Qingyue Cao , Bo Jin , Changwei Gong , Xin Tong , Wenzheng Li , Xiaodong Zhou

Understanding the dynamic reorganization of brain networks is critical for predicting cognitive decline, neurological progression, and individual variability in clinical outcomes. This work proposes a multimodal graph neural network…

Machine Learning · Computer Science 2026-02-11 Preksha Girish , Rachana Mysore , Kiran K. N. , Hiranmayee R. , Shipra Prashanth , Shrey Kumar

In this paper, we focus on image inpainting task, aiming at recovering the missing area of an incomplete image given the context information. Recent development in deep generative models enables an efficient end-to-end framework for image…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Yuhang Song , Chao Yang , Yeji Shen , Peng Wang , Qin Huang , C. -C. Jay Kuo

Graph generation is a crucial task in many fields, including network science and bioinformatics, as it enables the creation of synthetic graphs that mimic the properties of real-world networks for various applications. Graph Generative…

Machine Learning · Computer Science 2026-01-21 Salvatore Romano , Marco Grassia , Giuseppe Mangioni

While Graph Neural Network (GNN) has shown superiority in learning node representations of homogeneous graphs, leveraging GNN on heterogeneous graphs remains a challenging problem. The dominating reason is that GNN learns node…

Social and Information Networks · Computer Science 2020-09-22 Ziyue Qiao , Pengyang Wang , Yanjie Fu , Yi Du , Pengfei Wang , Yuanchun Zhou

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Multimodal MRI offers complementary multi-scale information to characterize the brain structure. However, it remains challenging to effectively integrate multimodal MRI while achieving neuroscience interpretability. Here we propose to use…

Neurons and Cognition · Quantitative Biology 2025-12-15 Chengzhi Xia , Jianwei Chen , Yixuan Jiang , Qi Yan , Chao Li

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao