English
Related papers

Related papers: OpenMAG: A Comprehensive Benchmark for Multimodal-…

200 papers

Graph Machine Learning is essential for understanding and analyzing relational data. However, privacy-sensitive applications demand the ability to efficiently remove sensitive information from trained graph neural networks (GNNs), avoiding…

Machine Learning · Computer Science 2025-01-07 Bowen Fan , Yuming Ai , Xunkai Li , Zhilin Guo , Rong-Hua Li , Guoren Wang

Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis. Prevailing LLM-based graph methods excel in adapting LLMs to text-rich graphs, wherein node attributes are text descriptions.…

Artificial Intelligence · Computer Science 2025-06-04 Dongzhe Fan , Yi Fang , Jiajin Liu , Djellel Difallah , Qiaoyu Tan

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

Attributed Graph Clustering (AGC) is a fundamental unsupervised task that integrates structural topology and node attributes to uncover latent patterns in graph-structured data. Despite its significance in industrial applications such as…

Machine Learning · Computer Science 2026-02-10 Yunhui Liu , Pengyu Qiu , Yu Xing , Yongchao Liu , Peng Du , Chuntao Hong , Jiajun Zheng , Tao Zheng , Tieke He

Graph domain adaptation models are widely adopted in cross-network learning tasks, with the aim of transferring labeling or structural knowledge. Currently, there mainly exist two limitations in evaluating graph domain adaptation models. On…

Artificial Intelligence · Computer Science 2023-07-24 Boshen Shi , Yongqing Wang , Fangda Guo , Jiangli Shao , Huawei Shen , Xueqi Cheng

Graph-based Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs), improving their factual accuracy, adaptability, interpretability, and trustworthiness. A number of…

Information Retrieval · Computer Science 2026-04-28 Yingli Zhou , Yaodong Su , Youran Sun , Shu Wang , Taotao Wang , Runyuan He , Yongwei Zhang , Sicong Liang , Xilin Liu , Yuchi Ma , Yixiang Fang

Text-Attributed Graphs (TAGs) enhance graph structures with natural language descriptions, enabling detailed representation of data and their relationships across a broad spectrum of real-world scenarios. Despite the potential for deeper…

Machine Learning · Computer Science 2024-05-28 Zheng Zhang , Yuntong Hu , Bo Pan , Chen Ling , Liang Zhao

Multimodal Large Language Models (MLLMs) have made significant strides in visual understanding and generation tasks. However, generating interleaved image-text content remains a challenge, which requires integrated multimodal understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Pengfei Zhou , Xiaopeng Peng , Jiajun Song , Chuanhao Li , Zhaopan Xu , Yue Yang , Ziyao Guo , Hao Zhang , Yuqi Lin , Yefei He , Lirui Zhao , Shuo Liu , Tianhua Li , Yuxuan Xie , Xiaojun Chang , Yu Qiao , Wenqi Shao , Kaipeng Zhang

Multi-relational temporal graphs are powerful tools for modeling real-world data, capturing the evolving and interconnected nature of entities over time. Recently, many novel models are proposed for ML on such graphs intensifying the need…

Multimodal learning has gained attention for its capacity to integrate information from different modalities. However, it is often hindered by the multimodal imbalance problem, where certain modality dominates while others remain…

Machine Learning · Computer Science 2025-06-16 Shaoxuan Xu , Menglu Cui , Chengxiang Huang , Hongfa Wang , Di Hu

Irregular data in real-world are usually organized as heterogeneous graphs (HGs) consisting of multiple types of nodes and edges. To explore useful knowledge from real-world data, both the large-scale encyclopedic HG datasets and…

Artificial Intelligence · Computer Science 2023-09-12 Yide Qiu , Shaoxiang Ling , Tong Zhang , Bo Huang , Zhen Cui

The widespread application of graph data in various high-risk scenarios has increased attention to graph anomaly detection (GAD). Faced with real-world graphs that often carry node descriptions in the form of raw text sequences, termed…

Machine Learning · Computer Science 2025-08-04 Yiming Xu , Xu Hua , Zhen Peng , Bin Shi , Jiarun Chen , Xingbo Fu , Song Wang , Bo Dong

With the rapid development of large language models (LLMs) and their integration into large multimodal models (LMMs), there has been impressive progress in zero-shot completion of user-oriented vision-language tasks. However, a gap remains…

Computation and Language · Computer Science 2024-04-16 Fuxiao Liu , Xiaoyang Wang , Wenlin Yao , Jianshu Chen , Kaiqiang Song , Sangwoo Cho , Yaser Yacoob , Dong Yu

The inevitable modality imperfection in real-world scenarios poses significant challenges for Multimodal Sentiment Analysis (MSA). While existing methods tailor reconstruction or joint representation learning strategies to restore missing…

Multimedia · Computer Science 2025-08-05 Hu Zhangfeng , Shi mengxin

We present MEGA-Bench, an evaluation suite that scales multimodal evaluation to over 500 real-world tasks, to address the highly heterogeneous daily use cases of end users. Our objective is to optimize for a set of high-quality data samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Jiacheng Chen , Tianhao Liang , Sherman Siu , Zhengqing Wang , Kai Wang , Yubo Wang , Yuansheng Ni , Wang Zhu , Ziyan Jiang , Bohan Lyu , Dongfu Jiang , Xuan He , Yuan Liu , Hexiang Hu , Xiang Yue , Wenhu Chen

We present a systematic investigation of Multi-modal Retrieval Augmented Multi-modal Generation (M$^2$RAG), a novel task that enables foundation models to process multi-modal web content and generate multi-modal responses, which exhibits…

Computation and Language · Computer Science 2025-05-26 Zi-Ao Ma , Tian Lan , Rong-Cheng Tu , Yong Hu , Yu-Shi Zhu , Tong Zhang , Heyan Huang , Zhijing Wu , Xian-Ling Mao

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very…

Multimedia · Computer Science 2022-11-01 Xuan Yang , Quanjin Tao , Xiao Feng , Donghong Cai , Xiang Ren , Yang Yang

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Different graph generalizations have been recently used in an ad-hoc manner to represent multilayer networks, i.e. systems formed by distinct layers where each layer can be seen as a network. Similar constructions have also been used to…

Discrete Mathematics · Computer Science 2016-09-30 Klaus Wehmuth , Éric Fleury , Artur Ziviani

The systematic analysis of user-generated social media content, especially when enriched with geospatial context, plays a vital role in domains such as disaster management and public opinion monitoring. Although multimodal approaches have…

Social and Information Networks · Computer Science 2026-01-21 Ehsaneddin Jalilian , Bernd Resch