English
Related papers

Related papers: TMTE: Effective Multimodal Graph Learning with Tas…

200 papers

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

Computation and Language · Computer Science 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Representation learning on text-attributed graphs (TAGs), where nodes are represented by textual descriptions, is crucial for textual and relational knowledge systems and recommendation systems. Currently, state-of-the-art embedding methods…

Computation and Language · Computer Science 2024-12-24 Yi Fang , Dongzhe Fan , Sirui Ding , Ninghao Liu , Qiaoyu Tan

Text-attributed graphs (TAGs) present unique challenges in representation learning by requiring models to capture both the semantic richness of node-associated texts and the structural dependencies of the graph. While graph neural networks…

Computation and Language · Computer Science 2026-05-26 Azadeh Beiranvand , Seyed Mehdi Vahidipour

Graphs with abundant attributes are essential in modeling interconnected entities and enhancing predictions across various real-world applications. Traditional Graph Neural Networks (GNNs) often require re-training for different graph tasks…

Computation and Language · Computer Science 2026-05-26 Yanchao Tan , Hang Lv , Pengxiang Zhan , Shiping Wang , Carl Yang

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the…

Machine Learning · Statistics 2023-08-23 Xingyue Pu , Tianyue Cao , Xiaoyun Zhang , Xiaowen Dong , Siheng Chen

Knowledge graphs (KGs) play a key role in promoting various multimedia and AI applications. However, with the explosive growth of multi-modal information, traditional knowledge graph completion (KGC) models cannot be directly applied. This…

Multimedia · Computer Science 2025-05-29 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Chengfeng Dou , Yuanpeng He , Xuan Zhang , Haiyan Zhao

Multimodal named entity recognition (MNER) and multimodal relation extraction (MRE) are two fundamental subtasks in the multimodal knowledge graph construction task. However, the existing methods usually handle two tasks independently,…

Computation and Language · Computer Science 2023-02-21 Li Yuan , Yi Cai , Jin Wang , Qing Li

Multi-modal Knowledge Graph Completion (MMKGC) aims to uncover hidden world knowledge in multimodal knowledge graphs by leveraging both multimodal and structural entity information. However, the inherent imbalance in multimodal knowledge…

Artificial Intelligence · Computer Science 2025-07-29 Lijian Li

Multimodal attributed graphs (MAGs) combine multimodal node attributes with structured relations. However, existing methods usually perform shared message passing on a single graph and implicitly assume that the same neighbors are equally…

Machine Learning · Computer Science 2026-04-15 Yilong Zuo , Xunkai Li , Zhihan Zhang , Ronghua Li , Guoren Wang

As multimodal LLM-driven agents advance in autonomy and generalization, traditional static datasets face inherent scalability limitations and are insufficient for fully assessing their capabilities in increasingly complex and diverse tasks.…

Computation and Language · Computer Science 2026-03-06 Yurun Chen , Xavier Hu , Yuhan Liu , Ziqi Wang , Zeyi Liao , Lin Chen , Feng Wei , Yuxi Qian , Bo Zheng , Keting Yin , Shengyu Zhang

Given the large volume of side information from different modalities, multimodal recommender systems have become increasingly vital, as they exploit richer semantic information beyond user-item interactions. Recent works highlight that…

Information Retrieval · Computer Science 2024-12-17 Junjie Huang , Jiarui Qin , Yong Yu , Weinan Zhang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in representing and understanding diverse modalities. However, they typically focus on modality alignment in a pairwise manner while overlooking structural…

Machine Learning · Computer Science 2025-06-13 Jiajin Liu , Dongzhe Fan , Jiacheng Shen , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Recent years have witnessed the remarkable success of applying Graph machine learning (GML) to node/graph classification and link prediction. However, edge classification task that enjoys numerous real-world applications such as social…

Machine Learning · Computer Science 2024-06-19 Xueqi Cheng , Yu Wang , Yunchao Liu , Yuying Zhao , Charu C. Aggarwal , Tyler Derr

Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis. Prevailing LLM-based graph methods excel in adapting LLMs to text-rich graphs, wherein node attributes are text descriptions.…

Artificial Intelligence · Computer Science 2025-06-04 Dongzhe Fan , Yi Fang , Jiajin Liu , Djellel Difallah , Qiaoyu Tan

In recent years, continual learning (CL) techniques have made significant progress in learning from streaming data while preserving knowledge across sequential tasks, particularly in the realm of euclidean data. To foster fair evaluation…

Machine Learning · Computer Science 2024-06-10 Tianqi Zhao , Alan Hanjalic , Megha Khosla

Transformers have revolutionized performance in Natural Language Processing and Vision, paving the way for their integration with Graph Neural Networks (GNNs). One key challenge in enhancing graph transformers is strengthening the…

Machine Learning · Computer Science 2026-01-09 Yun Young Choi , Sun Woo Park , Minho Lee , Youngho Woo

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types of information,…

Computation and Language · Computer Science 2023-10-11 Qian Li , Cheng Ji , Shu Guo , Zhaoji Liang , Lihong Wang , Jianxin Li

Emotion-Cause Pair Extraction (ECPE) aims to extract all emotion clauses and their corresponding cause clauses from a document. Existing approaches tackle this task through multi-task learning (MTL) framework in which the two subtasks…

Computation and Language · Computer Science 2023-06-08 Bowen Xing , Ivor W. Tsang

Heterogeneous graphs generally refers to graphs with different types of nodes and edges. A common approach for extracting useful information from heterogeneous graphs is to use meta-graphs, which can be seen as a special kind of directed…

Machine Learning · Computer Science 2023-09-04 Hansi Yang , Peiyu Zhang , Quanming Yao

Unsupervised multimodal change detection is a practical and challenging topic that can play an important role in time-sensitive emergency applications. To address the challenge that multimodal remote sensing images cannot be directly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Hongruixuan Chen , Naoto Yokoya , Chen Wu , Bo Du