English
Related papers

Related papers: RoleMAG: Learning Neighbor Roles in Multimodal Gra…

200 papers

To effectively engage in human society, the ability to adapt, filter information, and make informed decisions in ever-changing situations is critical. As robots and intelligent agents become more integrated into human life, there is a…

Artificial Intelligence · Computer Science 2025-11-13 Mingyang Mao , Mariela M. Perez-Cabarcas , Utteja Kallakuri , Nicholas R. Waytowich , Xiaomin Lin , Tinoosh Mohsenin

Workshop version accepted at KDD 2025 (AI4SupplyChain). Connecting an ever-expanding catalogue of products with suitable manufacturers and suppliers is critical for resilient, efficient global supply chains, yet traditional methods struggle…

Machine Learning · Computer Science 2025-08-14 Yunqing Li , Zixiang Tang , Jiaying Zhuang , Zhenyu Yang , Farhad Ameri , Jianbang Zhang

Learning informative representations (aka. embeddings) of users and items is the core of modern recommender systems. Previous works exploit user-item relationships of one-hop neighbors in the user-item interaction graph to improve the…

Information Retrieval · Computer Science 2021-03-02 Jinbo Song , Chao Chang , Fei Sun , Xinbo Song , Peng Jiang

Federated graph learning (FGL) enables collaborative training on graph data across multiple clients. As graph data increasingly contain multimodal node attributes such as text and images, multimodal federated graph learning (MM-FGL) has…

Machine Learning · Computer Science 2026-05-13 Zekai Chen , Xun Wu , Xunkai Li , Yihan Sun , Rong-Hua Li , Guoren Wang

Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zhiyuan Yan , Peng Sun , Yubo Lang , Shuo Du , Shanzhuo Zhang , Wei Wang , Lei Liu

Multimodal graphs, where nodes contain heterogeneous features such as images and text, are increasingly common in real-world applications. Effectively learning on such graphs requires both adaptive intra-modal message passing and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xiaobin Hong , Mingkai Lin , Xiaoli Wang , Chaoqun Wang , Wenzhong Li

Graph anomaly detection (GAD) aims to identify irregular nodes or structures in attributed graphs. Neighbor information, which reflects both structural connectivity and attribute consistency with surrounding nodes, is essential for…

Machine Learning · Computer Science 2026-03-31 Qing Qing , Huafei Huang , Mingliang Hou , Renqiang Luo , Mohsen Guizani

Unsupervised multimodal change detection is a practical and challenging topic that can play an important role in time-sensitive emergency applications. To address the challenge that multimodal remote sensing images cannot be directly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Hongruixuan Chen , Naoto Yokoya , Chen Wu , Bo Du

Graph representation learning is to learn universal node representations that preserve both node attributes and structural information. The derived node representations can be used to serve various downstream tasks, such as node…

Machine Learning · Computer Science 2020-11-16 Yuxiang Ren , Bo Liu , Chao Huang , Peng Dai , Liefeng Bo , Jiawei Zhang

Multi-robot systems of increasing size and complexity are used to solve large-scale problems, such as area exploration and search and rescue. A key decision in human-robot teaming is dividing a multi-robot system into teams to address…

Robotics · Computer Science 2020-04-09 Brian Reily , Christopher Reardon , Hao Zhang

Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are…

Machine Learning · Computer Science 2022-04-19 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv , Hui Xiong

Automatic surgical gesture recognition is fundamentally important to enable intelligent cognitive assistance in robotic surgery. With recent advancement in robot-assisted minimally invasive surgery, rich information including surgical…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Yonghao Long , Jie Ying Wu , Bo Lu , Yueming Jin , Mathias Unberath , Yun-Hui Liu , Pheng Ann Heng , Qi Dou

Graph Neural Networks (GNNs) have been widely used for the representation learning of various structured graph data. While promising, most existing GNNs oversimplified the complexity and diversity of the edges in the graph, and thus…

Machine Learning · Computer Science 2021-10-07 Hao Peng , Ruitong Zhang , Yingtong Dou , Renyu Yang , Jingyi Zhang , Philip S. Yu

This paper introduces a novel method for determining the best room to place an object in, for embodied scene rearrangement. While state-of-the-art approaches rely on large language models (LLMs) or reinforcement learned (RL) policies for…

Different graph generalizations have been recently used in an ad-hoc manner to represent multilayer networks, i.e. systems formed by distinct layers where each layer can be seen as a network. Similar constructions have also been used to…

Discrete Mathematics · Computer Science 2016-09-30 Klaus Wehmuth , Éric Fleury , Artur Ziviani

Human communication is multimodal in nature; it is through multiple modalities such as language, voice, and facial expressions, that opinions and emotions are expressed. Data in this domain exhibits complex multi-relational and temporal…

Computation and Language · Computer Science 2021-04-30 Jianing Yang , Yongxin Wang , Ruitao Yi , Yuying Zhu , Azaan Rehman , Amir Zadeh , Soujanya Poria , Louis-Philippe Morency

This paper proposes a learning model, based on rank-fusion graphs, for general applicability in multimodal prediction tasks, such as multimodal regression and image classification. Rank-fusion graphs encode information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Icaro Cavalcante Dourado , Salvatore Tabbone , Ricardo da Silva Torres

We present DYMAG, a graph neural network based on a novel form of message aggregation. Standard message-passing neural networks, which often aggregate local neighbors via mean-aggregation, can be regarded as convolving with a simple…

Learning to cooperate is crucially important in multi-agent environments. The key is to understand the mutual interplay between agents. However, multi-agent environments are highly dynamic, where agents keep moving and their neighbors…

Machine Learning · Computer Science 2020-02-12 Jiechuan Jiang , Chen Dun , Tiejun Huang , Zongqing Lu

Heterogeneous graph neural networks aim to discover discriminative node embeddings and relations from multi-relational networks.One challenge of heterogeneous graph learning is the design of learnable meta-paths, which significantly…

Machine Learning · Computer Science 2023-04-19 Zhaoliang Chen , Zhihao Wu , Luying Zhong , Claudia Plant , Shiping Wang , Wenzhong Guo