English
Related papers

Related papers: Graph Capsule Aggregation for Unaligned Multimodal…

200 papers

Demystifying the interactions among multiple agents from their past trajectories is fundamental to precise and interpretable trajectory prediction. However, previous works only consider pair-wise interactions with limited relational…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Chenxin Xu , Maosen Li , Zhenyang Ni , Ya Zhang , Siheng Chen

Emotion recognition in conversation (ERC) is a crucial component in affective dialogue systems, which helps the system understand users' emotions and generate empathetic responses. However, most works focus on modeling speaker and…

Computation and Language · Computer Science 2021-07-15 Jingwen Hu , Yuchen Liu , Jinming Zhao , Qin Jin

Recently, graph neural networks have shown the superiority of modeling the complex topological structures in heterogeneous network-based recommender systems. Due to the diverse interactions among nodes and abundant semantics emerging from…

Machine Learning · Computer Science 2022-08-04 Tiankai Gu , Chaokun Wang , Cheng Wu , Jingcao Xu , Yunkai Lou , Changping Wang , Kai Xu , Can Ye , Yang Song

Emotion recognition is a crucial task for human conversation understanding. It becomes more challenging with the notion of multimodal data, e.g., language, voice, and facial expressions. As a typical solution, the global- and the local…

Computation and Language · Computer Science 2024-01-31 Cam-Van Thi Nguyen , Anh-Tuan Mai , The-Son Le , Hai-Dang Kieu , Duc-Trong Le

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

Machine Learning · Computer Science 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li

Traditional approaches in speech emotion recognition, such as LSTM, CNN, RNN, SVM, and MLP, have limitations such as difficulty capturing long-term dependencies in sequential data, capturing the temporal dynamics, and struggling to capture…

Sound · Computer Science 2023-08-10 Samiul Islam , Md. Maksudul Haque , Abu Jobayer Md. Sadat

In this paper, we have used Recurrent Neural Networks to capture and model human motion data and generate motions by prediction of the next immediate data point at each time-step. Our RNN is armed with recently proposed Gated Recurrent…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Mohammad Pezeshki

Knowledge graph reasoning in the fully-inductive setting, where both entities and relations at test time are unseen during training, remains an open challenge. In this work, we introduce GraphOracle, a novel framework that achieves robust…

Machine Learning · Computer Science 2025-12-30 Enjun Du , Siyi Liu , Yongqi Zhang

When engaging in end-to-end graph representation learning with Graph Neural Networks (GNNs), the intricate causal relationships and rules inherent in graph data pose a formidable challenge for the model in accurately capturing authentic…

Machine Learning · Computer Science 2024-06-14 Hang Gao , Peng Qiao , Yifan Jin , Fengge Wu , Jiangmeng Li , Changwen Zheng

Socially-intelligent agents are of growing interest in artificial intelligence. To this end, we need systems that can understand social relationships in diverse social contexts. Inferring the social context in a given visual scene not only…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Arushi Goel , Keng Teck Ma , Cheston Tan

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

Artificial Intelligence · Computer Science 2026-03-11 Xueyao Wan , Hang Yu

This paper proposes a learning model, based on rank-fusion graphs, for general applicability in multimodal prediction tasks, such as multimodal regression and image classification. Rank-fusion graphs encode information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Icaro Cavalcante Dourado , Salvatore Tabbone , Ricardo da Silva Torres

Generating graph structures is a challenging problem due to the diverse representations and complex dependencies among nodes. In this paper, we introduce Graph Variational Recurrent Neural Network (GraphVRNN), a probabilistic autoregressive…

Machine Learning · Computer Science 2019-10-07 Shih-Yang Su , Hossein Hajimirsadeghi , Greg Mori

Models for sequential data such as the recurrent neural network (RNN) often implicitly model a sequence as having a fixed time interval between observations and do not account for group-level effects when multiple sequences are observed. We…

Machine Learning · Computer Science 2018-12-27 Ghazal Fazelnia , Mark Ibrahim , Ceena Modarres , Kevin Wu , John Paisley

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with…

Machine Learning · Computer Science 2025-02-25 Hang Gao , Chenhao Zhang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

This paper addresses the limitations of multi-node perception and delayed scheduling response in distributed systems by proposing a GNN-based multi-node collaborative perception mechanism. The system is modeled as a graph structure.…

Machine Learning · Computer Science 2025-05-23 Wenxuan Zhu , Qiyuan Wu , Tengda Tang , Renzi Meng , Sheng Chai , Xuehui Quan

Graph neural networks (GNNs) provide powerful insights for brain neuroimaging technology from the view of graphical networks. However, most existing GNN-based models assume that the neuroimaging-produced brain connectome network is a…

Machine Learning · Computer Science 2022-09-30 Gen Shi , Yifan Zhu , Wenjin Liu , Quanming Yao , Xuesong Li

We propose ArtSAGENet, a novel multimodal architecture that integrates Graph Neural Networks (GNNs) and Convolutional Neural Networks (CNNs), to jointly learn visual and semantic-based artistic representations. First, we illustrate the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Athanasios Efthymiou , Stevan Rudinac , Monika Kackovic , Marcel Worring , Nachoem Wijnberg

Multivariate time series is prevalent in many scientific and industrial domains. Modeling multivariate signals is challenging due to their long-range temporal dependencies and intricate interactions--both direct and indirect. To confront…

Machine Learning · Computer Science 2023-12-01 Juhyeon Kim , Hyungeun Lee , Seungwon Yu , Ung Hwang , Wooyul Jung , Miseon Park , Kijung Yoon

In this paper, we study the problem of node representation learning with graph neural networks. We present a graph neural network class named recurrent graph neural network (RGNN), that address the shortcomings of prior methods. By using…

Machine Learning · Computer Science 2019-08-27 Binxuan Huang , Kathleen M. Carley