中文
相关论文

相关论文: Multimodal Graph Network Modeling for Human-Object…

200 篇论文

Nowadays, numerous online platforms can be described as multi-modal heterogeneous networks (MMHNs), such as Douban's movie networks and Amazon's product review networks. Accurately categorizing nodes within these networks is crucial for…

机器学习 · 计算机科学 2025-06-23 Jiafan Li , Jiaqi Zhu , Liang Chang , Yilin Li , Miaomiao Li , Yang Wang , Hongan Wang

In this paper, we innovately use graph neural networks (GNNs) to learn a message-passing solution for the inference task of massive multiple multiple-input multiple-output (MIMO) detection in wireless communication. We adopt a graphical…

信号处理 · 电气工程与系统科学 2020-07-14 Andrea Scotti , Nima N. Moghadam , Dong Liu , Karl Gafvert , Jinliang Huang

Recently, diffusion-based recommendation methods have achieved impressive results. However, existing approaches predominantly treat each user's historical interactions as independent training samples, overlooking the potential of…

社会与信息网络 · 计算机科学 2025-04-08 Xuan Zhang , Xiang Deng , Hongxing Yuan , Chunyu Wei , Yushun Fan

Recent human-object interaction detection (HOID) methods highly require prior knowledge from vision-language models (VLMs) to enhance the interaction recognition capabilities. The training strategies and model architectures for connecting…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Junwen Chen , Peilin Xiong , Keiji Yanai

Understanding interactions between humans and objects is one of the fundamental problems in visual classification and an essential step towards detailed scene understanding. Human-object interaction (HOI) detection strives to localize both…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Tiancai Wang , Tong Yang , Martin Danelljan , Fahad Shahbaz Khan , Xiangyu Zhang , Jian Sun

Infrared and visible image fusion has gradually proved to be a vital fork in the field of multi-modality imaging technologies. In recent developments, researchers not only focus on the quality of fused images but also evaluate their…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Jiawei Li , Jiansheng Chen , Jinyuan Liu , Huimin Ma

Graph neural networks (GNNs) are proven effective in extracting complex node and structural information from graph data. While current GNNs perform well in node classification tasks within in-distribution (ID) settings, real-world scenarios…

机器学习 · 计算机科学 2025-05-08 Tao Yin , Chen Zhao , Xiaoyan Liu , Minglai Shao

Learning-based MIMO detection has shown strong empirical performance, yet existing methods typically rely on fixed-depth architectures without explicitly modeling the progressive refinement of symbol estimates. In this paper, we revisit…

信息论 · 计算机科学 2026-05-04 Nan Jiang , Jiadong Hong , Lei Liu , Xinyu Bian , Wenjie Wang , Zhaoyang Zhang

In this paper, we propose MGNet, a simple and effective multiplex graph convolutional network (GCN) model for multimodal brain network analysis. The proposed method integrates tensor representation into the multiplex GCN model to extract…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Zhaoming Kong , Lichao Sun , Hao Peng , Liang Zhan , Yong Chen , Lifang He

In this paper, we develop \textbf{MP-HOI}, a powerful Multi-modal Prompt-based HOI detector designed to leverage both textual descriptions for open-set generalization and visual exemplars for handling high ambiguity in descriptions,…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Jie Yang , Bingliang Li , Ailing Zeng , Lei Zhang , Ruimao Zhang

Scene graph generation (SGG) and human-object interaction (HOI) detection are two important visual tasks aiming at localising and recognising relationships between objects, and interactions between humans and objects, respectively.…

计算机视觉与模式识别 · 计算机科学 2023-11-06 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

The dominant paradigm for machine learning on graphs uses Message Passing Graph Neural Networks (MP-GNNs), in which node representations are updated by aggregating information in their local neighborhood. Recently, there have been…

机器学习 · 计算机科学 2023-03-02 Daniel Glickman , Eran Yahav

Recent advances in Graph Neural Networks (GNNs) have revolutionized graph-structured data modeling, yet traditional GNNs struggle with complex heterogeneous structures prevalent in real-world scenarios. Despite progress in handling…

机器学习 · 计算机科学 2025-01-07 Zongwei Li , Lianghao Xia , Hua Hua , Shijie Zhang , Shuangyang Wang , Chao Huang

Human-Object Interaction (HOI) detection aims to learn how human interacts with surrounding objects. Previous HOI detection frameworks simultaneously detect human, objects and their corresponding interactions by using a predictor. Using…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Huan Peng , Fenggang Liu , Yangguang Li , Bin Huang , Jing Shao , Nong Sang , Changxin Gao

There has been a growing interest in developing diffusion-based Graph Neural Networks (GNNs), building on the connections between message passing mechanisms in GNNs and physical diffusion processes. However, existing methods suffer from…

机器学习 · 计算机科学 2025-08-18 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

Real-world multimodal data usually exhibit complex structural relationships beyond traditional one-to-one mappings like image-caption pairs. Entities across modalities interact in intricate ways, with images and text forming diverse…

机器学习 · 计算机科学 2025-10-21 Xuying Ning , Dongqi Fu , Tianxin Wei , Wujiang Xu , Jingrui He

Dynamics modeling has been introduced as a novel paradigm in message passing (MP) of graph neural networks (GNNs). Existing methods consider MP between nodes as a heat diffusion process, and leverage heat equation to model the temporal…

机器学习 · 计算机科学 2025-05-30 Juwei Yue , Haikuo Li , Jiawei Sheng , Yihan Guo , Xinghua Zhang , Chuan Zhou , Tingwen Liu , Li Guo

Efficiently capturing consistent and complementary semantic features in a multimodal conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC). Existing methods mainly use graph structures to model dialogue…

计算与语言 · 计算机科学 2024-05-06 Tao Meng , Fuchen Zhang , Yuntao Shou , Wei Ai , Nan Yin , Keqin Li

Moving Object Segmentation (MOS) is a challenging problem in computer vision, particularly in scenarios with dynamic backgrounds, abrupt lighting changes, shadows, camouflage, and moving cameras. While graph-based methods have shown…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Wieke Prummel , Jhony H. Giraldo , Anastasia Zakharova , Thierry Bouwmans

Graph neural networks are increasingly becoming the framework of choice for graph-based machine learning. In this paper, we propose a new graph neural network architecture that substitutes classical message passing with an analysis of the…

机器学习 · 计算机科学 2024-01-18 Alessandro Bicciato , Luca Cosmo , Giorgia Minello , Luca Rossi , Andrea Torsello