English
Related papers

Related papers: Multimodal Graph Network Modeling for Human-Object…

200 papers

Pose-based action recognition has drawn considerable attention recently. Existing methods exploit the joint positions to extract the body-part features from the activation map of the convolutional networks to assist human action…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Lei Shi , Yifan Zhang , Jian Cheng , Hanqing Lu

Graphs offer a natural way to formulate Multiple Object Tracking (MOT) and Multiple Object Tracking and Segmentation (MOTS) within the tracking-by-detection paradigm. However, they also introduce a major challenge for learning methods, as…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Guillem Braso , Orcun Cetintas , Laura Leal-Taixe

Many real-world datasets, such as citation networks, social networks, and molecular structures, are naturally represented as heterogeneous graphs, where nodes belong to different types and have additional features. For example, in a…

Machine Learning · Computer Science 2026-02-05 Pallabee Das , Stefan Heindorf

Researchers of temporal networks (e.g., social networks and transaction networks) have been interested in mining dynamic patterns of nodes from their diverse interactions. Inspired by recently powerful graph mining methods like skip-gram…

Information Retrieval · Computer Science 2023-04-18 Tongya Zheng , Zunlei Feng , Tianli Zhang , Yunzhi Hao , Mingli Song , Xingen Wang , Xinyu Wang , Ji Zhao , Chun Chen

Graph classification is a fundamental task in domains ranging from molecular property prediction to materials design. While graph neural networks (GNNs) achieve strong performance by learning expressive representations via message passing,…

Machine Learning · Computer Science 2025-12-04 Hamed Poursiami , Shay Snyder , Guojing Cong , Thomas Potok , Maryam Parsa

Multimodal graphs are gaining increasing attention due to their rich representational power and wide applicability, yet they introduce substantial challenges arising from severe modality confusion. To address this issue, we propose NSG…

Machine Learning · Computer Science 2026-02-03 Yihan Zhang , Ercan E. Kuruoglu

Predicting user influence in social networks is a critical problem, and hypergraphs, as a prevalent higher-order modeling approach, provide new perspectives for this task. However, the absence of explicit cascade or infection probability…

Social and Information Networks · Computer Science 2025-08-22 Su-Su Zhang , JinFeng Xie , Yang Chen , Min Gao , Cong Li , Chuang Liu , Xiu-Xiu Zhan

Incorporating relational reasoning in neural networks for object recognition remains an open problem. Although many attempts have been made for relational reasoning, they generally only consider a single type of relationship. For example,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Hao Chen , Abhinav Shrivastava

Multi-modal neuroimaging technology has greatlly facilitated the efficiency and diagnosis accuracy, which provides complementary information in discovering objective disease biomarkers. Conventional deep learning methods, e.g. convolutional…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Yanwu Yang , Xutao Guo , Zhikai Chang , Chenfei Ye , Yang Xiang , Ting Ma

Most Graph Neural Networks (GNNs) propagate messages by treating node embeddings as holistic feature vectors, implicitly assuming uniform relevance across feature dimensions. This limits their ability to selectively transmit informative…

Machine Learning · Computer Science 2025-12-24 Longlong Li , Mengyang Zhao , Guanghui Wang , Cunquan Qu

Variable scene layouts and coexisting objects across scenes make indoor scene recognition still a challenging task. Leveraging object information within scenes to enhance the distinguishability of feature representations has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Chuanxin Song , Hanbo Wu , Xin Ma

Human-object interaction (HOI) detectors with popular query-transformer architecture have achieved promising performance. However, accurately identifying uncommon visual patterns and distinguishing between ambiguous HOIs continue to be…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Mingda Jia , Liming Zhao , Ge Li , Yun Zheng

Mesh-based graph neural networks (GNNs) have become effective surrogates for PDE simulations, yet their deep message passing incurs high cost and over-smoothing on large, long-range meshes; hierarchical GNNs shorten propagation paths but…

Machine Learning · Computer Science 2025-09-16 Bo Lei , Victor M. Castillo , Yeping Hu

Modern human-object interaction (HOI) detection approaches can be divided into one-stage methods and twostage ones. One-stage models are more efficient due to their straightforward architectures, but the two-stage models are still…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Xubin Zhong , Xian Qu , Changxing Ding , Dacheng Tao

While the celebrated graph neural networks yield effective representations for individual nodes of a graph, there has been relatively less success in extending to the task of graph similarity learning. Recent work on graph similarity…

Machine Learning · Computer Science 2021-08-20 Xiang Ling , Lingfei Wu , Saizhuo Wang , Tengfei Ma , Fangli Xu , Alex X. Liu , Chunming Wu , Shouling Ji

Graph neural networks (GNNs) have found extensive applications in learning from graph data. However, real-world graphs often possess diverse structures and comprise nodes and edges of varying types. To bolster the generalization capacity of…

Machine Learning · Computer Science 2023-10-18 Haotao Wang , Ziyu Jiang , Yuning You , Yan Han , Gaowen Liu , Jayanth Srinivasa , Ramana Rao Kompella , Zhangyang Wang

Recent state-of-the-art methods for HOI detection typically build on transformer architectures with two decoder branches, one for human-object pair detection and the other for interaction classification. Such disentangled transformers,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Sanghyun Kim , Deunsol Jung , Minsu Cho

Camouflaged object detection (COD) aims to identify the objects that seamlessly blend into the surrounding backgrounds. Due to the intrinsic similarity between the camouflaged objects and the background region, it is extremely challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Siyuan Yao , Hao Sun , Tian-Zhu Xiang , Xiao Wang , Xiaochun Cao

Heterogeneous information network (HIN) embedding, aiming to map the structure and semantic information in a HIN to distributed representations, has drawn considerable research attention. Graph neural networks for HIN embeddings typically…

Social and Information Networks · Computer Science 2020-07-07 Di Jin , Zhizhi Yu , Dongxiao He , Carl Yang , Philip S. Yu , Jiawei Han

Graph Neural Networks (GNNs) have achieved remarkable success in various graph mining tasks by aggregating information from neighborhoods for representation learning. The success relies on the homophily assumption that nearby nodes exhibit…

Machine Learning · Computer Science 2024-06-03 Zhuonan Zheng , Sheng Zhou , Hongjia Xu , Ming Gu , Yilun Xu , Ao Li , Yuhong Li , Jingjun Gu , Jiajun Bu