English
Related papers

Related papers: Hyper-relationship Learning Network for Scene Grap…

200 papers

Incorporating relational reasoning in neural networks for object recognition remains an open problem. Although many attempts have been made for relational reasoning, they generally only consider a single type of relationship. For example,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Hao Chen , Abhinav Shrivastava

Graph neural networks (GNNs) have been broadly studied on dynamic graphs for their representation learning, majority of which focus on graphs with homogeneous structures in the spatial domain. However, many real-world graphs - i.e.,…

Machine Learning · Computer Science 2021-10-27 Yujie Fan , Mingxuan Ju , Chuxu Zhang , Liang Zhao , Yanfang Ye

Graph Neural Networks (GNNs) are widely used in graph representation learning. However, most GNN methods are designed for either homogeneous or heterogeneous graphs. In this paper, we propose a new model, Hop-Hop Relation-aware Graph Neural…

Machine Learning · Computer Science 2020-12-22 Li Zhang , Yan Ge , Haiping Lu

Scene-Graph Generation (SGG) seeks to recognize objects in an image and distill their salient pairwise relationships. Most methods depend on dataset-specific supervision to learn the variety of interactions, restricting their usefulness in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Amartya Dutta , Kazi Sajeed Mehrab , Medha Sawhney , Abhilash Neog , Mridul Khurana , Sepideh Fatemi , Aanish Pradhan , M. Maruf , Ismini Lourentzou , Arka Daw , Anuj Karpatne

Many real-world interactions are group-based rather than pairwise such as papers with multiple co-authors and users jointly engaging with items. Hypergraph neural networks have shown great promise at modeling higher-order relations, but…

Machine Learning · Computer Science 2025-08-14 Xiaoyu Li , Guangyu Tang , Jiaojiao Jiang

We propose a novel scene graph generation model called Graph R-CNN, that is both effective and efficient at detecting objects and their relations in images. Our model contains a Relation Proposal Network (RePN) that efficiently deals with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Jianwei Yang , Jiasen Lu , Stefan Lee , Dhruv Batra , Devi Parikh

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and establish their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Naitik Khandelwal , Xiao Liu , Mengmi Zhang

Traditional scene graphs primarily focus on spatial relationships, limiting vision-language models' (VLMs) ability to reason about complex interactions in visual scenes. This paper addresses two key challenges: (1) conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Dayong Liang , Changmeng Zheng , Zhiyuan Wen , Yi Cai , Xiao-Yong Wei , Qing Li

In recent years, powered by the learned discriminative representation via graph neural network (GNN) models, deep graph matching methods have made great progresses in the task of matching semantic features. However, these methods usually…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 He Liu , Tao Wang , Yidong Li , Congyan Lang , Yi Jin , Haibin Ling

With the advancement of mobile technology, Point of Interest (POI) recommendation systems in Location-based Social Networks (LBSN) have brought numerous benefits to both users and companies. Many existing works employ Knowledge Graph (KG)…

Artificial Intelligence · Computer Science 2023-11-29 Jixiao Zhang , Yongkang Li , Ruotong Zou , Jingyuan Zhang , Zipei Fan , Xuan Song

Scene graph generation aims to capture detailed spatial and semantic relationships between objects in an image, which is challenging due to incomplete labelling, long-tailed relationship categories, and relational semantic overlap. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zeeshan Hayder , Xuming He

Social recommendation based on social network has achieved great success in improving the performance of recommendation system. Since social network (user-user relations) and user-item interactions are both naturally represented as…

Information Retrieval · Computer Science 2021-09-27 Yiming Zhang , Lingfei Wu , Qi Shen , Yitong Pang , Zhihua Wei , Fangli Xu , Ethan Chang , Bo Long

The scene graph generation (SGG) task aims to detect visual relationship triplets, i.e., subject, predicate, object, in an image, providing a structural vision layout for scene understanding. However, current models are stuck in common…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Yuyu Guo , Lianli Gao , Xuanhan Wang , Yuxuan Hu , Xing Xu , Xu Lu , Heng Tao Shen , Jingkuan Song

Heterogeneous graph neural networks (HGNNs) have powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks…

Machine Learning · Computer Science 2023-09-04 Xiaocheng Yang , Mingyu Yan , Shirui Pan , Xiaochun Ye , Dongrui Fan

Scene graph generation (SGG) aims to automatically map an image into a semantic structural graph for better scene understanding. It has attracted significant attention for its ability to provide object and relation information, enabling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xinyu Zhou , Zihan Ji , Anna Zhu

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Sequence classification has a wide range of real-world applications in different domains, such as genome classification in health and anomaly detection in business. However, the lack of explicit features in sequence data makes it difficult…

Machine Learning · Computer Science 2023-06-19 Khaled Mohammed Saifuddin , Corey May , Farhan Tanvir , Muhammad Ifte Khairul Islam , Esra Akbas

In this paper, we present a hypergraph neural networks (HGNN) framework for data representation learning, which can encode high-order data correlation in a hypergraph structure. Confronting the challenges of learning representation for…

Machine Learning · Computer Science 2019-02-26 Yifan Feng , Haoxuan You , Zizhao Zhang , Rongrong Ji , Yue Gao

Identifying objects in an image and their mutual relationships as a scene graph leads to a deep understanding of image content. Despite the recent advancement in deep learning, the detection and labeling of visual object relationships…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Rajat Koner , Poulami Sinhamahapatra , Volker Tresp

Graph representation learning for hypergraphs can be used to extract patterns among higher-order interactions that are critically important in many real world problems. Current approaches designed for hypergraphs, however, are unable to…

Machine Learning · Computer Science 2019-11-11 Ruochi Zhang , Yuesong Zou , Jian Ma