English
Related papers

Related papers: Fine-Grained Scene Graph Generation via Sample-Lev…

200 papers

Scene Graph Generation, which generally follows a regular encoder-decoder pipeline, aims to first encode the visual contents within the given image and then parse them into a compact summary graph. Existing SGG approaches generally not only…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xingning Dong , Tian Gan , Xuemeng Song , Jianlong Wu , Yuan Cheng , Liqiang Nie

Scene graph generation (SGG) is to detect object pairs with their relations in an image. Existing SGG approaches often use multi-stage pipelines to decompose this task into object detection, relation graph construction, and dense or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yao Teng , Limin Wang

The Scene Graph Generation (SGG) task aims to detect all the objects and their pairwise visual relationships in a given image. Although SGG has achieved remarkable progress over the last few years, almost all existing SGG models follow the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Lin Li , Long Chen , Hanrong Shi , Wenxiao Wang , Jian Shao , Yi Yang , Jun Xiao

Capturing global contextual representations by exploiting long-range pixel-pixel dependencies has shown to improve semantic segmentation performance. However, how to do this efficiently is an open question as current approaches of utilising…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Qinghui Liu , Michael Kampffmeyer , Robert Jenssen , Arnt-Børre Salberg

Despite the great success object detection and segmentation models have achieved in recognizing individual objects in images, performance on cognitive tasks such as image caption, semantic image retrieval, and visual QA is far from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Weilin Cong , William Wang , Wang-Chien Lee

Scene Graph Generation (SGG) has achieved significant progress recently. However, most previous works rely heavily on fixed-size entity representations based on bounding box proposals, anchors, or learnable queries. As each representation's…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Hengyue Liu , Bir Bhanu

The goal of scene graph generation is to predict a graph from an input image, where nodes correspond to identified and localized objects and edges to their corresponding interaction predicates. Existing methods are trained in a fully…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Bicheng Xu , Renjie Liao , Leonid Sigal

Scene Graph Generation (SGG) is a challenging task of detecting objects and predicting relationships between objects. After DETR was developed, one-stage SGG models based on a one-stage object detector have been actively studied. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jinbae Im , JeongYeon Nam , Nokyung Park , Hyungmin Lee , Seunghyun Park

Scene Graph Generation (SGG) aims to generate a comprehensive graphical representation that accurately captures the semantic information of a given scenario. However, the SGG model's performance in predicting more fine-grained predicates is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiasong Feng , Lichun Wang , Hongbo Xu , Kai Xu , Baocai Yin

Scene Graph Generation (SGG) offers a structured representation critical in many computer vision applications. Traditional SGG approaches, however, are limited by a closed-set assumption, restricting their ability to recognize only…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

The current studies of Scene Graph Generation (SGG) focus on solving the long-tailed problem for generating unbiased scene graphs. However, most de-biasing methods overemphasize the tail predicates and underestimate head ones throughout…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chaofan Zheng , Lianli Gao , Xinyu Lyu , Pengpeng Zeng , Abdulmotaleb El Saddik , Heng Tao Shen

Understanding a scene by decoding the visual relationships depicted in an image has been a long studied problem. While the recent advances in deep learning and the usage of deep neural networks have achieved near human accuracy on many…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Aniket Agarwal , Ayush Mangal , Vipul

Scene Graphs are widely applied in computer vision as a graphical representation of relationships between objects shown in images. However, these applications have not yet reached a practical stage of development owing to biased training…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Misaki Ohashi , Yusuke Matsui

3D Semantic Scene Graph Prediction aims to detect objects and their semantic relationships in 3D scenes, and has emerged as a crucial technology for robotics and AR/VR applications. While previous research has addressed dataset limitations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 KunHo Heo , GiHyun Kim , SuYeon Kim , MyeongAh Cho

Scene graphs provide structured semantic understanding beyond images. For downstream tasks, such as image retrieval, visual question answering, visual relationship detection, and even autonomous vehicle technology, scene graphs can not only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mingzhe Du

Open-vocabulary scene graph generation (SGG) aims to describe visual scenes with flexible and fine-grained relation phrases beyond a fixed predicate vocabulary. While recent vision-language models greatly expand the semantic coverage of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Suiyang Guang , Chenyu Liu , Ruohan Zhang , Siyuan Chen

Modern 3D semantic scene graph estimation methods utilize ground truth 3D annotations to accurately predict target objects, predicates, and relationships. In the absence of given 3D ground truth representations, we explore leveraging only…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Qi Xun Yeo , Yanyan Li , Gim Hee Lee

Scene Graph Generation (SGG) is a task that encodes visual relationships between objects in images as graph structures. SGG shows significant promise as a foundational component for downstream tasks, such as reasoning for embodied agents.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Maëlic Neau , Zoe Falomir

Over the past few years, a significant progress has been made in deep convolutional neural networks (CNNs)-based image recognition. This is mainly due to the strong ability of such networks in mining discriminative object pose and parts…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

Scene graphs provide valuable information to many downstream tasks. Many scene graph generation (SGG) models solely use the limited annotated relation triples for training, leading to their underperformance on low-shot (few and zero)…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tao He , Lianli Gao , Jingkuan Song , Jianfei Cai , Yuan-Fang Li