English
Related papers

Related papers: SG-Shuffle: Multi-aspect Shuffle Transformer for S…

200 papers

Scene graph generation (SGG) aims to detect objects in an image along with their pairwise relationships. There are three key properties of scene graph that have been underexplored in recent works: namely, the edge direction information, the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Xin Lin , Changxing Ding , Jinquan Zeng , Dacheng Tao

In this work, we seek new insights into the underlying challenges of the Scene Graph Generation (SGG) task. Quantitative and qualitative analysis of the Visual Genome dataset implies -- 1) Ambiguity: even if inter-object relationship…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sangmin Woo , Junhyug Noh , Kangil Kim

Scene graph generation (SGG) of surgical procedures is crucial in enhancing holistically cognitive intelligence in the operating room (OR). However, previous works have primarily relied on multi-stage learning, where the generated semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Jialun Pei , Diandian Guo , Jingyang Zhang , Manxi Lin , Yueming Jin , Pheng-Ann Heng

Scene Graph Generation (SGG) research has suffered from two fundamental challenges: the long-tailed predicate distribution and semantic ambiguity between predicates. These challenges lead to a bias towards head predicates in SGG models,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Kanghoon Yoon , Kibum Kim , Jaehyung Jeon , Yeonjun In , Donghyun Kim , Chanyoung Park

Scene Graph Generation (SGG) has achieved significant progress recently. However, most previous works rely heavily on fixed-size entity representations based on bounding box proposals, anchors, or learnable queries. As each representation's…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Hengyue Liu , Bir Bhanu

Despite the great success object detection and segmentation models have achieved in recognizing individual objects in images, performance on cognitive tasks such as image caption, semantic image retrieval, and visual QA is far from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Weilin Cong , William Wang , Wang-Chien Lee

Scene understanding is an essential and challenging task in computer vision. To provide the visually fundamental graphical structure of an image, the scene graph has received increased attention due to its powerful semantic representation.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Tianyu Zhang , Xusheng Du , Chia-Ming Chang , Xi Yang , Haoran Xie

Scene graph generation aims to detect visual relationship triplets, (subject, predicate, object). Due to biases in data, current models tend to predict common predicates, e.g. "on" and "at", instead of informative ones, e.g. "standing on"…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Lianli Gao , Xinyu Lyu , Yuyu Guo , Yuxuan Hu , Yuan-Fang Li , Lu Xu , Heng Tao Shen , Jingkuan Song

Scene Graph Generation (SGG) endeavors to predict the relationships between subjects and objects in a given image. Nevertheless, the long-tail distribution of relations often leads to biased prediction on coarse labels, presenting a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Qishen Chen , Jianzhi Liu , Xinyu Lyu , Lianli Gao , Heng Tao Shen , Jingkuan Song

Scene graph generation (SGG) is an important task in image understanding because it represents the relationships between objects in an image as a graph structure, making it possible to understand the semantic relationships between objects…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hyeongjin Kim , Sangwon Kim , Dasom Ahn , Jong Taek Lee , Byoung Chul Ko

Scene Graph Generation (SGG) offers a structured representation critical in many computer vision applications. Traditional SGG approaches, however, are limited by a closed-set assumption, restricting their ability to recognize only…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Scene graph generation (SGG) is built on top of detected objects to predict object pairwise visual relations for describing the image content abstraction. Existing works have revealed that if the links between objects are given as prior…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yuyu Guo , Lianli Gao , Jingkuan Song , Peng Wang , Nicu Sebe , Heng Tao Shen , Xuelong Li

Scene Graph Generation (SGG) is a challenging task of detecting objects and predicting relationships between objects. After DETR was developed, one-stage SGG models based on a one-stage object detector have been actively studied. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jinbae Im , JeongYeon Nam , Nokyung Park , Hyungmin Lee , Seunghyun Park

Scene graph generation (SGG) aims to automatically map an image into a semantic structural graph for better scene understanding. It has attracted significant attention for its ability to provide object and relation information, enabling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xinyu Zhou , Zihan Ji , Anna Zhu

Scene-Graph Generation (SGG) seeks to recognize objects in an image and distill their salient pairwise relationships. Most methods depend on dataset-specific supervision to learn the variety of interactions, restricting their usefulness in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Amartya Dutta , Kazi Sajeed Mehrab , Medha Sawhney , Abhilash Neog , Mridul Khurana , Sepideh Fatemi , Aanish Pradhan , M. Maruf , Ismini Lourentzou , Arka Daw , Anuj Karpatne

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and establish their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Naitik Khandelwal , Xiao Liu , Mengmi Zhang

Recent years have seen a growing interest in Scene Graph Generation (SGG), a comprehensive visual scene understanding task that aims to predict entity relationships using a relation encoder-decoder pipeline stacked on top of an object…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Gopika Sudhakaran , Devendra Singh Dhami , Kristian Kersting , Stefan Roth

Scene graphs (SGs) represent objects and their relationships as structured graphs, enabling applications in image generation, robotics, and 3D understanding. Recent work suggests that conditioning image generation on scene graphs improves…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rajalaxmi Rajagopalan , Romit Roy Choudhury

Scene graph generation (SGG) is to detect object pairs with their relations in an image. Existing SGG approaches often use multi-stage pipelines to decompose this task into object detection, relation graph construction, and dense or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yao Teng , Limin Wang

Research in scene graph generation (SGG) usually considers two-stage models, that is, detecting a set of entities, followed by combining them and labeling all possible relationships. While showing promising results, the pipeline structure…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Alakh Desai , Tz-Ying Wu , Subarna Tripathi , Nuno Vasconcelos