English
Related papers

Related papers: SGTR: End-to-end Scene Graph Generation with Trans…

200 papers

Scene Graph Generation (SGG) aims to extract entities, predicates and their semantic structure from images, enabling deep understanding of visual content, with many applications such as visual reasoning and image retrieval. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Alireza Zareian , Svebor Karaman , Shih-Fu Chang

Scene Graph Generation (SGG) is a task that encodes visual relationships between objects in images as graph structures. SGG shows significant promise as a foundational component for downstream tasks, such as reasoning for embodied agents.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Maëlic Neau , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche , Akihiro Sugimoto

Scene graph generation (SGG) aims to parse a visual scene into an intermediate graph representation for downstream reasoning tasks. Despite recent advancements, existing methods struggle to generate scene graphs with novel visual relation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Rongjie Li , Songyang Zhang , Dahua Lin , Kai Chen , Xuming He

Scene Graph Generation (SGG) aims to generate a comprehensive graphical representation that accurately captures the semantic information of a given scenario. However, the SGG model's performance in predicting more fine-grained predicates is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiasong Feng , Lichun Wang , Hongbo Xu , Kai Xu , Baocai Yin

Scene Graph Generation (SGG) suffers from a long-tailed distribution, where a few predicate classes dominate while many others are underrepresented, leading to biased models that underperform on rare relations. Unbiased-SGG methods address…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Runfeng Qu , Ole Hall , Pia K Bideau , Julie Ouerfelli-Ethier , Martin Rolfs , Klaus Obermayer , Olaf Hellwich

3D scene graph generation (SGG) has been of high interest in computer vision. Although the accuracy of 3D SGG on coarse classification and single relation label has been gradually improved, the performance of existing works is still far…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Yuanyuan Liu , Chengjiang Long , Zhaoxuan Zhang , Bokai Liu , Qiang Zhang , Baocai Yin , Xin Yang

Graph-structured scene descriptions can be efficiently used in generative models to control the composition of the generated image. Previous approaches are based on the combination of graph convolutional networks and adversarial methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Renato Sortino , Simone Palazzo , Concetto Spampinato

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Scene Graph Generation (SGG) aims to build a structured representation of a scene using objects and pairwise relationships, which benefits downstream tasks. However, current SGG methods usually suffer from sub-optimal scene graph generation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Chen , Yibing Zhan , Baosheng Yu , Liu Liu , Yong Luo , Bo Du

Scene Graph Generation (SGG) aims to structurally and comprehensively represent objects and their connections in images, it can significantly benefit scene understanding and other related downstream tasks. Existing SGG models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Qianji Di , Wenxi Ma , Zhongang Qi , Tianxiang Hou , Ying Shan , Hanzi Wang

Scene graph (SG) representations can neatly and efficiently describe scene semantics, which has driven sustained intensive research in SG generation. In the real world, multiple modalities often coexist, with different types, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Shengqiong Wu , Hao Fei , Tat-Seng Chua

As pretrained text-to-image diffusion models become increasingly powerful, recent efforts have been made to distill knowledge from these text-to-image pretrained models for optimizing a text-guided 3D model. Most of the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Gege Gao , Weiyang Liu , Anpei Chen , Andreas Geiger , Bernhard Schölkopf

Recent years have seen a growing interest in Scene Graph Generation (SGG), a comprehensive visual scene understanding task that aims to predict entity relationships using a relation encoder-decoder pipeline stacked on top of an object…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Gopika Sudhakaran , Devendra Singh Dhami , Kristian Kersting , Stefan Roth

Recent advancements in Generative Artificial Intelligence (GenAI) have significantly enhanced the capabilities of both image generation and editing. However, current approaches often treat these tasks separately, leading to inefficiencies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Thanh-Nhan Vo , Trong-Thuan Nguyen , Tam V. Nguyen , Minh-Triet Tran

The task of scene graph generation entails identifying object entities and their corresponding interaction predicates in a given image (or video). Due to the combinatorially large solution space, existing approaches to scene graph…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Siddhesh Khandelwal , Leonid Sigal

Training Scene Graph Generation (SGG) models with natural language captions has become increasingly popular due to the abundant, cost-effective, and open-world generalization supervision signals that natural language offers. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Predicting a scene graph that captures visual entities and their interactions in an image has been considered a crucial step towards full scene comprehension. Recent scene graph generation (SGG) models have shown their capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tzu-Jui Julius Wang , Selen Pehlivan , Jorma Laaksonen

Scene graph generation from images is a task of great interest to applications such as robotics, because graphs are the main way to represent knowledge about the world and regulate human-robot interactions in tasks such as Visual Question…

Robotics · Computer Science 2022-12-21 Fernando Amodeo , Fernando Caballero , Natalia Díaz-Rodríguez , Luis Merino

Despite recent advancements in single-domain or single-object image generation, it is still challenging to generate complex scenes containing diverse, multiple objects and their interactions. Scene graphs, composed of nodes as objects and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Sarthak Garg , Helisa Dhamo , Azade Farshad , Sabrina Musatian , Nassir Navab , Federico Tombari

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and establish their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Naitik Khandelwal , Xiao Liu , Mengmi Zhang