English
Related papers

Related papers: Scene Graph Generation with Role-Playing Large Lan…

200 papers

Scene-Graph Generation (SGG) seeks to recognize objects in an image and distill their salient pairwise relationships. Most methods depend on dataset-specific supervision to learn the variety of interactions, restricting their usefulness in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Amartya Dutta , Kazi Sajeed Mehrab , Medha Sawhney , Abhilash Neog , Mridul Khurana , Sepideh Fatemi , Aanish Pradhan , M. Maruf , Ismini Lourentzou , Arka Daw , Anuj Karpatne

Scene graph generation (SGG) aims to parse a visual scene into an intermediate graph representation for downstream reasoning tasks. Despite recent advancements, existing methods struggle to generate scene graphs with novel visual relation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Rongjie Li , Songyang Zhang , Dahua Lin , Kai Chen , Xuming He

Scene Graph Generation (SGG) offers a structured representation critical in many computer vision applications. Traditional SGG approaches, however, are limited by a closed-set assumption, restricting their ability to recognize only…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

Scene Graph Generation (SGG) encodes visual relationships between objects in images as graph structures. Thanks to the advances of Vision-Language Models (VLMs), the task of Open-Vocabulary SGG has been recently proposed where models are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Maëlic Neau , Zoe Falomir , Cédric Buche , Akihiro Sugimoto

We present OvSGTR, a novel transformer-based framework for fully open-vocabulary scene graph generation that overcomes the limitations of traditional closed-set models. Conventional methods restrict both object and relationship recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zuyao Chen , Jinlin Wu , Zhen Lei , Chang Wen Chen

Scene Graph Generation (SGG) unifies object localization and visual relationship reasoning by predicting boxes and subject-predicate-object triples. Yet most pipelines treat SGG as a one-shot, deterministic classification problem rather…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xin Hu , Ke Qin , Wen Yin , Yuan-Fang Li , Ming Li , Tao He

Scene Graph Generation (SGG) converts visual scenes into structured graph representations, providing deeper scene understanding for complex vision tasks. However, existing SGG models often overlook essential spatial relationships and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Mingjie Xu , Mengyang Wu , Yuzhi Zhao , Jason Chun Lok Li , Weifeng Ou

In Scene Graph Generation (SGG), structured representations are extracted from visual inputs as object nodes and connecting predicates, enabling image-based reasoning for diverse downstream tasks. While fully supervised SGG has improved…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Abdelrahman Elskhawy , Mengze Li , Nassir Navab , Benjamin Busam

Today's open vocabulary scene graph generation (OVSGG) extends traditional SGG by recognizing novel objects and relationships beyond predefined categories, leveraging the knowledge from pre-trained large-scale models. Most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Lin Li , Chuhan Zhang , Dong Zhang , Chong Sun , Chen Li , Long Chen

Scene graph generation aims to capture detailed spatial and semantic relationships between objects in an image, which is challenging due to incomplete labelling, long-tailed relationship categories, and relational semantic overlap. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zeeshan Hayder , Xuming He

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and establish their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Naitik Khandelwal , Xiao Liu , Mengmi Zhang

Scene Graph Generation (SGG) is a visual understanding task, aiming to describe a scene as a graph of entities and their relationships with each other. Existing works rely on location labels in form of bounding boxes or segmentation masks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ege Özsoy , Felix Holm , Mahdi Saleh , Tobias Czempiel , Chantal Pellegrini , Nassir Navab , Benjamin Busam

Open-vocabulary scene graph generation (SGG) aims to describe visual scenes with flexible and fine-grained relation phrases beyond a fixed predicate vocabulary. While recent vision-language models greatly expand the semantic coverage of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Suiyang Guang , Chenyu Liu , Ruohan Zhang , Siyuan Chen

3D scene graph generation (SGG) has been of high interest in computer vision. Although the accuracy of 3D SGG on coarse classification and single relation label has been gradually improved, the performance of existing works is still far…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Yuanyuan Liu , Chengjiang Long , Zhaoxuan Zhang , Bokai Liu , Qiang Zhang , Baocai Yin , Xin Yang

Scene graph generation (SGG) aims to capture a wide variety of interactions between pairs of objects, which is essential for full scene understanding. Existing SGG methods trained on the entire set of relations fail to acquire complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Arushi Goel , Basura Fernando , Frank Keller , Hakan Bilen

Dynamic Scene Graph Generation (DSGG) focuses on identifying visual relationships within the spatial-temporal domain of videos. Conventional approaches often employ multi-stage pipelines, which typically consist of object detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Guan Wang , Zhimin Li , Qingchao Chen , Yang Liu

Scene graph generation provides a compact structured representation for visual perception, but accurate and fast graph prediction from images and videos remains challenging. Recent VLM-based methods can generate scene graphs end-to-end as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Vladislav Makarov , Mark Gizetdinov , Dmitry Yudin

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research because of its powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Guangming Zhu , Liang Zhang , Youliang Jiang , Yixuan Dang , Haoran Hou , Peiyi Shen , Mingtao Feng , Xia Zhao , Qiguang Miao , Syed Afaq Ali Shah , Mohammed Bennamoun
‹ Prev 1 2 3 10 Next ›