English
Related papers

Related papers: Single-Stage Visual Relationship Learning using Co…

200 papers

Dynamic scene graph generation from a video is challenging due to the temporal dynamics of the scene and the inherent temporal fluctuations of predictions. We hypothesize that capturing long-term temporal dependencies is the key to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Shengyu Feng , Subarna Tripathi , Hesham Mostafa , Marcel Nassar , Somdeb Majumdar

Dynamic Scene Graph Generation (DSGG) focuses on identifying visual relationships within the spatial-temporal domain of videos. Conventional approaches often employ multi-stage pipelines, which typically consist of object detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Guan Wang , Zhimin Li , Qingchao Chen , Yang Liu

Scene Graph Generation (SGG) offers a structured representation critical in many computer vision applications. Traditional SGG approaches, however, are limited by a closed-set assumption, restricting their ability to recognize only…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Scene Graph Generation (SGG) aims to explore the relationships between objects in images and obtain scene summary graphs, thereby better serving downstream tasks. However, the long-tailed problem has adversely affected the scene graph's…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yansheng Li , Tingzhu Wang , Kang Wu , Linlin Wang , Xin Guo , Wenbin Wang

Scene graph generation (SGG) is built on top of detected objects to predict object pairwise visual relations for describing the image content abstraction. Existing works have revealed that if the links between objects are given as prior…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yuyu Guo , Lianli Gao , Jingkuan Song , Peng Wang , Nicu Sebe , Heng Tao Shen , Xuelong Li

In this work, we seek new insights into the underlying challenges of the Scene Graph Generation (SGG) task. Quantitative and qualitative analysis of the Visual Genome dataset implies -- 1) Ambiguity: even if inter-object relationship…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sangmin Woo , Junhyug Noh , Kangil Kim

Existing research addresses scene graph generation (SGG) -- a critical technology for scene understanding in images -- from a detection perspective, i.e., objects are detected using bounding boxes followed by prediction of their pairwise…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Jingkang Yang , Yi Zhe Ang , Zujin Guo , Kaiyang Zhou , Wayne Zhang , Ziwei Liu

Video scene graph generation (VidSGG) aims to identify objects in visual scenes and infer their relationships for a given video. It requires not only a comprehensive understanding of each object scattered on the whole scene but also a deep…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Tao Pu , Tianshui Chen , Hefeng Wu , Yongyi Lu , Liang Lin

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and establish their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Naitik Khandelwal , Xiao Liu , Mengmi Zhang

Scene graph generation (SGG) is designed to extract (subject, predicate, object) triplets in images. Recent works have made a steady progress on SGG, and provide useful tools for high-level vision and language understanding. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Ao Zhang , Yuan Yao , Qianyu Chen , Wei Ji , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Scene Graph Generation (SGG) research has suffered from two fundamental challenges: the long-tailed predicate distribution and semantic ambiguity between predicates. These challenges lead to a bias towards head predicates in SGG models,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Kanghoon Yoon , Kibum Kim , Jaehyung Jeon , Yeonjun In , Donghyun Kim , Chanyoung Park

Scene Graph Generation (SGG) is a visual understanding task, aiming to describe a scene as a graph of entities and their relationships with each other. Existing works rely on location labels in form of bounding boxes or segmentation masks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ege Özsoy , Felix Holm , Mahdi Saleh , Tobias Czempiel , Chantal Pellegrini , Nassir Navab , Benjamin Busam

Scene Graph Generation (SGG) aims to extract entities, predicates and their semantic structure from images, enabling deep understanding of visual content, with many applications such as visual reasoning and image retrieval. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Alireza Zareian , Svebor Karaman , Shih-Fu Chang

The task of scene graph generation entails identifying object entities and their corresponding interaction predicates in a given image (or video). Due to the combinatorially large solution space, existing approaches to scene graph…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Siddhesh Khandelwal , Leonid Sigal

Scene graph generation (SGG) is an important task in image understanding because it represents the relationships between objects in an image as a graph structure, making it possible to understand the semantic relationships between objects…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hyeongjin Kim , Sangwon Kim , Dasom Ahn , Jong Taek Lee , Byoung Chul Ko

Current Scene Graph Generation (SGG) methods explore contextual information to predict relationships among entity pairs. However, due to the diverse visual appearance of numerous possible subject-object combinations, there is a large…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Chaofan Zheng , Xinyu Lyu , Lianli Gao , Bo Dai , Jingkuan Song

Scene Graphs are widely applied in computer vision as a graphical representation of relationships between objects shown in images. However, these applications have not yet reached a practical stage of development owing to biased training…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Misaki Ohashi , Yusuke Matsui

As a structured representation of the image content, the visual scene graph (visual relationship) acts as a bridge between computer vision and natural language processing. Existing models on the scene graph generation task notoriously…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yuyu Guo , Jingkuan Song , Lianli Gao , Heng Tao Shen

3D scene graph generation (SGG) has been of high interest in computer vision. Although the accuracy of 3D SGG on coarse classification and single relation label has been gradually improved, the performance of existing works is still far…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Yuanyuan Liu , Chengjiang Long , Zhaoxuan Zhang , Bokai Liu , Qiang Zhang , Baocai Yin , Xin Yang

Scene Graph Generation (SGG) aims to detect all the visual relation triplets $<$\texttt{sub}, \texttt{pred}, \texttt{obj}$>$ in a given image. With the emergence of various advanced techniques for better utilizing both the intrinsic and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lin Li , Guikun Chen , Jun Xiao , Yi Yang , Chunping Wang , Long Chen