English
Related papers

Related papers: Unbiased Scene Graph Generation using Predicate Si…

200 papers

Scene Graph Generation (SGG) as a critical task in image understanding, facing the challenge of head-biased prediction caused by the long-tail distribution of predicates. However, current unbiased SGG methods can easily prioritize improving…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Lei Wang , Zejian Yuan , Yao Lu , Badong Chen

Unbiased scene graph generation (USGG) is a challenging task that requires predicting diverse and heavily imbalanced predicates between objects in an image. To address this, we propose a novel framework peer learning that uses predicate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Liguang Zhou , Junjie Hu , Yuhongze Zhou , Tin Lun Lam , Yangsheng Xu

Learning similarity between scene graphs and images aims to estimate a similarity score given a scene graph and an image. There is currently no research dedicated to this task, although it is critical for scene graph generation and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yuren Cong , Wentong Liao , Bodo Rosenhahn , Michael Ying Yang

Panoptic Scene Graph Generation (PSG) parses objects and predicts their relationships (predicate) to connect human language and visual scenes. However, different language preferences of annotators and semantic overlaps between predicates…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Li Li , Wei Ji , Yiming Wu , Mengze Li , You Qin , Lina Wei , Roger Zimmermann

Scene graphs provide a rich, structured representation of a scene by encoding the entities (objects) and their spatial relationships in a graphical format. This representation has proven useful in several tasks, such as question answering,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Sanjoy Kundu , Sathyanarayanan N. Aakur

Scene Graph Generation (SGG) aims to build a structured representation of a scene using objects and pairwise relationships, which benefits downstream tasks. However, current SGG methods usually suffer from sub-optimal scene graph generation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Chen , Yibing Zhan , Baosheng Yu , Liu Liu , Yong Luo , Bo Du

Scene graph generation (SGG) has gained tremendous progress in recent years. However, its underlying long-tailed distribution of predicate classes is a challenging problem. For extremely unbalanced predicate distributions, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Liguang Zhou , Yuhongze Zhou , Tin Lun Lam , Yangsheng Xu

Existing Unbiased Scene Graph Generation (USGG) methods only focus on addressing the predicate-level imbalance that high-frequency classes dominate predictions of rare ones, while overlooking the concept-level imbalance. Actually, even if…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xinyu Lyu , Lianli Gao , Junlin Xie , Pengpeng Zeng , Yulu Tian , Jie Shao , Heng Tao Shen

Panoptic Scene Graph Generation (PSG) involves the detection of objects and the prediction of their corresponding relationships (predicates). However, the presence of biased predicate annotations poses a significant challenge for PSG…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Li Li , You Qin , Wei Ji , Yuxiao Zhou , Roger Zimmermann

Scene Graph Generation (SGG) aims to structurally and comprehensively represent objects and their connections in images, it can significantly benefit scene understanding and other related downstream tasks. Existing SGG models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Qianji Di , Wenxi Ma , Zhongang Qi , Tianxiang Hou , Ying Shan , Hanzi Wang

Scene Graph Generation (SGG) unifies object localization and visual relationship reasoning by predicting boxes and subject-predicate-object triples. Yet most pipelines treat SGG as a one-shot, deterministic classification problem rather…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xin Hu , Ke Qin , Wen Yin , Yuan-Fang Li , Ming Li , Tao He

Scene Graph Generation (SGG) aims to explore the relationships between objects in images and obtain scene summary graphs, thereby better serving downstream tasks. However, the long-tailed problem has adversely affected the scene graph's…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yansheng Li , Tingzhu Wang , Kang Wu , Linlin Wang , Xin Guo , Wenbin Wang

Understanding a scene by decoding the visual relationships depicted in an image has been a long studied problem. While the recent advances in deep learning and the usage of deep neural networks have achieved near human accuracy on many…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Aniket Agarwal , Ayush Mangal , Vipul

Learning to compose visual relationships from raw images in the form of scene graphs is a highly challenging task due to contextual dependencies, but it is essential in computer vision applications that depend on scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Neau Maëlic , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

The scene graph generation (SGG) task involves detecting objects within an image and predicting predicates that represent the relationships between the objects. However, in SGG benchmark datasets, each subject-object pair is annotated with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jaehyeong Jeon , Kibum Kim , Kanghoon Yoon , Chanyoung Park

Despite recent advancements in single-domain or single-object image generation, it is still challenging to generate complex scenes containing diverse, multiple objects and their interactions. Scene graphs, composed of nodes as objects and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Sarthak Garg , Helisa Dhamo , Azade Farshad , Sabrina Musatian , Nassir Navab , Federico Tombari

By assigning each relationship a single label, current approaches formulate the relationship detection as a classification problem. Under this formulation, predicate categories are treated as completely different classes. However, different…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Yi Zhou , Shuyang Sun , Chao Zhang , Yikang Li , Wanli Ouyang

Predicting a scene graph that captures visual entities and their interactions in an image has been considered a crucial step towards full scene comprehension. Recent scene graph generation (SGG) models have shown their capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tzu-Jui Julius Wang , Selen Pehlivan , Jorma Laaksonen

The scene graph generation (SGG) task aims to detect visual relationship triplets, i.e., subject, predicate, object, in an image, providing a structural vision layout for scene understanding. However, current models are stuck in common…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Yuyu Guo , Lianli Gao , Xuanhan Wang , Yuxuan Hu , Xing Xu , Xu Lu , Heng Tao Shen , Jingkuan Song