English
Related papers

Related papers: Unbiased Scene Graph Generation from Biased Traini…

200 papers

Current Scene Graph Generation (SGG) methods tend to predict frequent predicate categories and fail to recognize rare ones due to the severe imbalanced distribution of predicates. To improve the robustness of SGG models on different…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xingchen Li , Long Chen , Jian Shao , Shaoning Xiao , Songyang Zhang , Jun Xiao

Spatio-Temporal Scene Graphs (STSGs) provide a concise and expressive representation of dynamic scenes by modeling objects and their evolving relationships over time. However, real-world visual relationships often exhibit a long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Rohith Peddi , Saurabh , Ayush Abhay Shrivastava , Parag Singla , Vibhav Gogate

Scene Graph Generation (SGG) plays a pivotal role in downstream vision-language tasks. Existing SGG methods typically suffer from poor compositional generalizations on unseen triplets. They are generally trained on incompletely annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiankai Li , Yunhong Wang , Weixin Li

Scene graph generation (SGG) is built on top of detected objects to predict object pairwise visual relations for describing the image content abstraction. Existing works have revealed that if the links between objects are given as prior…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yuyu Guo , Lianli Gao , Jingkuan Song , Peng Wang , Nicu Sebe , Heng Tao Shen , Xuelong Li

The scene graph generation (SGG) task involves detecting objects within an image and predicting predicates that represent the relationships between the objects. However, in SGG benchmark datasets, each subject-object pair is annotated with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jaehyeong Jeon , Kibum Kim , Kanghoon Yoon , Chanyoung Park

The Scene Graph Generation (SGG) task aims to detect all the objects and their pairwise visual relationships in a given image. Although SGG has achieved remarkable progress over the last few years, almost all existing SGG models follow the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Lin Li , Long Chen , Hanrong Shi , Wenxiao Wang , Jian Shao , Yi Yang , Jun Xiao

Scene graph is a structured representation of a scene that can clearly express the objects, attributes, and relationships between objects in the scene. As computer vision technology continues to develop, people are no longer satisfied with…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Xiaojun Chang , Pengzhen Ren , Pengfei Xu , Zhihui Li , Xiaojiang Chen , Alex Hauptmann

Reasoning about complex visual scenes involves perception of entities and their relations. Scene graphs provide a natural representation for reasoning tasks, by assigning labels to both entities (nodes) and relations (edges). Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Moshiko Raboh , Roei Herzig , Gal Chechik , Jonathan Berant , Amir Globerson

Being able to understand visual scenes is a precursor for many downstream tasks, including autonomous driving, robotics, and other vision-based approaches. A common approach enabling the ability to reason over visual data is Scene Graph…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ce Zhang , Simon Stepputtis , Joseph Campbell , Katia Sycara , Yaqi Xie

Although great progress has been made in the research of unbiased scene graph generation, issues still hinder improving the predictive performance of both head and tail classes. An unbiased scene graph generation (TA-HDG) is proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Guanglu Sun , Jin Qiu , Lili Liang

Scene Graph Generation (SGG) serves a comprehensive representation of the images for human understanding as well as visual understanding tasks. Due to the long tail bias problem of the object and predicate labels in the available annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Anh Duc Bui , Soyeon Caren Han , Josiah Poon

Training Scene Graph Generation (SGG) models with natural language captions has become increasingly popular due to the abundant, cost-effective, and open-world generalization supervision signals that natural language offers. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Dynamic scene graph generation (SGG) from videos requires not only a comprehensive understanding of objects across scenes but also a method to capture the temporal motions and interactions with different objects. Moreover, the long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Anant Khandelwal

Scene Graph Generation (SGG) aims to represent visual scenes by identifying objects and their pairwise relationships, providing a structured understanding of image content. However, inherent challenges like long-tailed class distributions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Sayak Nag , Udita Ghosh , Calvin-Khang Ta , Sarosij Bose , Jiachen Li , Amit K Roy Chowdhury

Learning to compose visual relationships from raw images in the form of scene graphs is a highly challenging task due to contextual dependencies, but it is essential in computer vision applications that depend on scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Neau Maëlic , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche

Scene graphs (SGs) represent objects and their relationships as structured graphs, enabling applications in image generation, robotics, and 3D understanding. Recent work suggests that conditioning image generation on scene graphs improves…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rajalaxmi Rajagopalan , Romit Roy Choudhury

Scene Graph Generation (SGG) aims to structurally and comprehensively represent objects and their connections in images, it can significantly benefit scene understanding and other related downstream tasks. Existing SGG models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Qianji Di , Wenxi Ma , Zhongang Qi , Tianxiang Hou , Ying Shan , Hanzi Wang

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and establish their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Naitik Khandelwal , Xiao Liu , Mengmi Zhang

As a structured prediction task, scene graph generation aims to build a visually-grounded scene graph to explicitly model objects and their relationships in an input image. Currently, the mean field variational Bayesian framework is the de…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Daqi Liu , Miroslaw Bober , Josef Kittler

While recent debiasing methods for Scene Graph Generation (SGG) have shown impressive performance, these efforts often attribute model bias solely to the long-tail distribution of relationships, overlooking the more profound causes stemming…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Li Liu , Shuzhou Sun , Shuaifeng Zhi , Fan Shi , Zhen Liu , Janne Heikkilä , Yongxiang Liu