English
Related papers

Related papers: Learning To Generate Scene Graph from Head to Tail

200 papers

Scene graph generation (SGG) models have suffered from inherent problems regarding the benchmark datasets such as the long-tailed predicate distribution and missing annotation problems. In this work, we aim to alleviate the long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Kibum Kim , Kanghoon Yoon , Yeonjun In , Jinyoung Moon , Donghyun Kim , Chanyoung Park

Scene Graph Generation (SGG) provides basic language representation of visual scenes, requiring models to grasp complex and diverse semantics between objects. This complexity and diversity in SGG leads to underrepresentation, where parts of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Yuxuan Wang , Xiaoyuan Liu

Scene graph generation aims to detect visual relationship triplets, (subject, predicate, object). Due to biases in data, current models tend to predict common predicates, e.g. "on" and "at", instead of informative ones, e.g. "standing on"…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Lianli Gao , Xinyu Lyu , Yuyu Guo , Yuxuan Hu , Yuan-Fang Li , Lu Xu , Heng Tao Shen , Jingkuan Song

Scene Graph Generation (SGG) aims to extract <subject, predicate, object> relationships in images for vision understanding. Although recent works have made steady progress on SGG, they still suffer long-tail distribution issues that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qifan Yu , Juncheng Li , Yu Wu , Siliang Tang , Wei Ji , Yueting Zhuang

Today, scene graph generation(SGG) task is largely limited in realistic scenarios, mainly due to the extremely long-tailed bias of predicate annotation distribution. Thus, tackling the class imbalance trouble of SGG is critical and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Shaotian Yan , Chen Shen , Zhongming Jin , Jianqiang Huang , Rongxin Jiang , Yaowu Chen , Xian-Sheng Hua

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research because of its powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Guangming Zhu , Liang Zhang , Youliang Jiang , Yixuan Dang , Haoran Hou , Peiyi Shen , Mingtao Feng , Xia Zhao , Qiguang Miao , Syed Afaq Ali Shah , Mohammed Bennamoun

Scene graph generation (SGG) is an important task in image understanding because it represents the relationships between objects in an image as a graph structure, making it possible to understand the semantic relationships between objects…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hyeongjin Kim , Sangwon Kim , Dasom Ahn , Jong Taek Lee , Byoung Chul Ko

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Scene graphs provide a rich, structured representation of a scene by encoding the entities (objects) and their spatial relationships in a graphical format. This representation has proven useful in several tasks, such as question answering,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Sanjoy Kundu , Sathyanarayanan N. Aakur

Scene Graph Generation (SGG) aims to structurally and comprehensively represent objects and their connections in images, it can significantly benefit scene understanding and other related downstream tasks. Existing SGG models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Qianji Di , Wenxi Ma , Zhongang Qi , Tianxiang Hou , Ying Shan , Hanzi Wang

As far as Scene Graph Generation (SGG), coarse and fine predicates mix in the dataset due to the crowd-sourced labeling, and the long-tail problem is also pronounced. Given this tricky situation, many existing SGG methods treat the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Youming Deng , Yansheng Li , Yongjun Zhang , Xiang Xiang , Jian Wang , Jingdong Chen , Jiayi Ma

Existing Unbiased Scene Graph Generation (USGG) methods only focus on addressing the predicate-level imbalance that high-frequency classes dominate predictions of rare ones, while overlooking the concept-level imbalance. Actually, even if…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xinyu Lyu , Lianli Gao , Junlin Xie , Pengpeng Zeng , Yulu Tian , Jie Shao , Heng Tao Shen

In Scene Graph Generation (SGG), structured representations are extracted from visual inputs as object nodes and connecting predicates, enabling image-based reasoning for diverse downstream tasks. While fully supervised SGG has improved…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Abdelrahman Elskhawy , Mengze Li , Nassir Navab , Benjamin Busam

Scene graph generation (SGG) aims to detect objects in an image along with their pairwise relationships. There are three key properties of scene graph that have been underexplored in recent works: namely, the edge direction information, the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Xin Lin , Changxing Ding , Jinquan Zeng , Dacheng Tao

An unbiased scene graph generation (SGG) algorithm referred to as Skew Class-balanced Re-weighting (SCR) is proposed for considering the unbiased predicate prediction caused by the long-tailed distribution. The prior works focus mainly on…

Machine Learning · Computer Science 2023-03-30 Haeyong Kang , Chang D. Yoo

Despite the impressive performance of recent unbiased Scene Graph Generation (SGG) methods, the current debiasing literature mainly focuses on the long-tailed distribution problem, whereas it overlooks another source of bias, i.e., semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Shuzhou Sun , Shuaifeng Zhi , Qing Liao , Janne Heikkilä , Li Liu

This paper investigates the problem of scene graph generation in videos with the aim of capturing semantic relations between subjects and objects in the form of $\langle$subject, predicate, object$\rangle$ triplets. Recognizing the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shuo Chen , Yingjun Du , Pascal Mettes , Cees G. M. Snoek

The task of dynamic scene graph generation (SGG) from videos is complicated and challenging due to the inherent dynamics of a scene, temporal fluctuation of model predictions, and the long-tailed distribution of the visual relationships in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Sayak Nag , Kyle Min , Subarna Tripathi , Amit K. Roy Chowdhury

Spatio-Temporal Scene Graphs (STSGs) provide a concise and expressive representation of dynamic scenes by modeling objects and their evolving relationships over time. However, real-world visual relationships often exhibit a long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Rohith Peddi , Saurabh , Ayush Abhay Shrivastava , Parag Singla , Vibhav Gogate

Scene graph generation (SGG) aims to detect objects and predict their pairwise relationships within an image. Current SGG methods typically utilize graph neural networks (GNNs) to acquire context information between objects/relationships.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Xin Lin , Changxing Ding , Yibing Zhan , Zijian Li , Dacheng Tao