English
Related papers

Related papers: Ensemble Predicate Decoding for Unbiased Scene Gra…

200 papers

Predicting a scene graph that captures visual entities and their interactions in an image has been considered a crucial step towards full scene comprehension. Recent scene graph generation (SGG) models have shown their capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tzu-Jui Julius Wang , Selen Pehlivan , Jorma Laaksonen

The performance of current Scene Graph Generation models is severely hampered by some hard-to-distinguish predicates, e.g., "woman-on/standing on/walking on-beach" or "woman-near/looking at/in front of-child". While general SGG models are…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Xinyu Lyu , Lianli Gao , Yuyu Guo , Zhou Zhao , Hao Huang , Heng Tao Shen , Jingkuan Song

3D Semantic Scene Graph Prediction aims to detect objects and their semantic relationships in 3D scenes, and has emerged as a crucial technology for robotics and AR/VR applications. While previous research has addressed dataset limitations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 KunHo Heo , GiHyun Kim , SuYeon Kim , MyeongAh Cho

Scene Graph Generation (SGG) aims to represent visual scenes by identifying objects and their pairwise relationships, providing a structured understanding of image content. However, inherent challenges like long-tailed class distributions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Sayak Nag , Udita Ghosh , Calvin-Khang Ta , Sarosij Bose , Jiachen Li , Amit K Roy Chowdhury

Scene graphs provide a rich, structured representation of a scene by encoding the entities (objects) and their spatial relationships in a graphical format. This representation has proven useful in several tasks, such as question answering,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Sanjoy Kundu , Sathyanarayanan N. Aakur

An unbiased scene graph generation (SGG) algorithm referred to as Skew Class-balanced Re-weighting (SCR) is proposed for considering the unbiased predicate prediction caused by the long-tailed distribution. The prior works focus mainly on…

Machine Learning · Computer Science 2023-03-30 Haeyong Kang , Chang D. Yoo

Scene Graph Generation (SGG) aims to extract <subject, predicate, object> relationships in images for vision understanding. Although recent works have made steady progress on SGG, they still suffer long-tail distribution issues that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qifan Yu , Juncheng Li , Yu Wu , Siliang Tang , Wei Ji , Yueting Zhuang

The current studies of Scene Graph Generation (SGG) focus on solving the long-tailed problem for generating unbiased scene graphs. However, most de-biasing methods overemphasize the tail predicates and underestimate head ones throughout…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chaofan Zheng , Lianli Gao , Xinyu Lyu , Pengpeng Zeng , Abdulmotaleb El Saddik , Heng Tao Shen

Scene Graph Generation(SGG) is a scene understanding task that aims at identifying object entities and reasoning their relationships within a given image. In contrast to prevailing two-stage methods based on a large object detector (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Xinyao Liao , Wei Wei , Dangyang Chen , Yuanyuan Fu

There has been exciting progress in generating images from natural language or layout conditions. However, these methods struggle to faithfully reproduce complex scenes due to the insufficient modeling of multiple objects and their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Yunnan Wang , Ziqiang Li , Zequn Zhang , Wenyao Zhang , Baao Xie , Xihui Liu , Wenjun Zeng , Xin Jin

The scene graph generation (SGG) task aims to detect visual relationship triplets, i.e., subject, predicate, object, in an image, providing a structural vision layout for scene understanding. However, current models are stuck in common…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Yuyu Guo , Lianli Gao , Xuanhan Wang , Yuxuan Hu , Xing Xu , Xu Lu , Heng Tao Shen , Jingkuan Song

Scene Graph Generation (SGG) remains a challenging visual understanding task due to its compositional property. Most previous works adopt a bottom-up two-stage or a point-based one-stage approach, which often suffers from high time…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Rongjie Li , Songyang Zhang , Xuming He

Scene graph generation (SGG) is a sophisticated task that suffers from both complex visual features and dataset long-tail problem. Recently, various unbiased strategies have been proposed by designing novel loss functions and data balancing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Xiaoguang Chang , Teng Wang , Shaowei Cai , Changyin Sun

The scene graph generation (SGG) task is designed to identify the predicates based on the subject-object pairs.However,existing datasets generally include two imbalance cases: one is the class imbalance from the predicted predicates and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yukuan Min , Aming Wu , Cheng Deng

Scene Graph Generation (SGG) aims to detect all the visual relation triplets $<$\texttt{sub}, \texttt{pred}, \texttt{obj}$>$ in a given image. With the emergence of various advanced techniques for better utilizing both the intrinsic and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lin Li , Guikun Chen , Jun Xiao , Yi Yang , Chunping Wang , Long Chen

Scene Graph Generation (SGG) remains a challenging task due to its compositional property. Previous approaches improve prediction efficiency through end-to-end learning. However, these methods exhibit limited performance as they assume…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Peng Hao , Weilong Wang , Xiaobing Wang , Yingying Jiang , Hanchao Jia , Shaowei Cui , Junhang Wei , Xiaoshuai Hao

Scene graph generation (SGG) is designed to extract (subject, predicate, object) triplets in images. Recent works have made a steady progress on SGG, and provide useful tools for high-level vision and language understanding. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Ao Zhang , Yuan Yao , Qianyu Chen , Wei Ji , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Scene Graph Generation (SGG) aims to build a structured representation of a scene using objects and pairwise relationships, which benefits downstream tasks. However, current SGG methods usually suffer from sub-optimal scene graph generation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Chen , Yibing Zhan , Baosheng Yu , Liu Liu , Yong Luo , Bo Du

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

In Scene Graph Generation (SGG), structured representations are extracted from visual inputs as object nodes and connecting predicates, enabling image-based reasoning for diverse downstream tasks. While fully supervised SGG has improved…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Abdelrahman Elskhawy , Mengze Li , Nassir Navab , Benjamin Busam