English
Related papers

Related papers: Leveraging Predicate and Triplet Learning for Scen…

200 papers

In this work, we seek new insights into the underlying challenges of the Scene Graph Generation (SGG) task. Quantitative and qualitative analysis of the Visual Genome dataset implies -- 1) Ambiguity: even if inter-object relationship…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sangmin Woo , Junhyug Noh , Kangil Kim

Scene graph generation aims to detect visual relationship triplets, (subject, predicate, object). Due to biases in data, current models tend to predict common predicates, e.g. "on" and "at", instead of informative ones, e.g. "standing on"…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Lianli Gao , Xinyu Lyu , Yuyu Guo , Yuxuan Hu , Yuan-Fang Li , Lu Xu , Heng Tao Shen , Jingkuan Song

Scene graph generation (SGG) is designed to extract (subject, predicate, object) triplets in images. Recent works have made a steady progress on SGG, and provide useful tools for high-level vision and language understanding. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Ao Zhang , Yuan Yao , Qianyu Chen , Wei Ji , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Despite the impressive performance of recent unbiased Scene Graph Generation (SGG) methods, the current debiasing literature mainly focuses on the long-tailed distribution problem, whereas it overlooks another source of bias, i.e., semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Shuzhou Sun , Shuaifeng Zhi , Qing Liao , Janne Heikkilä , Li Liu

Scene Graph Generation (SGG) suffers from a long-tailed distribution, where a few predicate classes dominate while many others are underrepresented, leading to biased models that underperform on rare relations. Unbiased-SGG methods address…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Runfeng Qu , Ole Hall , Pia K Bideau , Julie Ouerfelli-Ethier , Martin Rolfs , Klaus Obermayer , Olaf Hellwich

Scene Graph Generation (SGG) aims to generate a comprehensive graphical representation that accurately captures the semantic information of a given scenario. However, the SGG model's performance in predicting more fine-grained predicates is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiasong Feng , Lichun Wang , Hongbo Xu , Kai Xu , Baocai Yin

Predicting a scene graph that captures visual entities and their interactions in an image has been considered a crucial step towards full scene comprehension. Recent scene graph generation (SGG) models have shown their capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tzu-Jui Julius Wang , Selen Pehlivan , Jorma Laaksonen

Scene graph generation (SGG) has gained tremendous progress in recent years. However, its underlying long-tailed distribution of predicate classes is a challenging problem. For extremely unbalanced predicate distributions, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Liguang Zhou , Yuhongze Zhou , Tin Lun Lam , Yangsheng Xu

Scene Graph Generation (SGG) aims to extract <subject, predicate, object> relationships in images for vision understanding. Although recent works have made steady progress on SGG, they still suffer long-tail distribution issues that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qifan Yu , Juncheng Li , Yu Wu , Siliang Tang , Wei Ji , Yueting Zhuang

Scene Graph Generation (SGG) remains a challenging visual understanding task due to its compositional property. Most previous works adopt a bottom-up two-stage or a point-based one-stage approach, which often suffers from high time…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Rongjie Li , Songyang Zhang , Xuming He

Scene Graph Generation (SGG) as a critical task in image understanding, facing the challenge of head-biased prediction caused by the long-tail distribution of predicates. However, current unbiased SGG methods can easily prioritize improving…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Lei Wang , Zejian Yuan , Yao Lu , Badong Chen

Scene Graph Generation (SGG) has achieved significant progress recently. However, most previous works rely heavily on fixed-size entity representations based on bounding box proposals, anchors, or learnable queries. As each representation's…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Hengyue Liu , Bir Bhanu

The performance of current Scene Graph Generation models is severely hampered by some hard-to-distinguish predicates, e.g., "woman-on/standing on/walking on-beach" or "woman-near/looking at/in front of-child". While general SGG models are…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Xinyu Lyu , Lianli Gao , Yuyu Guo , Zhou Zhao , Hao Huang , Heng Tao Shen , Jingkuan Song

The Scene Graph Generation (SGG) task aims to detect all the objects and their pairwise visual relationships in a given image. Although SGG has achieved remarkable progress over the last few years, almost all existing SGG models follow the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Lin Li , Long Chen , Hanrong Shi , Wenxiao Wang , Jian Shao , Yi Yang , Jun Xiao

In Scene Graph Generation (SGG), structured representations are extracted from visual inputs as object nodes and connecting predicates, enabling image-based reasoning for diverse downstream tasks. While fully supervised SGG has improved…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Abdelrahman Elskhawy , Mengze Li , Nassir Navab , Benjamin Busam

Scene Graph Generation (SGG) aims to detect all the visual relation triplets $<$\texttt{sub}, \texttt{pred}, \texttt{obj}$>$ in a given image. With the emergence of various advanced techniques for better utilizing both the intrinsic and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lin Li , Guikun Chen , Jun Xiao , Yi Yang , Chunping Wang , Long Chen

Scene graph generation (SGG) aims to capture a wide variety of interactions between pairs of objects, which is essential for full scene understanding. Existing SGG methods trained on the entire set of relations fail to acquire complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Arushi Goel , Basura Fernando , Frank Keller , Hakan Bilen

Training Scene Graph Generation (SGG) models with natural language captions has become increasingly popular due to the abundant, cost-effective, and open-world generalization supervision signals that natural language offers. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Research in scene graph generation (SGG) usually considers two-stage models, that is, detecting a set of entities, followed by combining them and labeling all possible relationships. While showing promising results, the pipeline structure…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Alakh Desai , Tz-Ying Wu , Subarna Tripathi , Nuno Vasconcelos

Video Scene Graph Generation aims to obtain structured semantic representations of objects and their relationships in videos for high-level understanding. However, existing methods still have limitations in handling long-tail distributions.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenxing Li , Yiping Duan , Xiaoming Tao