English
Related papers

Related papers: Salience-SGG: Enhancing Unbiased Scene Graph Gener…

200 papers

Scene Graph Generation (SGG) aims to extract entities, predicates and their semantic structure from images, enabling deep understanding of visual content, with many applications such as visual reasoning and image retrieval. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Alireza Zareian , Svebor Karaman , Shih-Fu Chang

Scene Graph Generation, which generally follows a regular encoder-decoder pipeline, aims to first encode the visual contents within the given image and then parse them into a compact summary graph. Existing SGG approaches generally not only…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xingning Dong , Tian Gan , Xuemeng Song , Jianlong Wu , Yuan Cheng , Liqiang Nie

Despite the impressive performance of recent unbiased Scene Graph Generation (SGG) methods, the current debiasing literature mainly focuses on the long-tailed distribution problem, whereas it overlooks another source of bias, i.e., semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Shuzhou Sun , Shuaifeng Zhi , Qing Liao , Janne Heikkilä , Li Liu

Scene Graph Generation (SGG) unifies object localization and visual relationship reasoning by predicting boxes and subject-predicate-object triples. Yet most pipelines treat SGG as a one-shot, deterministic classification problem rather…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xin Hu , Ke Qin , Wen Yin , Yuan-Fang Li , Ming Li , Tao He

Scene Graph Generation (SGG) aims to identify entities and predict the relationship triplets \textit{\textless subject, predicate, object\textgreater } in visual scenes. Given the prevalence of large visual variations of subject-object…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jiankai Li , Yunhong Wang , Xiefan Guo , Ruijie Yang , Weixin Li

Unbiased scene graph generation (USGG) is a challenging task that requires predicting diverse and heavily imbalanced predicates between objects in an image. To address this, we propose a novel framework peer learning that uses predicate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Liguang Zhou , Junjie Hu , Yuhongze Zhou , Tin Lun Lam , Yangsheng Xu

Predicting a scene graph that captures visual entities and their interactions in an image has been considered a crucial step towards full scene comprehension. Recent scene graph generation (SGG) models have shown their capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tzu-Jui Julius Wang , Selen Pehlivan , Jorma Laaksonen

Given input images, scene graph generation (SGG) aims to produce comprehensive, graphical representations describing visual relationships among salient objects. Recently, more efforts have been paid to the long tail problem in SGG; however,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Meng-Jiun Chiou , Henghui Ding , Hanshu Yan , Changhu Wang , Roger Zimmermann , Jiashi Feng

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

Scene Graph Generation (SGG) aims to detect all the visual relation triplets $<$\texttt{sub}, \texttt{pred}, \texttt{obj}$>$ in a given image. With the emergence of various advanced techniques for better utilizing both the intrinsic and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lin Li , Guikun Chen , Jun Xiao , Yi Yang , Chunping Wang , Long Chen

Scene graph generation (SGG) aims to detect objects in an image along with their pairwise relationships. There are three key properties of scene graph that have been underexplored in recent works: namely, the edge direction information, the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Xin Lin , Changxing Ding , Jinquan Zeng , Dacheng Tao

Scene Graph Generation (SGG) has achieved significant progress recently. However, most previous works rely heavily on fixed-size entity representations based on bounding box proposals, anchors, or learnable queries. As each representation's…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Hengyue Liu , Bir Bhanu

The current studies of Scene Graph Generation (SGG) focus on solving the long-tailed problem for generating unbiased scene graphs. However, most de-biasing methods overemphasize the tail predicates and underestimate head ones throughout…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chaofan Zheng , Lianli Gao , Xinyu Lyu , Pengpeng Zeng , Abdulmotaleb El Saddik , Heng Tao Shen

Scene Graph Generation (SGG) aims to build a structured representation of a scene using objects and pairwise relationships, which benefits downstream tasks. However, current SGG methods usually suffer from sub-optimal scene graph generation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Chen , Yibing Zhan , Baosheng Yu , Liu Liu , Yong Luo , Bo Du

Scene Graph Generation (SGG) plays a pivotal role in downstream vision-language tasks. Existing SGG methods typically suffer from poor compositional generalizations on unseen triplets. They are generally trained on incompletely annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiankai Li , Yunhong Wang , Weixin Li

Semi-Supervised Semantic Segmentation (SSSS) aims to improve segmentation accuracy by leveraging a small set of labeled images alongside a larger pool of unlabeled data. Recent advances primarily focus on pseudo-labeling, consistency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Dinh Dai Quan Tran , Hoang-Thien Nguyen , Thanh-Huy Nguyen , Gia-Van To , Tien-Huy Nguyen , Quan Nguyen

Video Scene Graph Generation (VidSGG) aims to capture dynamic relationships among entities by sequentially analyzing video frames and integrating visual and semantic information. However, VidSGG is challenged by significant biases that skew…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yanjun Li , Zhaoyang Li , Honghui Chen , Lizhi Xu

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research because of its powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Guangming Zhu , Liang Zhang , Youliang Jiang , Yixuan Dang , Haoran Hou , Peiyi Shen , Mingtao Feng , Xia Zhao , Qiguang Miao , Syed Afaq Ali Shah , Mohammed Bennamoun

Reasoning about complex visual scenes involves perception of entities and their relations. Scene graphs provide a natural representation for reasoning tasks, by assigning labels to both entities (nodes) and relations (edges). Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Moshiko Raboh , Roei Herzig , Gal Chechik , Jonathan Berant , Amir Globerson

The task of dynamic scene graph generation (SGG) from videos is complicated and challenging due to the inherent dynamics of a scene, temporal fluctuation of model predictions, and the long-tailed distribution of the visual relationships in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Sayak Nag , Kyle Min , Subarna Tripathi , Amit K. Roy Chowdhury