English
Related papers

Related papers: Skew Class-balanced Re-weighting for Unbiased Scen…

200 papers

Scene Graph Generation (SGG) aims to build a structured representation of a scene using objects and pairwise relationships, which benefits downstream tasks. However, current SGG methods usually suffer from sub-optimal scene graph generation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Chen , Yibing Zhan , Baosheng Yu , Liu Liu , Yong Luo , Bo Du

The scene graph generation (SGG) task is designed to identify the predicates based on the subject-object pairs.However,existing datasets generally include two imbalance cases: one is the class imbalance from the predicted predicates and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yukuan Min , Aming Wu , Cheng Deng

Scene Graph Generation (SGG) as a critical task in image understanding, facing the challenge of head-biased prediction caused by the long-tail distribution of predicates. However, current unbiased SGG methods can easily prioritize improving…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Lei Wang , Zejian Yuan , Yao Lu , Badong Chen

The current studies of Scene Graph Generation (SGG) focus on solving the long-tailed problem for generating unbiased scene graphs. However, most de-biasing methods overemphasize the tail predicates and underestimate head ones throughout…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chaofan Zheng , Lianli Gao , Xinyu Lyu , Pengpeng Zeng , Abdulmotaleb El Saddik , Heng Tao Shen

Scene graph generation (SGG) models have suffered from inherent problems regarding the benchmark datasets such as the long-tailed predicate distribution and missing annotation problems. In this work, we aim to alleviate the long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Kibum Kim , Kanghoon Yoon , Yeonjun In , Jinyoung Moon , Donghyun Kim , Chanyoung Park

Extended sequence generation often leads to degradation in contextual consistency due to the inability of conventional self-attention mechanisms to effectively retain long-range dependencies. Existing approaches, including memory…

Computation and Language · Computer Science 2025-01-30 Jonathan Teel , Jocasta Cumberbatch , Raphael Benington , Quentin Baskerville

This paper investigates the problem of scene graph generation in videos with the aim of capturing semantic relations between subjects and objects in the form of $\langle$subject, predicate, object$\rangle$ triplets. Recognizing the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shuo Chen , Yingjun Du , Pascal Mettes , Cees G. M. Snoek

The performance of current Scene Graph Generation models is severely hampered by some hard-to-distinguish predicates, e.g., "woman-on/standing on/walking on-beach" or "woman-near/looking at/in front of-child". While general SGG models are…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Xinyu Lyu , Lianli Gao , Yuyu Guo , Zhou Zhao , Hao Huang , Heng Tao Shen , Jingkuan Song

Visual scene graph generation is a challenging task. Previous works have achieved great progress, but most of them do not explicitly consider the class imbalance issue in scene graph generation. Models learned without considering the class…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Jingyi Zhang , Yong Zhang , Baoyuan Wu , Yanbo Fan , Fumin Shen , Heng Tao Shen

Scene graph generation is a structured prediction task aiming to explicitly model objects and their relationships via constructing a visually-grounded scene graph for an input image. Currently, the message passing neural network based mean…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Daqi Liu , Miroslaw Bober , Josef Kittler

Scene Graph Generation (SGG) structures visual scenes as graphs of objects and their relations. While Multimodal Large Language Models (MLLMs) have advanced end-to-end SGG, current methods are hindered by both a lack of task-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Jiaye Feng , Qixiang Yin , Yuankun Liu , Tong Mo , Weiping Li

In scene graph generation (SGG), learning with cross-entropy loss yields biased predictions owing to the severe imbalance in the distribution of the relationship labels in the dataset. Thus, this study proposes a method to generate scene…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Sorachi Kurita , Satoshi Oyama , Itsuki Noda

Scene Graph Generation (SGG) aims to extract <subject, predicate, object> relationships in images for vision understanding. Although recent works have made steady progress on SGG, they still suffer long-tail distribution issues that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qifan Yu , Juncheng Li , Yu Wu , Siliang Tang , Wei Ji , Yueting Zhuang

Stochastic computation graphs (SCGs) provide a formalism to represent structured optimization problems arising in artificial intelligence, including supervised, unsupervised, and reinforcement learning. Previous work has shown that an…

Machine Learning · Computer Science 2019-01-08 Théophane Weber , Nicolas Heess , Lars Buesing , David Silver

Scene Graph Generation (SGG) aims to structurally and comprehensively represent objects and their connections in images, it can significantly benefit scene understanding and other related downstream tasks. Existing SGG models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Qianji Di , Wenxi Ma , Zhongang Qi , Tianxiang Hou , Ying Shan , Hanzi Wang

In Scene Graph Generation (SGG), structured representations are extracted from visual inputs as object nodes and connecting predicates, enabling image-based reasoning for diverse downstream tasks. While fully supervised SGG has improved…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Abdelrahman Elskhawy , Mengze Li , Nassir Navab , Benjamin Busam

The task of dynamic scene graph generation (SGG) from videos is complicated and challenging due to the inherent dynamics of a scene, temporal fluctuation of model predictions, and the long-tailed distribution of the visual relationships in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Sayak Nag , Kyle Min , Subarna Tripathi , Amit K. Roy Chowdhury

The scene graph generation (SGG) task involves detecting objects within an image and predicting predicates that represent the relationships between the objects. However, in SGG benchmark datasets, each subject-object pair is annotated with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jaehyeong Jeon , Kibum Kim , Kanghoon Yoon , Chanyoung Park

Scene coordinate regression (SCR) has established itself as a promising learning-based approach to visual relocalization. After mere minutes of scene-specific training, SCR models estimate camera poses of query images with high accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Leonard Bruns , Axel Barroso-Laguna , Tommaso Cavallari , Áron Monszpart , Sowmya Munukutla , Victor Adrian Prisacariu , Eric Brachmann

Scene graph generation (SGG) aims to predict graph-structured descriptions of input images, in the form of objects and relationships between them. This task is becoming increasingly useful for progress at the interface of vision and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Boris Knyazev , Harm de Vries , Cătălina Cangea , Graham W. Taylor , Aaron Courville , Eugene Belilovsky