English
Related papers

Related papers: Environment-Invariant Curriculum Relation Learning…

200 papers

Existing Unbiased Scene Graph Generation (USGG) methods only focus on addressing the predicate-level imbalance that high-frequency classes dominate predictions of rare ones, while overlooking the concept-level imbalance. Actually, even if…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xinyu Lyu , Lianli Gao , Junlin Xie , Pengpeng Zeng , Yulu Tian , Jie Shao , Heng Tao Shen

The scene graph generation (SGG) task aims to detect visual relationship triplets, i.e., subject, predicate, object, in an image, providing a structural vision layout for scene understanding. However, current models are stuck in common…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Yuyu Guo , Lianli Gao , Xuanhan Wang , Yuxuan Hu , Xing Xu , Xu Lu , Heng Tao Shen , Jingkuan Song

Scene graph generation aims to detect visual relationship triplets, (subject, predicate, object). Due to biases in data, current models tend to predict common predicates, e.g. "on" and "at", instead of informative ones, e.g. "standing on"…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Lianli Gao , Xinyu Lyu , Yuyu Guo , Yuxuan Hu , Yuan-Fang Li , Lu Xu , Heng Tao Shen , Jingkuan Song

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

Visual scene graph generation is a challenging task. Previous works have achieved great progress, but most of them do not explicitly consider the class imbalance issue in scene graph generation. Models learned without considering the class…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Jingyi Zhang , Yong Zhang , Baoyuan Wu , Yanbo Fan , Fumin Shen , Heng Tao Shen

Scene graph generation (SGG) has gained tremendous progress in recent years. However, its underlying long-tailed distribution of predicate classes is a challenging problem. For extremely unbalanced predicate distributions, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Liguang Zhou , Yuhongze Zhou , Tin Lun Lam , Yangsheng Xu

Scene Graph Generation (SGG) aims to explore the relationships between objects in images and obtain scene summary graphs, thereby better serving downstream tasks. However, the long-tailed problem has adversely affected the scene graph's…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yansheng Li , Tingzhu Wang , Kang Wu , Linlin Wang , Xin Guo , Wenbin Wang

Unbiased scene graph generation (USGG) is a challenging task that requires predicting diverse and heavily imbalanced predicates between objects in an image. To address this, we propose a novel framework peer learning that uses predicate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Liguang Zhou , Junjie Hu , Yuhongze Zhou , Tin Lun Lam , Yangsheng Xu

Predicting a scene graph that captures visual entities and their interactions in an image has been considered a crucial step towards full scene comprehension. Recent scene graph generation (SGG) models have shown their capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tzu-Jui Julius Wang , Selen Pehlivan , Jorma Laaksonen

Scene graph generation (SGG) is designed to extract (subject, predicate, object) triplets in images. Recent works have made a steady progress on SGG, and provide useful tools for high-level vision and language understanding. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Ao Zhang , Yuan Yao , Qianyu Chen , Wei Ji , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Scene graph generation (SGG) aims to capture a wide variety of interactions between pairs of objects, which is essential for full scene understanding. Existing SGG methods trained on the entire set of relations fail to acquire complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Arushi Goel , Basura Fernando , Frank Keller , Hakan Bilen

In this work, we seek new insights into the underlying challenges of the Scene Graph Generation (SGG) task. Quantitative and qualitative analysis of the Visual Genome dataset implies -- 1) Ambiguity: even if inter-object relationship…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sangmin Woo , Junhyug Noh , Kangil Kim

Today, scene graph generation(SGG) task is largely limited in realistic scenarios, mainly due to the extremely long-tailed bias of predicate annotation distribution. Thus, tackling the class imbalance trouble of SGG is critical and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Shaotian Yan , Chen Shen , Zhongming Jin , Jianqiang Huang , Rongxin Jiang , Yaowu Chen , Xian-Sheng Hua

An unbiased scene graph generation (SGG) algorithm referred to as Skew Class-balanced Re-weighting (SCR) is proposed for considering the unbiased predicate prediction caused by the long-tailed distribution. The prior works focus mainly on…

Machine Learning · Computer Science 2023-03-30 Haeyong Kang , Chang D. Yoo

Scene Graph Generation (SGG) aims to generate a comprehensive graphical representation that accurately captures the semantic information of a given scenario. However, the SGG model's performance in predicting more fine-grained predicates is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiasong Feng , Lichun Wang , Hongbo Xu , Kai Xu , Baocai Yin

The scene graph generation (SGG) task involves detecting objects within an image and predicting predicates that represent the relationships between the objects. However, in SGG benchmark datasets, each subject-object pair is annotated with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jaehyeong Jeon , Kibum Kim , Kanghoon Yoon , Chanyoung Park

Learning to compose visual relationships from raw images in the form of scene graphs is a highly challenging task due to contextual dependencies, but it is essential in computer vision applications that depend on scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Neau Maëlic , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche

Current Scene Graph Generation (SGG) methods tend to predict frequent predicate categories and fail to recognize rare ones due to the severe imbalanced distribution of predicates. To improve the robustness of SGG models on different…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xingchen Li , Long Chen , Jian Shao , Shaoning Xiao , Songyang Zhang , Jun Xiao

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Scene Graph Generation (SGG) provides basic language representation of visual scenes, requiring models to grasp complex and diverse semantics between objects. This complexity and diversity in SGG leads to underrepresentation, where parts of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Yuxuan Wang , Xiaoyuan Liu
‹ Prev 1 2 3 10 Next ›