English
Related papers

Related papers: Unbiased Scene Graph Generation via Two-stage Caus…

200 papers

The current studies of Scene Graph Generation (SGG) focus on solving the long-tailed problem for generating unbiased scene graphs. However, most de-biasing methods overemphasize the tail predicates and underestimate head ones throughout…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chaofan Zheng , Lianli Gao , Xinyu Lyu , Pengpeng Zeng , Abdulmotaleb El Saddik , Heng Tao Shen

The task of dynamic scene graph generation (DynSGG) aims to generate scene graphs for given videos, which involves modeling the spatial-temporal information in the video. However, due to the long-tailed distribution of samples in the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Xinyu Lyu , Jingwei Liu , Yuyu Guo , Lianli Gao

Although great progress has been made in the research of unbiased scene graph generation, issues still hinder improving the predictive performance of both head and tail classes. An unbiased scene graph generation (TA-HDG) is proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Guanglu Sun , Jin Qiu , Lili Liang

The scene graph generation (SGG) task aims to detect visual relationship triplets, i.e., subject, predicate, object, in an image, providing a structural vision layout for scene understanding. However, current models are stuck in common…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Yuyu Guo , Lianli Gao , Xuanhan Wang , Yuxuan Hu , Xing Xu , Xu Lu , Heng Tao Shen , Jingkuan Song

Scene Graph Generation (SGG) as a critical task in image understanding, facing the challenge of head-biased prediction caused by the long-tail distribution of predicates. However, current unbiased SGG methods can easily prioritize improving…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Lei Wang , Zejian Yuan , Yao Lu , Badong Chen

Scene Graph Generation (SGG) serves a comprehensive representation of the images for human understanding as well as visual understanding tasks. Due to the long tail bias problem of the object and predicate labels in the available annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Anh Duc Bui , Soyeon Caren Han , Josiah Poon

Scene graph generation (SGG) models have suffered from inherent problems regarding the benchmark datasets such as the long-tailed predicate distribution and missing annotation problems. In this work, we aim to alleviate the long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Kibum Kim , Kanghoon Yoon , Yeonjun In , Jinyoung Moon , Donghyun Kim , Chanyoung Park

Existing offline feed-forward methods for joint scene understanding and reconstruction on long image streams often repeatedly perform global computation over an ever-growing set of past observations, causing runtime and GPU memory to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Renhe Zhang , Yuyang Tan , Jingyu Gong , Zhizhong Zhang , Lizhuang Ma , Yuan Xie , Xin Tan

In real-world data, long-tailed data distribution is common, making it challenging for models trained on empirical risk minimisation to learn and classify tail classes effectively. While many studies have sought to improve long tail…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Ziheng Wang , Toni Lassila , Sharib Ali

Video Scene Graph Generation (VidSGG) aims to capture dynamic relationships among entities by sequentially analyzing video frames and integrating visual and semantic information. However, VidSGG is challenged by significant biases that skew…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yanjun Li , Zhaoyang Li , Honghui Chen , Lizhi Xu

knowledge graph-based recommendation methods have achieved great success in the field of recommender systems. However, over-reliance on high-quality knowledge graphs is a bottleneck for such methods. Specifically, the long-tailed…

Information Retrieval · Computer Science 2023-10-03 Yubo Gao , Haotian Wu

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

For a typical Scene Graph Generation (SGG) method, there is often a large gap in the performance of the predicates' head classes and tail classes. This phenomenon is mainly caused by the semantic overlap between different predicates as well…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Leitian Tao , Li Mi , Nannan Li , Xianhang Cheng , Yaosi Hu , Zhenzhong Chen

We propose a novel formalism for describing Structural Causal Models (SCMs) as fixed-point problems on causally ordered variables, eliminating the need for Directed Acyclic Graphs (DAGs), and establish the weakest known conditions for their…

Machine Learning · Computer Science 2024-12-16 Meyer Scetbon , Joel Jennings , Agrin Hilmkil , Cheng Zhang , Chao Ma

The Scene Graph Generation (SGG) task aims to detect all the objects and their pairwise visual relationships in a given image. Although SGG has achieved remarkable progress over the last few years, almost all existing SGG models follow the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Lin Li , Long Chen , Hanrong Shi , Wenxiao Wang , Jian Shao , Yi Yang , Jun Xiao

Scene Graph Generation (SGG) aims to extract <subject, predicate, object> relationships in images for vision understanding. Although recent works have made steady progress on SGG, they still suffer long-tail distribution issues that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qifan Yu , Juncheng Li , Yu Wu , Siliang Tang , Wei Ji , Yueting Zhuang

Scene Graph Generation, which generally follows a regular encoder-decoder pipeline, aims to first encode the visual contents within the given image and then parse them into a compact summary graph. Existing SGG approaches generally not only…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xingning Dong , Tian Gan , Xuemeng Song , Jianlong Wu , Yuan Cheng , Liqiang Nie

Scene graphs are semantic abstraction of images that encourage visual understanding and reasoning. However, the performance of Scene Graph Generation (SGG) is unsatisfactory when faced with biased data in real-world scenarios. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Jing Yu , Yuan Chai , Yujing Wang , Yue Hu , Qi Wu

Source localization is the inverse problem of graph information dissemination and has broad practical applications. However, the inherent intricacy and uncertainty in information dissemination pose significant challenges, and the ill-posed…

Machine Learning · Computer Science 2023-04-19 Bosong Huang , Weihao Yu , Ruzhong Xie , Jing Xiao , Jin Huang