English
Related papers

Related papers: BCTR: Bidirectional Conditioning Transformer for S…

200 papers

Scene Graph Generation, which generally follows a regular encoder-decoder pipeline, aims to first encode the visual contents within the given image and then parse them into a compact summary graph. Existing SGG approaches generally not only…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xingning Dong , Tian Gan , Xuemeng Song , Jianlong Wu , Yuan Cheng , Liqiang Nie

Scene Graph Generation (SGG) aims to build a structured representation of a scene using objects and pairwise relationships, which benefits downstream tasks. However, current SGG methods usually suffer from sub-optimal scene graph generation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Chen , Yibing Zhan , Baosheng Yu , Liu Liu , Yong Luo , Bo Du

Scene graph generation aims to capture detailed spatial and semantic relationships between objects in an image, which is challenging due to incomplete labelling, long-tailed relationship categories, and relational semantic overlap. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zeeshan Hayder , Xuming He

Panoptic Scene Graph Generation (PSG) parses objects and predicts their relationships (predicate) to connect human language and visual scenes. However, different language preferences of annotators and semantic overlaps between predicates…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Li Li , Wei Ji , Yiming Wu , Mengze Li , You Qin , Lina Wei , Roger Zimmermann

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

Scene Graph Generation (SGG) is a task that encodes visual relationships between objects in images as graph structures. SGG shows significant promise as a foundational component for downstream tasks, such as reasoning for embodied agents.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Maëlic Neau , Zoe Falomir

We introduce BiGR, a novel conditional image generation model using compact binary latent codes for generative training, focusing on enhancing both generation and representation capabilities. BiGR is the first conditional generative model…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Shaozhe Hao , Xuantong Liu , Xianbiao Qi , Shihao Zhao , Bojia Zi , Rong Xiao , Kai Han , Kwan-Yee K. Wong

Scene Graph Generation is a critical enabler of environmental comprehension for autonomous robotic systems. Most of existing methods, however, are often thwarted by the intricate dynamics of background complexity, which limits their ability…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Xukun Zhou , Zhenbo Song , Jun He , Hongyan Liu , Zhaoxin Fan

Different objects in the same scene are more or less related to each other, but only a limited number of these relationships are noteworthy. Inspired by DETR, which excels in object detection, we view scene graph generation as a set…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yuren Cong , Michael Ying Yang , Bodo Rosenhahn

Training Scene Graph Generation (SGG) models with natural language captions has become increasingly popular due to the abundant, cost-effective, and open-world generalization supervision signals that natural language offers. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Scene graph generation aims to detect visual relationship triplets, (subject, predicate, object). Due to biases in data, current models tend to predict common predicates, e.g. "on" and "at", instead of informative ones, e.g. "standing on"…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Lianli Gao , Xinyu Lyu , Yuyu Guo , Yuxuan Hu , Yuan-Fang Li , Lu Xu , Heng Tao Shen , Jingkuan Song

Scene graphs provide a rich, structured representation of a scene by encoding the entities (objects) and their spatial relationships in a graphical format. This representation has proven useful in several tasks, such as question answering,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Sanjoy Kundu , Sathyanarayanan N. Aakur

Scene Graph Generation (SGG) aims to detect all the visual relation triplets $<$\texttt{sub}, \texttt{pred}, \texttt{obj}$>$ in a given image. With the emergence of various advanced techniques for better utilizing both the intrinsic and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lin Li , Guikun Chen , Jun Xiao , Yi Yang , Chunping Wang , Long Chen

Graph generation generally aims to create new graphs that closely align with a specific graph distribution. Existing works often implicitly capture this distribution through the optimization of generators, potentially overlooking the…

Machine Learning · Computer Science 2024-07-19 Song Wang , Zhen Tan , Xinyu Zhao , Tianlong Chen , Huan Liu , Jundong Li

Scene Graph Generation (SGG) aims to identify entities and predict the relationship triplets \textit{\textless subject, predicate, object\textgreater } in visual scenes. Given the prevalence of large visual variations of subject-object…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jiankai Li , Yunhong Wang , Xiefan Guo , Ruijie Yang , Weixin Li

Scene Graph Generation (SGG) research has suffered from two fundamental challenges: the long-tailed predicate distribution and semantic ambiguity between predicates. These challenges lead to a bias towards head predicates in SGG models,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Kanghoon Yoon , Kibum Kim , Jaehyung Jeon , Yeonjun In , Donghyun Kim , Chanyoung Park

Scene graph generation (SGG) is designed to extract (subject, predicate, object) triplets in images. Recent works have made a steady progress on SGG, and provide useful tools for high-level vision and language understanding. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Ao Zhang , Yuan Yao , Qianyu Chen , Wei Ji , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Scene Graph Generation(SGG) is a scene understanding task that aims at identifying object entities and reasoning their relationships within a given image. In contrast to prevailing two-stage methods based on a large object detector (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Xinyao Liao , Wei Wei , Dangyang Chen , Yuanyuan Fu

Scene Graph Generation (SGG) provides basic language representation of visual scenes, requiring models to grasp complex and diverse semantics between objects. This complexity and diversity in SGG leads to underrepresentation, where parts of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Yuxuan Wang , Xiaoyuan Liu