中文
相关论文

相关论文: Tackling the Unannotated: Scene Graph Generation w…

200 篇论文

Open-vocabulary scene graph generation (SGG) aims to describe visual scenes with flexible relation phrases beyond a fixed predicate set. Existing methods usually treat annotated triplets as positives and all unannotated object-pair…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Amir Hosseini , Sara Farahani , Xinyi Li , Suiyang Guang

Scene Graph Generation (SGG) offers a structured representation critical in many computer vision applications. Traditional SGG approaches, however, are limited by a closed-set assumption, restricting their ability to recognize only…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Scene Graph Generation (SGG) suffers from a long-tailed distribution, where a few predicate classes dominate while many others are underrepresented, leading to biased models that underperform on rare relations. Unbiased-SGG methods address…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Runfeng Qu , Ole Hall , Pia K Bideau , Julie Ouerfelli-Ethier , Martin Rolfs , Klaus Obermayer , Olaf Hellwich

Scene Graph Generation (SGG) aims to identify entities and predict the relationship triplets \textit{\textless subject, predicate, object\textgreater } in visual scenes. Given the prevalence of large visual variations of subject-object…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Jiankai Li , Yunhong Wang , Xiefan Guo , Ruijie Yang , Weixin Li

The intersection of vision and language is of major interest due to the increased focus on seamless integration between recognition and reasoning. Scene graphs (SGs) have emerged as a useful tool for multimodal image analysis, showing…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Bruno Souza , Marius Aasan , Helio Pedrini , Adín Ramírez Rivera

Scene Graph Generation (SGG) has achieved significant progress recently. However, most previous works rely heavily on fixed-size entity representations based on bounding box proposals, anchors, or learnable queries. As each representation's…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Hengyue Liu , Bir Bhanu

Research in scene graph generation (SGG) usually considers two-stage models, that is, detecting a set of entities, followed by combining them and labeling all possible relationships. While showing promising results, the pipeline structure…

计算机视觉与模式识别 · 计算机科学 2023-06-12 Alakh Desai , Tz-Ying Wu , Subarna Tripathi , Nuno Vasconcelos

Scene Graphs are widely applied in computer vision as a graphical representation of relationships between objects shown in images. However, these applications have not yet reached a practical stage of development owing to biased training…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Misaki Ohashi , Yusuke Matsui

Along with generative AI, interest in scene graph generation (SGG), which comprehensively captures the relationships and interactions between objects in an image and creates a structured graph-based representation, has significantly…

计算机视觉与模式识别 · 计算机科学 2023-11-03 Hyeongjin Kim , Sangwon Kim , Jong Taek Lee , Byoung Chul Ko

Scene Graph Generation (SGG) aims to generate a comprehensive graphical representation that accurately captures the semantic information of a given scenario. However, the SGG model's performance in predicting more fine-grained predicates is…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Jiasong Feng , Lichun Wang , Hongbo Xu , Kai Xu , Baocai Yin

Scene graph generation is a sophisticated task because there is no specific recognition pattern (e.g., "looking at" and "near" have no conspicuous difference concerning vision, whereas "near" could occur between entities with different…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Xiaoguang Chang , Teng Wang , Changyin Sun , Wenzhe Cai

Training Scene Graph Generation (SGG) models with natural language captions has become increasingly popular due to the abundant, cost-effective, and open-world generalization supervision signals that natural language offers. However, such…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Today's scene graph generation (SGG) task is still far from practical, mainly due to the severe training bias, e.g., collapsing diverse "human walk on / sit on / lay on beach" into "human on beach". Given such SGG, the down-stream tasks…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Kaihua Tang , Yulei Niu , Jianqiang Huang , Jiaxin Shi , Hanwang Zhang

Weakly-supervised video scene graph generation (WS-VSGG) aims to parse video content into structured relational triplets without bounding box annotations and with only sparse temporal labeling, significantly reducing annotation costs.…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Minseok Kang , Minhyeok Lee , Minjung Kim , Jungho Lee , Donghyeong Kim , Sungmin Woo , Inseok Jeon , Sangyoun Lee

3D scene graphs provide a structured representation of object entities and their relationships, enabling high-level interpretation and reasoning for robots while remaining intuitively understandable to humans. Existing approaches for 3D…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Zirui Wang , Ruiping Liu , Yufan Chen , Junwei Zheng , Weijia Fan , Kunyu Peng , Di Wen , Jiale Wei , Jiaming Zhang , Rainer Stiefelhagen

A major challenge in scene graph classification is that the appearance of objects and relations can be significantly different from one image to another. Previous works have addressed this by relational reasoning over all objects in an…

计算机视觉与模式识别 · 计算机科学 2020-12-18 Sahand Sharifzadeh , Sina Moayed Baharlou , Volker Tresp

Panoptic Scene Graph Generation (PSG) involves the detection of objects and the prediction of their corresponding relationships (predicates). However, the presence of biased predicate annotations poses a significant challenge for PSG…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Li Li , You Qin , Wei Ji , Yuxiao Zhou , Roger Zimmermann

Scene Graph Generation (SGG) plays a pivotal role in downstream vision-language tasks. Existing SGG methods typically suffer from poor compositional generalizations on unseen triplets. They are generally trained on incompletely annotated…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Jiankai Li , Yunhong Wang , Weixin Li

The task of dynamic scene graph generation (SGG) from videos is complicated and challenging due to the inherent dynamics of a scene, temporal fluctuation of model predictions, and the long-tailed distribution of the visual relationships in…

计算机视觉与模式识别 · 计算机科学 2023-07-03 Sayak Nag , Kyle Min , Subarna Tripathi , Amit K. Roy Chowdhury

Relationships encode the interactions among individual instances, and play a critical role in deep visual scene understanding. Suffering from the high predictability with non-visual information, existing methods tend to fit the statistical…

计算机视觉与模式识别 · 计算机科学 2019-08-27 Yuanzhi Liang , Yalong Bai , Wei Zhang , Xueming Qian , Li Zhu , Tao Mei