中文
相关论文

相关论文: Towards Lifelong Scene Graph Generation with Knowl…

200 篇论文

Scene graph generation (SGG) is an important task in image understanding because it represents the relationships between objects in an image as a graph structure, making it possible to understand the semantic relationships between objects…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Hyeongjin Kim , Sangwon Kim , Dasom Ahn , Jong Taek Lee , Byoung Chul Ko

The scene graph generation (SGG) task aims to detect visual relationship triplets, i.e., subject, predicate, object, in an image, providing a structural vision layout for scene understanding. However, current models are stuck in common…

计算机视觉与模式识别 · 计算机科学 2021-08-31 Yuyu Guo , Lianli Gao , Xuanhan Wang , Yuxuan Hu , Xing Xu , Xu Lu , Heng Tao Shen , Jingkuan Song

Scene Graph Generation (SGG) encodes visual relationships between objects in images as graph structures. Thanks to the advances of Vision-Language Models (VLMs), the task of Open-Vocabulary SGG has been recently proposed where models are…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Maëlic Neau , Zoe Falomir , Cédric Buche , Akihiro Sugimoto

Learning to compose visual relationships from raw images in the form of scene graphs is a highly challenging task due to contextual dependencies, but it is essential in computer vision applications that depend on scene understanding.…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Neau Maëlic , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche

Scene graph generation from images is a task of great interest to applications such as robotics, because graphs are the main way to represent knowledge about the world and regulate human-robot interactions in tasks such as Visual Question…

机器人学 · 计算机科学 2022-12-21 Fernando Amodeo , Fernando Caballero , Natalia Díaz-Rodríguez , Luis Merino

Current approaches for open-vocabulary scene graph generation (OVSGG) use vision-language models such as CLIP and follow a standard zero-shot pipeline -- computing similarity between the query image and the text embeddings for each category…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Guikun Chen , Jin Li , Wenguan Wang

Scene Graph Generation (SGG) converts visual scenes into structured graph representations, providing deeper scene understanding for complex vision tasks. However, existing SGG models often overlook essential spatial relationships and…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Mingjie Xu , Mengyang Wu , Yuzhi Zhao , Jason Chun Lok Li , Weifeng Ou

Open-vocabulary scene graph generation (SGG) aims to describe visual scenes with flexible and fine-grained relation phrases beyond a fixed predicate vocabulary. While recent vision-language models greatly expand the semantic coverage of…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Suiyang Guang , Chenyu Liu , Ruohan Zhang , Siyuan Chen

Scene Graph Generation (SGG) structures visual scenes as graphs of objects and their relations. While Multimodal Large Language Models (MLLMs) have advanced end-to-end SGG, current methods are hindered by both a lack of task-specific…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Jiaye Feng , Qixiang Yin , Yuankun Liu , Tong Mo , Weiping Li

Understanding a visual scene goes beyond recognizing individual objects in isolation. Relationships between objects also constitute rich semantic information about the scene. In this work, we explicitly model the objects and their…

计算机视觉与模式识别 · 计算机科学 2017-04-13 Danfei Xu , Yuke Zhu , Christopher B. Choy , Li Fei-Fei

Scene Graph Generation (SGG) serves a comprehensive representation of the images for human understanding as well as visual understanding tasks. Due to the long tail bias problem of the object and predicate labels in the available annotated…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Anh Duc Bui , Soyeon Caren Han , Josiah Poon

Scene graph generation (SGG) aims to detect objects and predict their pairwise relationships within an image. Current SGG methods typically utilize graph neural networks (GNNs) to acquire context information between objects/relationships.…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Xin Lin , Changxing Ding , Yibing Zhan , Zijian Li , Dacheng Tao

The Scene Graph Generation (SGG) task aims to detect all the objects and their pairwise visual relationships in a given image. Although SGG has achieved remarkable progress over the last few years, almost all existing SGG models follow the…

计算机视觉与模式识别 · 计算机科学 2022-08-09 Lin Li , Long Chen , Hanrong Shi , Wenxiao Wang , Jian Shao , Yi Yang , Jun Xiao

Spatio-temporal scene graphs provide a principled representation for modeling evolving object interactions, yet existing methods remain fundamentally frame-centric: they reason only about currently visible objects, discard entities upon…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Rohith Peddi , Saurabh , Shravan Shanmugam , Likhitha Pallapothula , Yu Xiang , Parag Singla , Vibhav Gogate

Scene graph generation aims to detect visual relationship triplets, (subject, predicate, object). Due to biases in data, current models tend to predict common predicates, e.g. "on" and "at", instead of informative ones, e.g. "standing on"…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Lianli Gao , Xinyu Lyu , Yuyu Guo , Yuxuan Hu , Yuan-Fang Li , Lu Xu , Heng Tao Shen , Jingkuan Song

Scene Graph Generation (SGG) aims to extract entities, predicates and their semantic structure from images, enabling deep understanding of visual content, with many applications such as visual reasoning and image retrieval. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Alireza Zareian , Svebor Karaman , Shih-Fu Chang

Training Scene Graph Generation (SGG) models with natural language captions has become increasingly popular due to the abundant, cost-effective, and open-world generalization supervision signals that natural language offers. However, such…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Today's open vocabulary scene graph generation (OVSGG) extends traditional SGG by recognizing novel objects and relationships beyond predefined categories, leveraging the knowledge from pre-trained large-scale models. Most existing methods…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Lin Li , Chuhan Zhang , Dong Zhang , Chong Sun , Chen Li , Long Chen

3D scene graph generation (SGG) has been of high interest in computer vision. Although the accuracy of 3D SGG on coarse classification and single relation label has been gradually improved, the performance of existing works is still far…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Yuanyuan Liu , Chengjiang Long , Zhaoxuan Zhang , Bokai Liu , Qiang Zhang , Baocai Yin , Xin Yang

Scene Graph Generation (SGG) provides basic language representation of visual scenes, requiring models to grasp complex and diverse semantics between objects. This complexity and diversity in SGG leads to underrepresentation, where parts of…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Yuxuan Wang , Xiaoyuan Liu