English
Related papers

Related papers: An Interpretable Model for Scene Graph Generation

200 papers

Random graph models are frequently used as a controllable and versatile data source for experimental campaigns in various research fields. Generating such data-sets at scale is a non-trivial task as it requires design decisions typically…

Data Structures and Algorithms · Computer Science 2020-03-03 Manuel Penschuck , Ulrik Brandes , Michael Hamann , Sebastian Lamm , Ulrich Meyer , Ilya Safro , Peter Sanders , Christian Schulz

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy, several pivotal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Oran Gafni , Adam Polyak , Oron Ashual , Shelly Sheynin , Devi Parikh , Yaniv Taigman

Prior work in scene graph generation requires categorical supervision at the level of triplets - subjects and objects, and predicates that relate them, either with or without bounding box information. However, scene graph generation is a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Keren Ye , Adriana Kovashka

Semantic communication emphasizes the transmission of meaning rather than raw symbols. It offers a promising solution to alleviate network congestion and improve transmission efficiency. In this paper, we propose a wireless image…

Signal Processing · Electrical Eng. & Systems 2025-07-17 Chen Zhu , Siyun Liang , Zhouxiang Zhao , Jianrong Bao , Zhaohui Yang , Zhaoyang Zhang , Dusit Niyato

Infrared and visible image fusion has garnered considerable attention owing to the strong complementarity of these two modalities in complex, harsh environments. While deep learning-based fusion methods have made remarkable advances in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Guihui Li , Bowei Dong , Kaizhi Dong , Jiayi Li , Haiyong Zheng

3D scene graphs have recently emerged as a powerful high-level representation of 3D environments. A 3D scene graph describes the environment as a layered graph where nodes represent spatial concepts at multiple levels of abstraction and…

Robotics · Computer Science 2022-06-22 Nathan Hughes , Yun Chang , Luca Carlone

Recent advancements in Generative Artificial Intelligence (GenAI) have significantly enhanced the capabilities of both image generation and editing. However, current approaches often treat these tasks separately, leading to inefficiencies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Thanh-Nhan Vo , Trong-Thuan Nguyen , Tam V. Nguyen , Minh-Triet Tran

Scene understanding plays an important role in several high-level computer vision applications, such as autonomous vehicles, intelligent video surveillance, or robotics. However, too few solutions have been proposed for indoor/outdoor scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ayman Beghdadi , Azeddine Beghdadi , Mohib Ullah , Faouzi Alaya Cheikh , Malik Mallem

Scene Graph Generation (SGG) remains a challenging visual understanding task due to its compositional property. Most previous works adopt a bottom-up two-stage or a point-based one-stage approach, which often suffers from high time…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Rongjie Li , Songyang Zhang , Xuming He

Scene parsing from images is a fundamental yet challenging problem in visual content understanding. In this dense prediction task, the parsing model assigns every pixel to a categorical label, which requires the contextual information of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Litao Yu , Yongsheng Gao , Jun Zhou , Jian Zhang , Qiang Wu

In this work, we seek new insights into the underlying challenges of the Scene Graph Generation (SGG) task. Quantitative and qualitative analysis of the Visual Genome dataset implies -- 1) Ambiguity: even if inter-object relationship…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sangmin Woo , Junhyug Noh , Kangil Kim

For robots to perform a wide variety of tasks, they require a 3D representation of the world that is semantically rich, yet compact and efficient for task-driven perception and planning. Recent approaches have attempted to leverage features…

We demonstrate that a generative model for object shapes can achieve state of the art results on challenging scene text recognition tasks, and with orders of magnitude fewer training images than required for competing discriminative…

Computer Vision and Pattern Recognition · Computer Science 2016-11-10 Xinghua Lou , Ken Kansky , Wolfgang Lehrach , CC Laan , Bhaskara Marthi , D. Scott Phoenix , Dileep George

We introduce a framework for joint grounded scene graph - image generation, a challenging task involving high-dimensional, multi-modal structured data. To effectively model this complex joint distribution, we adopt a factorized approach:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Bicheng Xu , Qi Yan , Renjie Liao , Lele Wang , Leonid Sigal

We propose a network architecture to perform efficient scene understanding. This work presents three main novelties: the first is an Improved Guided Upsampling Module that can replace in toto the decoder part in common semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Davide Mazzini , Raimondo Schettini

The paper presents a novel two-stream network architecture for enhancing scene understanding in computer vision. This architecture utilizes a graph feature stream and an image feature stream, aiming to merge the strengths of both modalities…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Wenkai Yang , Wenyuan Sun , Runxaing Huang

Recognizing a traffic accident is an essential part of any autonomous driving or road monitoring system. An accident can appear in a wide variety of forms, and understanding what type of accident is taking place may be useful to prevent it…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Aaron Lohner , Francesco Compagno , Jonathan Francis , Alessandro Oltramari

A proper scene representation is central to the pursuit of spatial intelligence where agents can robustly reconstruct and efficiently understand 3D scenes. A scene representation is either metric, such as landmark maps in 3D reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Juexiao Zhang , Gao Zhu , Sihang Li , Xinhao Liu , Haorui Song , Xinran Tang , Chen Feng

3D scene graph prediction is a task that aims to concurrently predict object classes and their relationships within a 3D environment. As these environments are primarily designed by and for humans, incorporating commonsense knowledge…

Robotics · Computer Science 2023-08-15 Yiding Qiu , Henrik I. Christensen

Scene Graph Generation (SGG) aims to explore the relationships between objects in images and obtain scene summary graphs, thereby better serving downstream tasks. However, the long-tailed problem has adversely affected the scene graph's…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yansheng Li , Tingzhu Wang , Kang Wu , Linlin Wang , Xin Guo , Wenbin Wang