English

Scene Graph Generation with Geometric Context

Computer Vision and Pattern Recognition 2021-11-29 v1 Artificial Intelligence Machine Learning

Abstract

Scene Graph Generation has gained much attention in computer vision research with the growing demand in image understanding projects like visual question answering, image captioning, self-driving cars, crowd behavior analysis, activity recognition, and more. Scene graph, a visually grounded graphical structure of an image, immensely helps to simplify the image understanding tasks. In this work, we introduced a post-processing algorithm called Geometric Context to understand the visual scenes better geometrically. We use this post-processing algorithm to add and refine the geometric relationships between object pairs to a prior model. We exploit this context by calculating the direction and distance between object pairs. We use Knowledge Embedded Routing Network (KERN) as our baseline model, extend the work with our algorithm, and show comparable results on the recent state-of-the-art algorithms.

Keywords

Cite

@article{arxiv.2111.13131,
  title  = {Scene Graph Generation with Geometric Context},
  author = {Vishal Kumar and Albert Mundu and Satish Kumar Singh},
  journal= {arXiv preprint arXiv:2111.13131},
  year   = {2021}
}

Comments

Paper accepted at 6th IAPR International Conference on Computer Vision & Image Processing (CVIP2021), IIT Ropar, India

R2 v1 2026-06-24T07:52:12.837Z