English
Related papers

Related papers: ReCon1M:A Large-scale Benchmark Dataset for Relati…

200 papers

Recently, the diffusion-based generative paradigm has achieved impressive general image generation capabilities with text prompts due to its accurate distribution modeling and stable training process. However, generating diverse remote…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Jialin Luo , Yuanzhi Wang , Ziqi Gu , Yide Qiu , Shuaizhen Yao , Fuyun Wang , Chunyan Xu , Wenhua Zhang , Dan Wang , Zhen Cui

Despite the great success object detection and segmentation models have achieved in recognizing individual objects in images, performance on cognitive tasks such as image caption, semantic image retrieval, and visual QA is far from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Weilin Cong , William Wang , Wang-Chien Lee

Learning to compose visual relationships from raw images in the form of scene graphs is a highly challenging task due to contextual dependencies, but it is essential in computer vision applications that depend on scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Neau Maëlic , Paulo E. Santos , Anne-Gwenn Bosser , Cédric Buche

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Scene Graph Generation (SGG) offers a structured representation critical in many computer vision applications. Traditional SGG approaches, however, are limited by a closed-set assumption, restricting their ability to recognize only…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Scene graph generation aims to capture detailed spatial and semantic relationships between objects in an image, which is challenging due to incomplete labelling, long-tailed relationship categories, and relational semantic overlap. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zeeshan Hayder , Xuming He

The scene graph generation (SGG) task aims to detect visual relationship triplets, i.e., subject, predicate, object, in an image, providing a structural vision layout for scene understanding. However, current models are stuck in common…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Yuyu Guo , Lianli Gao , Xuanhan Wang , Yuxuan Hu , Xing Xu , Xu Lu , Heng Tao Shen , Jingkuan Song

Predicting a scene graph that captures visual entities and their interactions in an image has been considered a crucial step towards full scene comprehension. Recent scene graph generation (SGG) models have shown their capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Tzu-Jui Julius Wang , Selen Pehlivan , Jorma Laaksonen

Existing research addresses scene graph generation (SGG) -- a critical technology for scene understanding in images -- from a detection perspective, i.e., objects are detected using bounding boxes followed by prediction of their pairwise…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Jingkang Yang , Yi Zhe Ang , Zujin Guo , Kaiyang Zhou , Wayne Zhang , Ziwei Liu

Remote Sensing Large Multi-Modal Models (RSLMMs) are developing rapidly and showcase significant capabilities in remote sensing imagery (RSI) comprehension. However, due to the limitations of existing datasets, RSLMMs have shortcomings in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Junwei Luo , Zhen Pang , Yongjun Zhang , Tingzhu Wang , Linlin Wang , Bo Dang , Jiangwei Lao , Jian Wang , Jingdong Chen , Yihua Tan , Yansheng Li

Scene graph generation (SGG) aims to capture a wide variety of interactions between pairs of objects, which is essential for full scene understanding. Existing SGG methods trained on the entire set of relations fail to acquire complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Arushi Goel , Basura Fernando , Frank Keller , Hakan Bilen

Existing work has observed that current text-to-image systems do not accurately reflect explicit spatial relations between objects such as 'left of' or 'below'. We hypothesize that this is because explicit spatial relations rarely appear in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Ander Salaberria , Gorka Azkune , Oier Lopez de Lacalle , Aitor Soroa , Eneko Agirre , Frank Keller

Scene Graph Generation (SGG) aims to explore the relationships between objects in images and obtain scene summary graphs, thereby better serving downstream tasks. However, the long-tailed problem has adversely affected the scene graph's…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yansheng Li , Tingzhu Wang , Kang Wu , Linlin Wang , Xin Guo , Wenbin Wang

Scene graph generation (SGG) aims to understand the visual objects and their semantic relationships from one given image. Until now, lots of SGG datasets with the eyelevel view are released but the SGG dataset with the overhead view is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Yansheng Li , Kun Li , Yongjun Zhang , Linlin Wang , Dingwen Zhang

Along with generative AI, interest in scene graph generation (SGG), which comprehensively captures the relationships and interactions between objects in an image and creates a structured graph-based representation, has significantly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hyeongjin Kim , Sangwon Kim , Jong Taek Lee , Byoung Chul Ko

While text-to-image generation has been extensively studied, generating images from scene graphs remains relatively underexplored, primarily due to challenges in accurately modeling spatial relationships and object interactions. To fill…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zuyao Chen , Jinlin Wu , Zhen Lei , Chang Wen Chen

Identifying objects in an image and their mutual relationships as a scene graph leads to a deep understanding of image content. Despite the recent advancement in deep learning, the detection and labeling of visual object relationships…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Rajat Koner , Poulami Sinhamahapatra , Volker Tresp

Dynamic Scene Graph Generation (DSGG) models how object relations evolve over time in videos. However, existing methods are trained only on annotated object pairs and lack guidance for non-related pairs, making it difficult to identify…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Hae-Won Jo , Yeong-Jun Cho

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

The significant progress on Generative Adversarial Networks (GANs) has facilitated realistic single-object image generation based on language input. However, complex-scene generation (with various interactions among multiple objects) still…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Tianyu Hua , Hongdong Zheng , Yalong Bai , Wei Zhang , Xiao-Ping Zhang , Tao Mei