English
Related papers

Related papers: Peer Learning for Unbiased Scene Graph Generation

200 papers

Image segmentation, the process of partitioning an image into meaningful regions, plays a pivotal role in computer vision and medical imaging applications. Unsupervised segmentation, particularly in the absence of labeled data, remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Kovvuri Sai Gopal Reddy , Bodduluri Saran , A. Mudit Adityaja , Saurabh J. Shigwan , Nitin Kumar

Scene Graph Generation (SGG) is a visual understanding task, aiming to describe a scene as a graph of entities and their relationships with each other. Existing works rely on location labels in form of bounding boxes or segmentation masks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ege Özsoy , Felix Holm , Mahdi Saleh , Tobias Czempiel , Chantal Pellegrini , Nassir Navab , Benjamin Busam

Despite the great success object detection and segmentation models have achieved in recognizing individual objects in images, performance on cognitive tasks such as image caption, semantic image retrieval, and visual QA is far from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Weilin Cong , William Wang , Wang-Chien Lee

Unsupervised graph representation learning has emerged as a powerful tool to address real-world problems and achieves huge success in the graph learning domain. Graph contrastive learning is one of the unsupervised graph representation…

Machine Learning · Computer Science 2022-03-08 Haoran Yang , Hongxu Chen , Shirui Pan , Lin Li , Philip S. Yu , Guandong Xu

A proper scene representation is central to the pursuit of spatial intelligence where agents can robustly reconstruct and efficiently understand 3D scenes. A scene representation is either metric, such as landmark maps in 3D reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Juexiao Zhang , Gao Zhu , Sihang Li , Xinhao Liu , Haorui Song , Xinran Tang , Chen Feng

Scene Graph Generation (SGG) as a critical task in image understanding, facing the challenge of head-biased prediction caused by the long-tail distribution of predicates. However, current unbiased SGG methods can easily prioritize improving…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Lei Wang , Zejian Yuan , Yao Lu , Badong Chen

The task of scene graph generation entails identifying object entities and their corresponding interaction predicates in a given image (or video). Due to the combinatorially large solution space, existing approaches to scene graph…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Siddhesh Khandelwal , Leonid Sigal

Research in scene graph generation has quickly gained traction in the past few years because of its potential to help in downstream tasks like visual question answering, image captioning, etc. Many interesting approaches have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Sandeep Inuganti , Vineeth N Balasubramanian

Semi-supervised semantic segmentation learns from small amounts of labelled images and large amounts of unlabelled images, which has witnessed impressive progress with the recent advance of deep neural networks. However, it often suffers…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Dayan Guan , Jiaxing Huang , Aoran Xiao , Shijian Lu

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

We address the challenging problem of semi-supervised learning in the context of multiple visual interpretations of the world by finding consensus in a graph of neural networks. Each graph node is a scene interpretation layer, while each…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Marius Leordeanu , Mihai Pirvu , Dragos Costea , Alina Marcu , Emil Slusanschi , Rahul Sukthankar

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research because of its powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Guangming Zhu , Liang Zhang , Youliang Jiang , Yixuan Dang , Haoran Hou , Peiyi Shen , Mingtao Feng , Xia Zhao , Qiguang Miao , Syed Afaq Ali Shah , Mohammed Bennamoun

In Scene Graph Generation (SGG), structured representations are extracted from visual inputs as object nodes and connecting predicates, enabling image-based reasoning for diverse downstream tasks. While fully supervised SGG has improved…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Abdelrahman Elskhawy , Mengze Li , Nassir Navab , Benjamin Busam

Unsupervised graph representation learning aims to learn low-dimensional node embeddings without supervision while preserving graph topological structures and node attributive features. Previous graph neural networks (GNN) require a large…

Machine Learning · Computer Science 2020-09-04 Yanqiao Zhu , Yichen Xu , Feng Yu , Shu Wu , Liang Wang

Scene Graph Generation (SGG) serves a comprehensive representation of the images for human understanding as well as visual understanding tasks. Due to the long tail bias problem of the object and predicate labels in the available annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Anh Duc Bui , Soyeon Caren Han , Josiah Poon

Unsupervised learning has grown in popularity because of the difficulty of collecting annotated data and the development of modern frameworks that allow us to learn from unlabeled data. Existing studies, however, either disregard variations…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yi-Zhan Xu , Chih-Yao Chen , Cheng-Te Li

Current Scene Graph Generation (SGG) methods tend to predict frequent predicate categories and fail to recognize rare ones due to the severe imbalanced distribution of predicates. To improve the robustness of SGG models on different…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xingchen Li , Long Chen , Jian Shao , Shaoning Xiao , Songyang Zhang , Jun Xiao

Scene graph generation is a sophisticated task because there is no specific recognition pattern (e.g., "looking at" and "near" have no conspicuous difference concerning vision, whereas "near" could occur between entities with different…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Xiaoguang Chang , Teng Wang , Changyin Sun , Wenzhe Cai

Biased enhanced sampling methods utilizing collective variables (CVs) are powerful tools for sampling conformational ensembles. Due to high intrinsic dimensions, efficiently generating conformational ensembles for complex systems requires…

Machine Learning · Computer Science 2023-12-19 Yikai Liu , Tushar K. Ghosh , Guang Lin , Ming Chen

In scene graph generation (SGG), learning with cross-entropy loss yields biased predictions owing to the severe imbalance in the distribution of the relationship labels in the dataset. Thus, this study proposes a method to generate scene…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Sorachi Kurita , Satoshi Oyama , Itsuki Noda