English
Related papers

Related papers: Robo-SGG: Exploiting Layout-Oriented Normalization…

200 papers

Scene Graph Generation (SGG) provides basic language representation of visual scenes, requiring models to grasp complex and diverse semantics between objects. This complexity and diversity in SGG leads to underrepresentation, where parts of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Yuxuan Wang , Xiaoyuan Liu

Recent studies have revealed that GNNs are vulnerable to adversarial attacks. To defend against such attacks, robust graph structure refinement (GSR) methods aim at minimizing the effect of adversarial edges based on node features, graph…

Machine Learning · Computer Science 2024-03-05 Yeonjun In , Kanghoon Yoon , Kibum Kim , Kijung Shin , Chanyoung Park

Scene Graph Generation (SGG) plays a pivotal role in downstream vision-language tasks. Existing SGG methods typically suffer from poor compositional generalizations on unseen triplets. They are generally trained on incompletely annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiankai Li , Yunhong Wang , Weixin Li

Scene Graph Generation (SGG) remains a challenging visual understanding task due to its compositional property. Most previous works adopt a bottom-up two-stage or a point-based one-stage approach, which often suffers from high time…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Rongjie Li , Songyang Zhang , Xuming He

Next-token prediction is the fundamental principle for training large language models (LLMs), and reinforcement learning (RL) further enhances their reasoning performance. As an effective way to model language, image, video, and other…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zuyao Chen , Jinlin Wu , Zhen Lei , Marc Pollefeys , Chang Wen Chen

Scene graph generation (SGG) aims to automatically map an image into a semantic structural graph for better scene understanding. It has attracted significant attention for its ability to provide object and relation information, enabling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xinyu Zhou , Zihan Ji , Anna Zhu

Generating structured, editable diagrams remains a significant challenge for contemporary large language models, despite their proficiency in general-purpose vector code generation. The primary difficulty lies in the structural fragility of…

Computation and Language · Computer Science 2026-05-26 Sifan Li , Yujun Cai , Hongkai Chen , Yiwei Wang

Scene Graph Generation is a critical enabler of environmental comprehension for autonomous robotic systems. Most of existing methods, however, are often thwarted by the intricate dynamics of background complexity, which limits their ability…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Xukun Zhou , Zhenbo Song , Jun He , Hongyan Liu , Zhaoxin Fan

Self-supervised learning (SSL) with vision transformers (ViTs) has proven effective for representation learning as demonstrated by the impressive performance on various downstream tasks. Despite these successes, existing ViT-based SSL…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Chaitanya Devaguptapu , Sumukh Aithal , Shrinivas Ramasubramanian , Moyuru Yamada , Manohar Kaul

Masked graph autoencoder (MGAE) has emerged as a promising self-supervised graph pre-training (SGP) paradigm due to its simplicity and effectiveness. However, existing efforts perform the mask-then-reconstruct operation in the raw data…

Machine Learning · Computer Science 2023-04-07 Wenxuan Tu , Qing Liao , Sihang Zhou , Xin Peng , Chuan Ma , Zhe Liu , Xinwang Liu , Zhiping Cai

Scene Graph Generation (SGG) remains a challenging visual understanding task due to its compositional property. Most previous works adopt a bottom-up, two-stage or point-based, one-stage approach, which often suffers from high time…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Rongjie Li , Songyang Zhang , Xuming He

Scene graph generation (SGG) is a fundamental task aimed at detecting visual relations between objects in an image. The prevailing SGG methods require all object classes to be given in the training set. Such a closed setting limits the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

To improve the robustness of graph neural networks (GNN), graph structure learning (GSL) has attracted great interest due to the pervasiveness of noise in graph data. Many approaches have been proposed for GSL to jointly learn a clean graph…

Machine Learning · Computer Science 2023-07-06 Shaogao Lv , Gang Wen , Shiyu Liu , Linsen Wei , Ming Li

Scene graph generation (SGG) aims to capture a wide variety of interactions between pairs of objects, which is essential for full scene understanding. Existing SGG methods trained on the entire set of relations fail to acquire complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Arushi Goel , Basura Fernando , Frank Keller , Hakan Bilen

Scene Graph Generation (SGG) research has suffered from two fundamental challenges: the long-tailed predicate distribution and semantic ambiguity between predicates. These challenges lead to a bias towards head predicates in SGG models,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Kanghoon Yoon , Kibum Kim , Jaehyung Jeon , Yeonjun In , Donghyun Kim , Chanyoung Park

Deep learning-based graph generation approaches have remarkable capacities for graph data modeling, allowing them to solve a wide range of real-world problems. Making these methods able to consider different conditions during the generation…

Machine Learning · Computer Science 2023-01-11 Faezeh Faez , Negin Hashemi Dijujin , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Scene-Graph Generation (SGG) seeks to recognize objects in an image and distill their salient pairwise relationships. Most methods depend on dataset-specific supervision to learn the variety of interactions, restricting their usefulness in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Amartya Dutta , Kazi Sajeed Mehrab , Medha Sawhney , Abhilash Neog , Mridul Khurana , Sepideh Fatemi , Aanish Pradhan , M. Maruf , Ismini Lourentzou , Arka Daw , Anuj Karpatne

Scene graphs provide valuable information to many downstream tasks. Many scene graph generation (SGG) models solely use the limited annotated relation triples for training, leading to their underperformance on low-shot (few and zero)…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tao He , Lianli Gao , Jingkuan Song , Jianfei Cai , Yuan-Fang Li

Scene graph generation from images is a task of great interest to applications such as robotics, because graphs are the main way to represent knowledge about the world and regulate human-robot interactions in tasks such as Visual Question…

Robotics · Computer Science 2022-12-21 Fernando Amodeo , Fernando Caballero , Natalia Díaz-Rodríguez , Luis Merino

Effectively capturing intricate interactions among road users is of critical importance to achieving safe navigation for autonomous vehicles. While graph learning (GL) has emerged as a promising approach to tackle this challenge, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Junyao Wang , Arnav Vaibhav Malawade , Junhong Zhou , Shih-Yuan Yu , Mohammad Abdullah Al Faruque