中文
相关论文

相关论文: SGTR+: End-to-end Scene Graph Generation with Tran…

200 篇论文

Today's scene graph generation (SGG) task is still far from practical, mainly due to the severe training bias, e.g., collapsing diverse "human walk on / sit on / lay on beach" into "human on beach". Given such SGG, the down-stream tasks…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Kaihua Tang , Yulei Niu , Jianqiang Huang , Jiaxin Shi , Hanwang Zhang

In this paper, we address the task of semantic-guided scene generation. One open challenge in scene generation is the difficulty of the generation of small objects and detailed local texture, which has been widely observed in global…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Hao Tang , Dan Xu , Yan Yan , Philip H. S. Torr , Nicu Sebe

Scene graph generation (SGG) models have suffered from inherent problems regarding the benchmark datasets such as the long-tailed predicate distribution and missing annotation problems. In this work, we aim to alleviate the long-tailed…

计算机视觉与模式识别 · 计算机科学 2024-08-05 Kibum Kim , Kanghoon Yoon , Yeonjun In , Jinyoung Moon , Donghyun Kim , Chanyoung Park

As a natural extension of the image synthesis task, video synthesis has attracted a lot of interest recently. Many image synthesis works utilize class labels or text as guidance. However, neither labels nor text can provide explicit…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yuren Cong , Jinhui Yi , Bodo Rosenhahn , Michael Ying Yang

Scene graph generation refers to the task of automatically mapping an image into a semantic structural graph, which requires correctly labeling each extracted object and their interaction relationships. Despite the recent success in object…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Mengshi Qi , Weijian Li , Zhengyuan Yang , Yunhong Wang , Jiebo Luo

We introduce the GANformer, a novel and efficient type of transformer, and explore it for the task of visual generative modeling. The network employs a bipartite structure that enables long-range interactions across the image, while…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Drew A. Hudson , C. Lawrence Zitnick

Recently the Transformer structure has shown good performances in graph learning tasks. However, these Transformer models directly work on graph nodes and may have difficulties learning high-level information. Inspired by the vision…

机器学习 · 计算机科学 2023-04-11 Han Gao , Xu Han , Jiaoyang Huang , Jian-Xun Wang , Li-Ping Liu

Scene graph is a structured representation of a scene that can clearly express the objects, attributes, and relationships between objects in the scene. As computer vision technology continues to develop, people are no longer satisfied with…

计算机视觉与模式识别 · 计算机科学 2022-01-10 Xiaojun Chang , Pengzhen Ren , Pengfei Xu , Zhihui Li , Xiaojiang Chen , Alex Hauptmann

Recent advancements in graph representation learning have shifted attention towards dynamic graphs, which exhibit evolving topologies and features over time. The increased use of such graphs creates a paramount need for generative models…

机器学习 · 计算机科学 2024-12-23 Ryien Hosseini , Filippo Simini , Venkatram Vishwanath , Henry Hoffmann

Learning similarity between scene graphs and images aims to estimate a similarity score given a scene graph and an image. There is currently no research dedicated to this task, although it is critical for scene graph generation and…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Yuren Cong , Wentong Liao , Bodo Rosenhahn , Michael Ying Yang

Recent progress in aspect-level sentiment classification has been propelled by the incorporation of graph neural networks (GNNs) leveraging syntactic structures, particularly dependency trees. Nevertheless, the performance of these models…

计算与语言 · 计算机科学 2023-12-08 Jane Sunny , Tom Padraig , Roggie Terry , Woods Ali

The rise of graph-structured data has driven interest in graph learning and synthetic data generation. While successful in text and image domains, synthetic graph generation remains challenging -- especially for real-world graphs with…

This work presents the introduction of UniSG^GA, a novel integrated scenegraph structure, that to incorporates behavior and geometry data on a 3D scene. It is specifically designed to seamlessly integrate Graph Neural Networks (GNNs) and…

Knowledge graph completion aims to address the problem of extending a KG with missing triples. In this paper, we provide an approach GenKGC, which converts knowledge graph completion to sequence-to-sequence generation task with the…

计算与语言 · 计算机科学 2023-03-15 Xin Xie , Ningyu Zhang , Zhoubo Li , Shumin Deng , Hui Chen , Feiyu Xiong , Mosha Chen , Huajun Chen

Scene recognition based on deep-learning has made significant progress, but there are still limitations in its performance due to challenges posed by inter-class similarities and intra-class dissimilarities. Furthermore, prior research has…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Amirhossein Aminimehr , Amirali Molaei , Erik Cambria

Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Ling Yang , Zhilin Huang , Yang Song , Shenda Hong , Guohao Li , Wentao Zhang , Bin Cui , Bernard Ghanem , Ming-Hsuan Yang

In recommender systems, most graph-based methods focus on positive user feedback, while overlooking the valuable negative feedback. Integrating both positive and negative feedback to form a signed graph can lead to a more comprehensive…

信息检索 · 计算机科学 2024-05-07 Sirui Chen , Jiawei Chen , Sheng Zhou , Bohao Wang , Shen Han , Chanfei Su , Yuqing Yuan , Can Wang

Scene graphs provide structured semantic understanding beyond images. For downstream tasks, such as image retrieval, visual question answering, visual relationship detection, and even autonomous vehicle technology, scene graphs can not only…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Mingzhe Du

Despite the great success object detection and segmentation models have achieved in recognizing individual objects in images, performance on cognitive tasks such as image caption, semantic image retrieval, and visual QA is far from…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Weilin Cong , William Wang , Wang-Chien Lee

Generation of graphs is a major challenge for real-world tasks that require understanding the complex nature of their non-Euclidean structures. Although diffusion models have achieved notable success in graph generation recently, they are…

机器学习 · 计算机科学 2024-06-04 Jaehyeong Jo , Dongki Kim , Sung Ju Hwang