中文
相关论文

相关论文: Learning Object-Centric Representations Based on S…

200 篇论文

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Object compositing based on 2D images is a challenging problem since it typically involves multiple processing stages such as color harmonization, geometry correction and shadow generation to generate realistic results. Furthermore,…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Yizhi Song , Zhifei Zhang , Zhe Lin , Scott Cohen , Brian Price , Jianming Zhang , Soo Ye Kim , Daniel Aliaga

We address the problem of multi-object 3D pose control in image diffusion models. Instead of conditioning on a sequence of text tokens, we propose to use a set of per-object representations, Neural Assets, to control the 3D pose of…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Ziyi Wu , Yulia Rubanova , Rishabh Kabra , Drew A. Hudson , Igor Gilitschenski , Yusuf Aytar , Sjoerd van Steenkiste , Kelsey R. Allen , Thomas Kipf

As large-scale text-to-image generation models have made remarkable progress in the field of text-to-image generation, many fine-tuning methods have been proposed. However, these models often struggle with novel objects, especially with…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Jianxiang Lu , Cong Xie , Hui Guo

Object Detection has been a significant topic in computer vision. As the continuous development of Deep Learning, many advanced academic and industrial outcomes are established on localising and classifying the target objects, such as…

计算机视觉与模式识别 · 计算机科学 2019-07-31 Yingwei Zhou

Automatically discovering composable abstractions from raw perceptual data is a long-standing challenge in machine learning. Recent slot-based neural networks that learn about objects in a self-supervised manner have made exciting progress…

计算机视觉与模式识别 · 计算机科学 2023-07-24 Ondrej Biza , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Gamaleldin F. Elsayed , Aravindh Mahendran , Thomas Kipf

The binding problem in artificial neural networks is actively explored with the goal of achieving human-level recognition skills through the comprehension of the world in terms of symbol-like entities. Especially in the field of computer…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Jinwoo Kim , Janghyuk Choi , Jaehyun Kang , Changyeon Lee , Ho-Jin Choi , Seon Joo Kim

Model customization introduces new concepts to existing text-to-image models, enabling the generation of these new concepts/objects in novel contexts. However, such methods lack accurate camera view control with respect to the new object,…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Nupur Kumari , Grace Su , Richard Zhang , Taesung Park , Eli Shechtman , Jun-Yan Zhu

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

Understanding dynamics from visual observations is a challenging problem that requires disentangling individual objects from the scene and learning their interactions. While recent object-centric models can successfully decompose a scene…

计算机视觉与模式识别 · 计算机科学 2023-01-24 Ziyi Wu , Nikita Dvornik , Klaus Greff , Thomas Kipf , Animesh Garg

Generating background scenes for salient objects plays a crucial role across various domains including creative design and e-commerce, as it enhances the presentation and context of subjects by integrating them into tailored environments.…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Amir Erfan Eshratifar , Joao V. B. Soares , Kapil Thadani , Shaunak Mishra , Mikhail Kuznetsov , Yueh-Ning Ku , Paloma de Juan

Self-supervised methods for learning object-centric representations have recently been applied successfully to various datasets. This progress is largely fueled by slot-based methods, whose ability to cluster visual scenes into meaningful…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Roland S. Zimmermann , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Thomas Kipf , Klaus Greff

The appearance of the same object may vary in different scene images due to perspectives and occlusions between objects. Humans can easily identify the same object, even if occlusions exist, by completing the occluded parts based on its…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Tonglin Chen , Bin Li , Zhimeng Shen , Xiangyang Xue

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , Kfir Aberman

Object-centric representations promise a key property for few-shot learning: Rather than treating a scene as a single unit, a model can decompose it into individual object-level parts that can be matched and compared across different…

Humans are remarkably good at understanding and reasoning about complex visual scenes. The capability to decompose low-level observations into discrete objects allows us to build a grounded abstract representation and identify the…

机器学习 · 计算机科学 2022-10-12 Ruixiang Zhang , Tong Che , Boris Ivanovic , Renhao Wang , Marco Pavone , Yoshua Bengio , Liam Paull

Unlike popular solutions based on dense feature maps, Object-Centric Learning (OCL) represents visual scenes as sub-symbolic object-level feature vectors, termed slots, which are highly versatile for tasks involving visual modalities. OCL…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Rongzhen Zhao , Yi Zhao , Juho Kannala , Joni Pajarinen

We present a slot-wise, object-based transition model that decomposes a scene into objects, aligns them (with respect to a slot-wise object memory) to maintain a consistent order across time, and predicts how those objects evolve over…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Antonia Creswell , Rishabh Kabra , Chris Burgess , Murray Shanahan

Although data generation is often straightforward, extracting information from data is more difficult. Object-centric representation learning can extract information from images in an unsupervised manner. It does so by segmenting an image…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Joël Küchler , Ellen van Maren , Vaiva Vasiliauskaitė , Katarina Vulić , Reza Abbasi-Asl , Stephan J. Ihle

The de facto approach in video object-centric learning maintains temporal consistency through learned dynamics modules that predict future object representations, called slots. We demonstrate that these predictors function as expensive…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Zhiyuan Li , Rongzhen Zhao , Wenyan Yang , Wenshuai Zhao , Pekka Marttinen , Joni Pajarinen