English
Related papers

Related papers: Learning Object-Centric Representations Based on S…

200 papers

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Object compositing based on 2D images is a challenging problem since it typically involves multiple processing stages such as color harmonization, geometry correction and shadow generation to generate realistic results. Furthermore,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yizhi Song , Zhifei Zhang , Zhe Lin , Scott Cohen , Brian Price , Jianming Zhang , Soo Ye Kim , Daniel Aliaga

We address the problem of multi-object 3D pose control in image diffusion models. Instead of conditioning on a sequence of text tokens, we propose to use a set of per-object representations, Neural Assets, to control the 3D pose of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Ziyi Wu , Yulia Rubanova , Rishabh Kabra , Drew A. Hudson , Igor Gilitschenski , Yusuf Aytar , Sjoerd van Steenkiste , Kelsey R. Allen , Thomas Kipf

As large-scale text-to-image generation models have made remarkable progress in the field of text-to-image generation, many fine-tuning methods have been proposed. However, these models often struggle with novel objects, especially with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jianxiang Lu , Cong Xie , Hui Guo

Object Detection has been a significant topic in computer vision. As the continuous development of Deep Learning, many advanced academic and industrial outcomes are established on localising and classifying the target objects, such as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Yingwei Zhou

Automatically discovering composable abstractions from raw perceptual data is a long-standing challenge in machine learning. Recent slot-based neural networks that learn about objects in a self-supervised manner have made exciting progress…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Ondrej Biza , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Gamaleldin F. Elsayed , Aravindh Mahendran , Thomas Kipf

The binding problem in artificial neural networks is actively explored with the goal of achieving human-level recognition skills through the comprehension of the world in terms of symbol-like entities. Especially in the field of computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jinwoo Kim , Janghyuk Choi , Jaehyun Kang , Changyeon Lee , Ho-Jin Choi , Seon Joo Kim

Model customization introduces new concepts to existing text-to-image models, enabling the generation of these new concepts/objects in novel contexts. However, such methods lack accurate camera view control with respect to the new object,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Nupur Kumari , Grace Su , Richard Zhang , Taesung Park , Eli Shechtman , Jun-Yan Zhu

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

Understanding dynamics from visual observations is a challenging problem that requires disentangling individual objects from the scene and learning their interactions. While recent object-centric models can successfully decompose a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Ziyi Wu , Nikita Dvornik , Klaus Greff , Thomas Kipf , Animesh Garg

Generating background scenes for salient objects plays a crucial role across various domains including creative design and e-commerce, as it enhances the presentation and context of subjects by integrating them into tailored environments.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Amir Erfan Eshratifar , Joao V. B. Soares , Kapil Thadani , Shaunak Mishra , Mikhail Kuznetsov , Yueh-Ning Ku , Paloma de Juan

Self-supervised methods for learning object-centric representations have recently been applied successfully to various datasets. This progress is largely fueled by slot-based methods, whose ability to cluster visual scenes into meaningful…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Roland S. Zimmermann , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Thomas Kipf , Klaus Greff

The appearance of the same object may vary in different scene images due to perspectives and occlusions between objects. Humans can easily identify the same object, even if occlusions exist, by completing the occluded parts based on its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Tonglin Chen , Bin Li , Zhimeng Shen , Xiangyang Xue

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , Kfir Aberman

Object-centric representations promise a key property for few-shot learning: Rather than treating a scene as a single unit, a model can decompose it into individual object-level parts that can be matched and compared across different…

Machine Learning · Computer Science 2026-05-19 Phu-Quy Nguyen-Lam , Phu-Hoa Pham , Dao Sy Duy Minh , Chi-Nguyen Tran , Huynh Trung Kiet , Long Tran-Thanh

Humans are remarkably good at understanding and reasoning about complex visual scenes. The capability to decompose low-level observations into discrete objects allows us to build a grounded abstract representation and identify the…

Machine Learning · Computer Science 2022-10-12 Ruixiang Zhang , Tong Che , Boris Ivanovic , Renhao Wang , Marco Pavone , Yoshua Bengio , Liam Paull

Unlike popular solutions based on dense feature maps, Object-Centric Learning (OCL) represents visual scenes as sub-symbolic object-level feature vectors, termed slots, which are highly versatile for tasks involving visual modalities. OCL…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rongzhen Zhao , Yi Zhao , Juho Kannala , Joni Pajarinen

We present a slot-wise, object-based transition model that decomposes a scene into objects, aligns them (with respect to a slot-wise object memory) to maintain a consistent order across time, and predicts how those objects evolve over…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Antonia Creswell , Rishabh Kabra , Chris Burgess , Murray Shanahan

Although data generation is often straightforward, extracting information from data is more difficult. Object-centric representation learning can extract information from images in an unsupervised manner. It does so by segmenting an image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Joël Küchler , Ellen van Maren , Vaiva Vasiliauskaitė , Katarina Vulić , Reza Abbasi-Asl , Stephan J. Ihle

The de facto approach in video object-centric learning maintains temporal consistency through learned dynamics modules that predict future object representations, called slots. We demonstrate that these predictors function as expensive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhiyuan Li , Rongzhen Zhao , Wenyan Yang , Wenshuai Zhao , Pekka Marttinen , Joni Pajarinen