English
Related papers

Related papers: Unsupervised part representation by Flow Capsules

200 papers

In this work we propose a capsule-based approach for semi-supervised video object segmentation. Current video object segmentation methods are frame-based and often require optical flow to capture temporal consistency across frames which can…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Kevin Duarte , Yogesh S Rawat , Mubarak Shah

The ability to decompose scenes into their object components is a desired property for autonomous agents, allowing them to reason and act in their surroundings. Recently, different methods have been proposed to learn object-centric…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Angel Villar-Corrales , Sven Behnke

Part-based image classification aims at representing categories by small sets of learned discriminative parts, upon which an image representation is built. Considered as a promising avenue a decade ago, this direction has been neglected…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Ronan Sicre , Yannis Avrithis , Ewa Kijak , Frederic Jurie

Capsule networks (see e.g. Hinton et al., 2018) aim to encode knowledge and reason about the relationship between an object and its parts. In this paper we specify a \emph{generative} model for such data, and derive a variational algorithm…

Machine Learning · Computer Science 2022-03-16 Alfredo Nazabal , Nikolaos Tsagkas , Christopher K. I. Williams

We present a new algorithm for multi-region segmentation of 2D images with objects that may partially occlude each other. Our algorithm is based on the observation hat human performance on this task is based both on prior knowledge about…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Yuka Kihara , Matvey Soloviev , Tsuhan Chen

In this paper, we address the task of detecting semantic parts on partially occluded objects. We consider a scenario where the model is trained using non-occluded images but tested on occluded images. The motivation is that there are…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Jianyu Wang , Cihang Xie , Zhishuai Zhang , Jun Zhu , Lingxi Xie , Alan Yuille

We address the problem of discovering part segmentations of articulated objects without supervision. In contrast to keypoints, part segmentations provide information about part localizations on the level of individual pixels. Capturing both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Sandro Braun , Patrick Esser , Björn Ommer

This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Deepak Pathak , Ross Girshick , Piotr Dollár , Trevor Darrell , Bharath Hariharan

Image recognition tasks that involve identifying parts of an object or the contents of a vessel can be viewed as a hierarchical problem, which can be solved by initial recognition of the main object, followed by recognition of its parts or…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Sagi Eppel

Convolutional Neural Networks (CNNs) have achieved promising results in medical image segmentation. However, CNNs require lots of training data and are incapable of handling pose and deformation of objects. Furthermore, their pooling layers…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Minh Tran , Viet-Khoa Vo-Ho , Ngan T. H. Le

Our work expands the use of capsule networks to the task of object segmentation for the first time in the literature. This is made possible via the introduction of locally-constrained routing and transformation matrix sharing, which reduces…

Image and Video Processing · Electrical Eng. & Systems 2020-12-14 Rodney LaLonde , Ziyue Xu , Ismail Irmakci , Sanjay Jain , Ulas Bagci

Existing scene understanding systems mainly focus on recognizing the visible parts of a scene, ignoring the intact appearance of physical objects in the real-world. Concurrently, image completion has aimed to create plausible appearance for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Chuanxia Zheng , Duy-Son Dao , Guoxian Song , Tat-Jen Cham , Jianfei Cai

Capsule networks are biologically inspired neural networks that group neurons into vectors called capsules, each explicitly representing an object or one of its parts. The routing mechanism connects capsules in consecutive layers, forming a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Riccardo Renzulli , Enzo Tartaglione , Marco Grangetto

Capsule networks are a recently developed class of neural networks that potentially address some of the deficiencies with traditional convolutional neural networks. By replacing the standard scalar activations with vectors, and by…

Machine Learning · Computer Science 2020-01-30 Arjun Punjabi , Jonas Schmid , Aggelos K. Katsaggelos

Capsule Network is a promising concept in deep learning, yet its true potential is not fully realized thus far, providing sub-par performance on several key benchmark datasets with complex data. Drawing intuition from the success achieved…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jathushan Rajasegaran , Vinoj Jayasundara , Sandaru Jayasekara , Hirunima Jayasekara , Suranga Seneviratne , Ranga Rodrigo

We present an unsupervised learning framework for decomposing images into layers of automatically discovered object models. Contrary to recent approaches that model image layers with autoencoder networks, we represent them as explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Tom Monnier , Elliot Vincent , Jean Ponce , Mathieu Aubry

Objects are composed of a set of geometrically organized parts. We introduce an unsupervised capsule autoencoder (SCAE), which explicitly uses geometric relationships between parts to reason about objects. Since these relationships do not…

Machine Learning · Statistics 2019-12-03 Adam R. Kosiorek , Sara Sabour , Yee Whye Teh , Geoffrey E. Hinton

This technical report investigates the potential of Convolutional Neural Networks to post-process images from primary atomization. Three tasks are investigated. First, the detection and segmentation of liquid droplets in degraded optical…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Geoffroy Chaussonnet , Christian Lieber , Yan Yikang , Wenda Gu , Andreas Bartschat , Markus Reischl , Rainer Koch , Ralf Mikut , Hans-Jörg Bauer

Existing deep learning based unsupervised video object segmentation methods still rely on ground-truth segmentation masks to train. Unsupervised in this context only means that no annotated frames are used during inference. As obtaining…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Sahir Shrestha , Mohammad Ali Armin , Hongdong Li , Nick Barnes

Self-supervised representation learning is able to learn semantically meaningful features; however, much of its recent success relies on multiple crops of an image with very few objects. Instead of learning view-invariant representation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Yuwen Xiong , Mengye Ren , Wenyuan Zeng , Raquel Urtasun