English
Related papers

Related papers: Inference for Generative Capsule Models

200 papers

Learning to infer object representations, and in particular part-whole hierarchies, has been the focus of extensive research in computer vision, in pursuit of improving data efficiency, systematic generalisation, and robustness. Models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jake Levi , Mark van der Wilk

Capsule networks aim to parse images into a hierarchy of objects, parts and relations. While promising, they remain limited by an inability to learn effective low level part descriptions. To address this issue we propose a way to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-02-22 Sara Sabour , Andrea Tagliasacchi , Soroosh Yazdani , Geoffrey E. Hinton , David J. Fleet

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

We present a framework for efficient inference in structured image models that explicitly reason about objects. We achieve this by performing probabilistic inference using a recurrent neural network that attends to scene elements and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-15 S. M. Ali Eslami , Nicolas Heess , Theophane Weber , Yuval Tassa , David Szepesvari , Koray Kavukcuoglu , Geoffrey E. Hinton

Generative models have demonstrated remarkable abilities in generating high-fidelity visual content. In this work, we explore how generative models can further be used not only to synthesize visual content but also to understand the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yanbo Wang , Justin Dauwels , Yilun Du

Capsule networks promise significant benefits over convolutional networks by storing stronger internal representations, and routing information based on the agreement between intermediate representations' projections. Despite this, their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Rodney Lalonde , Naji Khosravan , Ulas Bagci

Adaptable models could greatly benefit robotic agents operating in the real world, allowing them to deal with novel and varying conditions. While approaches such as Bayesian inference are well-studied frameworks for adapting models to…

Machine Learning · Computer Science 2023-10-20 Orr Krupnik , Elisei Shafer , Tom Jurgenson , Aviv Tamar

Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models…

Computation and Language · Computer Science 2020-06-02 Zhengyang Wang , Xia Hu , Shuiwang Ji

Capsules are the multidimensional analogue to scalar neurons in neural networks, and because they are multidimensional, much more complex routing schemes can be used to pass information forward through the network than what can be used in…

Neural and Evolutionary Computing · Computer Science 2019-07-29 Michael Hauser

Deep learning has excelled in medical image classification, but its clinical application is limited by poor interpretability. Capsule networks, known for encoding hierarchical relationships and spatial features, show potential in addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xinyu Geng , Jiaming Wang , Jun Xu

Affordance detection from visual input is a fundamental step in autonomous robotic manipulation. Existing solutions to the problem of affordance detection rely on convolutional neural networks. However, these networks do not consider the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Antonio Rodríguez-Sánchez , Simon Haller-Seeber , David Peer , Chris Engelhardt , Jakob Mittelberger , Matteo Saveriano

Understanding morphological types of galaxies is a key parameter for studying their formation and evolution. Neural networks that have been used previously for galaxy morphology classification have some disadvantages, such as not being…

Instrumentation and Methods for Astrophysics · Physics 2019-04-10 Reza Katebi , Yadi Zhou , Ryan Chornock , Razvan Bunescu

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jerrin Bright , Suryaprakash Rajkumar , Arockia Selvakumar Arockia Doss

In this paper, we propose 3D point-capsule networks, an auto-encoder designed to process sparse 3D point clouds while preserving spatial arrangements of the input data. 3D capsule networks arise as a direct consequence of our novel unified…

Computer Vision and Pattern Recognition · Computer Science 2019-07-15 Yongheng Zhao , Tolga Birdal , Haowen Deng , Federico Tombari

Capsule networks are a type of neural network that have recently gained increased popularity. They consist of groups of neurons, called capsules, which encode properties of objects or object parts. The connections between capsules encrypt…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Josef Gugglberger , David Peer , Antonio Rodriguez-Sanchez

Convolutional neural networks (CNNs) have become a key asset to most of fields in AI. Despite their successful performance, CNNs suffer from a major drawback. They fail to capture the hierarchy of spatial relation among different parts of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Marzieh Edraki , Nazanin Rahnavard , Mubarak Shah

Machine learning based methods achieves impressive results in object classification and detection. Utilizing representative data of the visual world during the training phase is crucial to achieve good performance with such data driven…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Bruno Ferrarini , Shoaib Ehsan , Adrien Bartoli , Aleš Leonardis , Klaus D. McDonald-Maier

We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task, instead of relying on hand-engineered representations. Our framework is modular and consists of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Benjamin Gutierrez Becker , Ignacio Sarasua , Christian Wachinger

This project considers Capsule Networks, a recently introduced machine learning model that has shown promising results regarding generalization and preservation of spatial information with few parameters. The Capsule Network's inner routing…

Machine Learning · Computer Science 2020-01-10 Gonçalo Faria

Learning to insert an object instance into an image in a semantically coherent manner is a challenging and interesting problem. Solving it requires (a) determining a location to place an object in the scene and (b) determining its…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Donghoon Lee , Sifei Liu , Jinwei Gu , Ming-Yu Liu , Ming-Hsuan Yang , Jan Kautz