English
Related papers

Related papers: Why Capsule Neural Networks Do Not Scale: Challeng…

200 papers

Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much fewer parameters due to their parameter sharing principle. Modern architectures usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Ilke Cugu , Emre Akbas

Neural fields, which represent signals as a function parameterized by a neural network, are a promising alternative to traditional discrete vector or grid-based representations. Compared to discrete representations, neural representations…

Machine Learning · Computer Science 2023-09-14 Jeffrey Gu , Kuan-Chieh Wang , Serena Yeung

The traditional convolution neural networks (CNN) have several drawbacks like the Picasso effect and the loss of information by the pooling layer. The Capsule network (CapsNet) was proposed to address these challenges because its…

Machine Learning · Computer Science 2021-09-24 Adewale Adeyemo , Faiq Khalid , Tolulope A. Odetola , Syed Rafay Hasan

Deep neural networks (DNNs) are machine learning algorithms that have revolutionised computer vision due to their remarkable successes in tasks like object classification and segmentation. The success of DNNs as computer vision algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Felix A. Wichmann , Robert Geirhos

Modular neural networks outperform nonmodular neural networks on tasks ranging from visual question answering to robotics. These performance improvements are thought to be due to modular networks' superior ability to model the compositional…

Machine Learning · Computer Science 2025-03-12 Akhilan Boopathy , Sunshine Jiang , William Yue , Jaedong Hwang , Abhiram Iyer , Ila Fiete

Neural network models can now recognise images, understand text, translate languages, and play many human games at human or superhuman levels. These systems are highly abstracted, but are inspired by biological brains and use only…

Neurons and Cognition · Quantitative Biology 2019-03-06 Katherine R. Storrs , Nikolaus Kriegeskorte

Convolutional Neural Networks (CNNs) have produced state-of-the-art results for image classification tasks. However, they are limited in their ability to handle rotational and viewpoint variations due to information loss in max-pooling…

Machine Learning · Computer Science 2023-10-06 Samaneh Javadinia , Amirali Baniasadi

In neuroscience, all kinds of computation models were designed to answer the open question of how sensory stimuli are encoded by neurons and conversely, how sensory stimuli can be decoded from neuronal activities. Especially, functional…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Kai Qiao , Chi Zhang , Linyuan Wang , Bin Yan , Jian Chen , Lei Zeng , Li Tong

Quantum Neural Networks (QNNs) have been recently proposed as generalizations of classical neural networks to achieve the quantum speed-up. Despite the potential to outperform classical models, serious bottlenecks exist for training QNNs;…

Quantum Physics · Physics 2020-12-08 Kaining Zhang , Min-Hsiu Hsieh , Liu Liu , Dacheng Tao

Convolutional Neural Network(CNN) has been widely used for image recognition with great success. However, there are a number of limitations of the current CNN based image recognition paradigm. First, the receptive field of CNN is generally…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Dong-Qing Zhang

Tabular data are ubiquitous for the widespread applications of tables and hence have attracted the attention of researchers to extract underlying information. One of the critical problems in mining tabular data is how to understand their…

Machine Learning · Computer Science 2021-06-17 Lun Du , Fei Gao , Xu Chen , Ran Jia , Junshan Wang , Jiang Zhang , Shi Han , Dongmei Zhang

Traditionally, the vision community has devised algorithms to estimate the distance between an original image and images that have been subject to perturbations. Inspiration was usually taken from the human visual perceptual system and how…

Machine Learning · Computer Science 2020-11-18 Alexander Hepburn , Valero Laparra , Jesús Malo , Ryan McConville , Raul Santos-Rodriguez

Classical neural networks achieve only limited convergence in hard problems such as XOR or parity when the number of hidden neurons is small. With the motivation to improve the success rate of neural networks in these problems, we propose a…

Neural and Evolutionary Computing · Computer Science 2024-02-27 Kristína Malinovská , Slavomír Holenda , Ľudovít Malinovský

Reducing the size of a neural network (pruning) by removing weights without impacting its performance is an important problem for resource-constrained devices. In the past, pruning was typically accomplished by ranking or penalizing weights…

Machine Learning · Computer Science 2023-08-22 Rajan Sahu , Shivam Chadha , Nithin Nagaraj , Archana Mathur , Snehanshu Saha

Despite the success of convolution- and attention-based models in vision tasks, their rigid receptive fields and complex architectures limit their ability to model irregular spatial patterns and hinder interpretability, therefore posing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Xiangshuai Song , Jun-Jie Huang , Tianrui Liu , Ke Liang , Chang Tang

This paper presents an empirical exploration of the use of capsule networks for text classification. While it has been shown that capsule networks are effective for image classification, their validity in the domain of text has not been…

Computation and Language · Computer Science 2018-08-15 Jaeyoung Kim , Sion Jang , Sungchul Choi , Eunjeong Park

Modern artificial neural networks, including convolutional neural networks and vision transformers, have mastered several computer vision tasks, including object recognition. However, there are many significant differences between the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Tiago Oliveira , Tiago Marques , Arlindo L. Oliveira

Through the success of deep learning in various domains, artificial neural networks are currently among the most used artificial intelligence methods. Taking inspiration from the network properties of biological neural networks (e.g.…

Neural and Evolutionary Computing · Computer Science 2018-06-21 Decebal Constantin Mocanu , Elena Mocanu , Peter Stone , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta

Capsule networks (CapsNets) are an emerging trend in image processing. In contrast to a convolutional neural network, CapsNets are not vulnerable to object deformation, as the relative spatial information of the objects is preserved across…

Machine Learning · Computer Science 2024-04-09 Miguel Costa , Diogo Costa , Tiago Gomes , Sandro Pinto

Capsules are grouping of neurons that allow to represent sophisticated information of a visual entity such as pose and features. In the view of this property, Capsule Networks outperform CNNs in challenging tasks like object recognition in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Barış Özcan , Furkan Kınlı , Furkan Kıraç