English
Related papers

Related papers: Learning Invariant Representations for Equivariant…

200 papers

Traditionally, deep convolutional neural networks consist of a series of convolutional and pooling layers followed by one or more fully connected (FC) layers to perform the final classification. While this design has been successful, for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Zhongchao Qian , Tyler L. Hayes , Kushal Kafle , Christopher Kanan

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Convolutional neural networks have shown great success on feature extraction from raw input data such as images. Although convolutional neural networks are invariant to translations on the inputs, they are not invariant to other…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Hongyang Gao , Shuiwang Ji

Quantum Neural Networks (QNNs) are suggested as one of the quantum algorithms which can be efficiently simulated with a low depth on near-term quantum hardware in the presence of noises. However, their performance highly relies on choosing…

Quantum Physics · Physics 2024-03-14 Su Yeon Chang , Michele Grossi , Bertrand Le Saux , Sofia Vallecorsa

Convolutional Neural Networks (CNNs) have recently been shown to excel at performing visual place recognition under changing appearance and viewpoint. Previously, place recognition has been improved by intelligently selecting relevant…

Robotics · Computer Science 2018-10-31 Stephen Hausler , Adam Jacobson , Michael Milford

This paper is focused on studying the view-manifold structure in the feature spaces implied by the different layers of Convolutional Neural Networks (CNN). There are several questions that this paper aims to answer: Does the learned CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Amr Bakry , Mohamed Elhoseiny , Tarek El-Gaaly , Ahmed Elgammal

A large number of deep learning architectures use spatial transformations of CNN feature maps or filters to better deal with variability in object appearance caused by natural image transformations. In this paper, we prove that spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Ylva Jansson , Maksim Maydanskiy , Lukas Finnveden , Tony Lindeberg

Convolutional Neural Networks (CNNs) have shown remarkable performance in general object recognition tasks. In this paper, we propose a new model called EnsNet which is composed of one base CNN and multiple Fully Connected SubNetworks…

Machine Learning · Computer Science 2023-07-19 Daiki Hirata , Norikazu Takahashi

Despite the effectiveness of Convolutional Neural Networks (CNNs) for image classification, our understanding of the relationship between shape of convolution kernels and learned representations is limited. In this work, we explore and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Zhun Sun , Mete Ozay , Takayuki Okatani

This invention addresses fixed-point representations of convolutional neural networks (CNN) in integrated circuits. When quantizing a CNN for a practical implementation there is a trade-off between the precision used for operations between…

Neural and Evolutionary Computing · Computer Science 2018-07-27 Mo'taz Al-Hami , Marcin Pietron , Rishi Kumar , Raul A. Casas , Samer L. Hijazi , Chris Rowen

Color is a crucial visual cue readily exploited by Convolutional Neural Networks (CNNs) for object recognition. However, CNNs struggle if there is data imbalance between color variations introduced by accidental recording conditions. Color…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Attila Lengyel , Ombretta Strafforello , Robert-Jan Bruintjes , Alexander Gielisse , Jan van Gemert

Convolution neural network (CNN), as one of the most powerful and popular technologies, has achieved remarkable progress for image and video classification since its invention in 1989. However, with the high definition video-data explosion,…

Emerging Technologies · Computer Science 2021-08-04 Yue Jiang , Wenjia Zhang , Fan Yang , Zuyuan He

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in…

Machine Learning · Computer Science 2021-02-18 Makoto Kawano , Wataru Kumagai , Akiyoshi Sannai , Yusuke Iwasawa , Yutaka Matsuo

The notion of group invariance helps neural networks in recognizing patterns and features under geometric transformations. Group convolutional neural networks enhance traditional convolutional neural networks by incorporating group-based…

Machine Learning · Computer Science 2025-04-15 Ali Mohaddes , Johannes Lederer

Nowadays, deep learning can be employed to a wide ranges of fields including medicine, engineering, etc. In deep learning, Convolutional Neural Network (CNN) is extensively used in the pattern and sequence recognition, video analysis,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Rezoana Bente Arif , Md. Abu Bakr Siddique , Mohammad Mahmudur Rahman Khan , Mahjabin Rahman Oishe

In modern artificial intelligence, convolutional neural networks (CNNs) have become a cornerstone for visual and perceptual tasks. However, their implementation on conventional electronic hardware faces fundamental bottlenecks in speed and…

Steerable convolutional neural networks (SCNNs) enhance task performance by modelling geometric symmetries through equivariance constraints on weights. Yet, unknown or varying symmetries can lead to overconstrained weights and decreased…

Machine Learning · Computer Science 2025-05-09 Lars Veefkind , Gabriele Cesa

We propose a novel formulation of deep networks that do not use dot-product neurons and rely on a hierarchy of voting tables instead, denoted as Convolutional Tables (CT), to enable accelerated CPU-based inference. Convolutional layers are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shay Dekel , Yosi Keller , Aharon Bar-Hillel

We present a general theory of Group equivariant Convolutional Neural Networks (G-CNNs) on homogeneous spaces such as Euclidean space and the sphere. Feature maps in these networks represent fields on a homogeneous base space, and layers…

Machine Learning · Computer Science 2020-01-10 Taco Cohen , Mario Geiger , Maurice Weiler

We introduce a simple permutation equivariant layer for deep learning with set structure.This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. We use deep…

Machine Learning · Statistics 2017-02-27 Siamak Ravanbakhsh , Jeff Schneider , Barnabas Poczos