English
Related papers

Related papers: Empowering Networks With Scale and Rotation Equiva…

200 papers

Owing to flexible architectures of deep convolutional neural networks (CNNs), CNNs are successfully used for image denoising. However, they suffer from the following drawbacks: (i) deep network architecture is very difficult to train. (ii)…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chunwei Tian , Yong Xu , Lunke Fei , Junqian Wang , Jie Wen , Nan Luo

Scale is often seen as a given, disturbing factor in many vision tasks. When doing so it is one of the factors why we need more data during learning. In recent work scale equivariance was added to convolutional neural networks. It was shown…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Ivan Sosnovik , Artem Moskalev , Arnold Smeulders

In recent years, representation learning approaches have disrupted many multimedia computing tasks. Among those approaches, deep convolutional neural networks (CNNs) have notably reached human level expertise on some constrained image…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Lucas Pascal , Xavier Bost , Benoît Huet

Convolutional neural network (CNN) is one of the most widely-used successful architectures in the era of deep learning. However, the high-computational cost of CNN still hampers more universal uses to light devices. Fortunately, the Fourier…

Networking and Internet Architecture · Computer Science 2021-08-13 Xiaohan Zhu , Zhen Cui , Tong Zhang , Yong Li , Jian Yang

Convolutional neural networks (CNN) have been successful in machine learning applications. Their success relies on their ability to consider space invariant local features. We consider the use of CNN to fit nuisance models in semiparametric…

Machine Learning · Statistics 2025-09-08 Mohammad Ghasempour , Niloofar Moosavi , Xavier de Luna

Regular group convolutional neural networks (G-CNNs) have been shown to increase model performance and improve equivariance to different geometrical symmetries. This work addresses the problem of SE(3), i.e., roto-translation equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Thijs P. Kuipers , Erik J. Bekkers

Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 David M. Knigge , David W. Romero , Erik J. Bekkers

Convolutional Neural Networks (CNNs) were the driving force behind many advancements in Computer Vision research in recent years. This progress has spawned many practical applications and we see an increased need to efficiently move CNNs to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Thomas Kurbiel , Shahrzad Khaleghian

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Group-equivariant convolutional neural networks (G-CNN) heavily rely on parameter sharing to increase CNN's data efficiency and performance. However, the parameter-sharing strategy greatly increases the computational burden for each added…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Wenzhao Zhao , Barbara D. Wichtmann , Steffen Albert , Angelika Maurer , Frank G. Zöllner , Jürgen Hesser

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

Robustness to transformation is desirable in many computer vision tasks, given that input data often exhibits pose variance. While translation invariance and equivariance is a documented phenomenon of CNNs, sensitivity to other…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Felix Richards , Adeline Paiement , Xianghua Xie , Elisabeth Sola , Pierre-Alain Duc

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…

Machine Learning · Computer Science 2023-07-24 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Convolutional neural networks have been highly successful in image-based learning tasks due to their translation equivariance property. Recent work has generalized the traditional convolutional layer of a convolutional neural network to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Monami Banerjee , Rudrasis Chakraborty , Jose Bouza , Baba C. Vemuri

The ability to handle large scale variations is crucial for many real world visual tasks. A straightforward approach for handling scale in a deep network is to process an image at several scales simultaneously in a set of scale channels.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Ylva Jansson , Tony Lindeberg

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

Equivariant quantum neural networks (QNNs) are promising variational models that exploit symmetries to improve machine learning capabilities. Despite theoretical developments in equivariant QNNs, their implementation on near-term quantum…

Quantum Physics · Physics 2026-04-20 Koki Chinzei , Quoc Hoan Tran , Yasuhiro Endo , Hirotaka Oshima

Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases…

Machine Learning · Computer Science 2021-11-23 Luca Della Libera , Vladimir Golkov , Yue Zhu , Arman Mielke , Daniel Cremers