English
Related papers

Related papers: Learning to Convolve: A Generalized Weight-Tying A…

200 papers

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Maxime W. Lafarge , Erik J. Bekkers , Josien P. W. Pluim , Remco Duits , Mitko Veta

Recent work in neural networks for image classification has seen a strong tendency towards increasing the spatial context. Whether achieved through large convolution kernels or self-attention, models scale poorly with the increased spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Julia Grabinski , Janis Keuper , Margret Keuper

Many classes of images exhibit rotational symmetry. Convolutional neural networks are sometimes trained using data augmentation to exploit this, but they are still required to learn the rotation equivariance properties from the data.…

Machine Learning · Computer Science 2016-05-27 Sander Dieleman , Jeffrey De Fauw , Koray Kavukcuoglu

This paper challenges the prevailing view that convolutional neural network (CNN) filters become increasingly specialized in deeper layers. Motivated by recent observations of clusterable repeating patterns in depthwise separable CNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Zahra Babaiee , Peyman M. Kiasari , Daniela Rus , Radu Grosu

Transformation groups, such as translations or rotations, effectively express part of the variability observed in many recognition problems. The group structure enables the construction of invariant signal representations with appealing…

Artificial Intelligence · Computer Science 2013-01-17 Joan Bruna , Arthur Szlam , Yann LeCun

Joint image filters leverage the guidance image as a prior and transfer the structural details from the guidance image to the target image for suppressing noise or enhancing spatial resolution. Existing methods either rely on various…

Computer Vision and Pattern Recognition · Computer Science 2019-01-04 Yijun Li , Jia-Bin Huang , Narendra Ahuja , Ming-Hsuan Yang

In this paper, we showed that the feature map of a convolution layer is equivalent to the unnormalized log posterior of a special kind of Gaussian mixture for image modeling. Then we expanded the model to drive diverse features and proposed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Lifan Liang

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

A rigid-motion scattering computes adaptive invariants along translations and rotations, with a deep convolutional network. Convolutions are calculated on the rigid-motion group, with wavelets defined on the translation and rotation…

Computer Vision and Pattern Recognition · Computer Science 2014-03-10 Laurent SIfre , Stéphane Mallat

We seek to improve deep neural networks by generalizing the pooling operations that play a central role in current architectures. We pursue a careful exploration of approaches to allow pooling to learn and to adapt to complex and variable…

Machine Learning · Statistics 2015-10-13 Chen-Yu Lee , Patrick W. Gallagher , Zhuowen Tu

Extending the translation equivariance property of convolutional neural networks to larger symmetry groups has been shown to reduce sample complexity and enable more discriminative feature learning. Further, exploiting additional symmetries…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lisa Weijler , Pedro Hermosilla

Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases…

Machine Learning · Computer Science 2021-11-23 Luca Della Libera , Vladimir Golkov , Yue Zhu , Arman Mielke , Daniel Cremers

Recent progresses in 3D deep learning has shown that it is possible to design special convolution operators to consume point cloud data. However, a typical drawback is that rotation invariance is often not guaranteed, resulting in networks…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Zhiyuan Zhang , Binh-Son Hua , David W. Rosen , Sai-Kit Yeung

Following the traditional paradigm of convolutional neural networks (CNNs), modern CNNs manage to keep pace with more recent, for example transformer-based, models by not only increasing model depth and width but also the kernel size. This…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Paul Gavrikov , Janis Keuper

Several popular approaches to 3D vision tasks process multiple views of the input independently with deep neural networks pre-trained on natural images, achieving view permutation invariance through a single round of pooling over all views.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Carlos Esteves , Yinshuang Xu , Christine Allen-Blanchette , Kostas Daniilidis

As neural networks become deeper, the redundancy within their parameters increases. This phenomenon has led to several methods that attempt to reduce the correlation between convolutional filters. We propose a computationally efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yoav Kurtz , Noga Bar , Raja Giryes

Expanding the receptive field to capture large-scale context is key to obtaining good performance in dense prediction tasks, such as human pose estimation. While many state-of-the-art fully-convolutional architectures enlarge the receptive…

Machine Learning · Computer Science 2019-06-28 Linguang Zhang , Maciej Halber , Szymon Rusinkiewicz

We study rotation-robust learning for image inputs using Convolutional Model Trees (CMTs) [1], whose split and leaf coefficients can be structured on the image grid and transformed geometrically at deployment time. In a controlled MNIST…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Hongyi Li , William Ward Armstrong , Jun Xu

Simple image rotations significantly reduce the accuracy of deep neural networks. Moreover, training with all possible rotations increases the data set, which also increases the training duration. In this work, we address trainable rotation…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Wolfgang Fuhl , Enkelejda Kasneci

The skill of pivoting an object with a robotic system is challenging for the external forces that act on the system, mainly given by contact interaction. The complexity increases when the same skills are required to generalize across…

Robotics · Computer Science 2023-05-05 Xiang Zhang , Siddarth Jain , Baichuan Huang , Masayoshi Tomizuka , Diego Romeres