English
Related papers

Related papers: Accurate Shift Invariant Convolutional Neural Netw…

200 papers

We develop the "generalized consistent weighted sampling" (GCWS) for hashing the "powered-GMM" (pGMM) kernel (with a tuning parameter $p$). It turns out that GCWS provides a numerically stable scheme for applying power transformation on the…

Machine Learning · Statistics 2022-01-10 Ping Li , Weijie Zhao

The method of deep learning has achieved excellent results in improving the performance of robotic grasping detection. However, the deep learning methods used in general object detection are not suitable for robotic grasping detection.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Hu Cao , Guang Chen , Zhijun Li , Jianjie Lin , Alois Knoll

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

Inspired by two basic mechanisms in animal visual systems, we introduce a feature transform technique that imposes invariance properties in the training of deep neural networks. The resulting algorithm requires less parameter tuning, trains…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Chengxi Ye , Xiong Zhou , Tristan McKinney , Yanfeng Liu , Qinggang Zhou , Fedor Zhdanov

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Graph Convolutional Networks (GCNs) have become a crucial tool on learning representations of graph vertices. The main challenge of adapting GCNs on large-scale graphs is the scalability issue that it incurs heavy cost both in computation…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Wenbing Huang , Tong Zhang , Yu Rong , Junzhou Huang

Deep convolutional neural networks (CNNs) have shown excellent performance in object recognition tasks and dense classification problems such as semantic segmentation. However, training deep neural networks on large and sparse datasets is…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Lorenz Berger , Eoin Hyde , M. Jorge Cardoso , Sebastien Ourselin

Convolutional neural networks (CNNs) have been applied to learn spatial features for high-resolution (HR) synthetic aperture radar (SAR) image classification. However, there has been little work on integrating the unique statistical…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Wenkai Liang , Yan Wu , Ming Li , Peng Zhang , Yice Cao , Xin Hu

Incorporating group symmetry directly into the learning process has proved to be an effective guideline for model design. By producing features that are guaranteed to transform covariantly to the group actions on the inputs,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Liyao Gao , Guang Lin , Wei Zhu

Graph convolutional networks (GCNs) are powerful deep neural networks for graph-structured data. However, GCN computes the representation of a node recursively from its neighbors, making the receptive field size grow exponentially with the…

Machine Learning · Statistics 2018-03-02 Jianfei Chen , Jun Zhu , Le Song

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that…

Machine Learning · Computer Science 2016-06-06 Taco S. Cohen , Max Welling

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

Modern single image super-resolution (SISR) system based on convolutional neural networks (CNNs) achieves fancy performance while requires huge computational costs. The problem on feature redundancy is well studied in visual recognition…

Image and Video Processing · Electrical Eng. & Systems 2022-08-18 Ying Nie , Kai Han , Zhenhua Liu , Chuanjian Liu , Yunhe Wang

Group Convolutional Neural Networks (G-CNNs) constrain learned features to respect the symmetries in the selected group, and lead to better generalization when these symmetries appear in the data. If this is not the case, however,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 David W. Romero , Suhas Lohit

Graph neural networks (GNNs) are commonly described as being permutation equivariant with respect to node relabeling in the graph. This symmetry of GNNs is often compared to the translation equivariance of Euclidean convolution neural…

Machine Learning · Statistics 2023-11-20 Ningyuan Huang , Ron Levie , Soledad Villar

The effectiveness of Convolutional Neural Networks (CNNs) has been substantially attributed to their built-in property of translation equivariance. However, CNNs do not have embedded mechanisms to handle other types of transformations. In…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Ivan Sosnovik , Michał Szmaja , Arnold Smeulders

The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…

Signal Processing · Electrical Eng. & Systems 2021-05-05 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

The high computation, memory, and power budgets of inferring convolutional neural networks (CNNs) are major bottlenecks of model deployment to edge computing platforms, e.g., mobile devices and IoT. Moreover, training CNNs is time and…

Machine Learning · Computer Science 2021-07-09 Mostafa Elhoushi , Zihao Chen , Farhan Shafiq , Ye Henry Tian , Joey Yiwei Li

Convolutional Neural Network (CNN) have been widely used in image classification. Over the years, they have also benefited from various enhancements and they are now considered as state of the art techniques for image like data. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Thomas Gonzalez , Antoine Blais , Nicolas Couëllan , Christian Ruiz

Convolution neural networks (CNNs) have succeeded in compressive image sensing. However, due to the inductive bias of locality and weight sharing, the convolution operations demonstrate the intrinsic limitations in modeling the long-range…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Dongjie Ye , Zhangkai Ni , Hanli Wang , Jian Zhang , Shiqi Wang , Sam Kwong