English
Related papers

Related papers: Equivariant vs. Invariant Layers: A Comparison of …

200 papers

Leveraging prior knowledge on intraclass variance due to transformations is a powerful method to improve the sample complexity of deep neural networks. This makes them applicable to practically important use-cases where training data is…

Machine Learning · Computer Science 2022-02-09 Matthias Rath , Alexandru Paul Condurache

Point cloud analysis (such as 3D segmentation and detection) is a challenging task, because of not only the irregular geometries of many millions of unordered points, but also the great variations caused by depth, viewpoint, occlusion, etc.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Tuo Feng , Wenguan Wang , Xiaohan Wang , Yi Yang , Qinghua Zheng

Recent advances in image clustering typically focus on learning better deep representations. In contrast, we present an orthogonal approach that does not rely on abstract features but instead learns to predict image transformations and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Tom Monnier , Thibault Groueix , Mathieu Aubry

Learning a powerful representation from point clouds is a fundamental and challenging problem in the field of computer vision. Different from images where RGB pixels are stored in the regular grid, for point clouds, the underlying semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Feng Yang , Yichao Cao , Qifan Xue , Shuai Jin , Xuanpeng Li , Weigong Zhang

Group equivariant neural networks are used as building blocks of group invariant neural networks, which have been shown to improve generalisation performance and data efficiency through principled parameter sharing. Such works have mostly…

Machine Learning · Computer Science 2021-06-17 Michael Hutchinson , Charline Le Lan , Sheheryar Zaidi , Emilien Dupont , Yee Whye Teh , Hyunjik Kim

Invariant and equivariant networks have been successfully used for learning images, sets, point clouds, and graphs. A basic challenge in developing such networks is finding the maximal collection of invariant and equivariant linear layers.…

Machine Learning · Computer Science 2019-05-01 Haggai Maron , Heli Ben-Hamu , Nadav Shamir , Yaron Lipman

We propose an end-to-end deep learning learning model for graph classification and representation learning that is invariant to permutation of the nodes of the input graphs. We address the challenge of learning a fixed size graph…

Machine Learning · Computer Science 2019-05-09 Peter Meltzer , Marcelo Daniel Gutierrez Mallea , Peter J. Bentley

Deep learning systems extensively use convolution operations to process input data. Though convolution is clearly defined for structured data such as 2D images or 3D volumes, this is not true for other data types such as sparse point…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Pedro Hermosilla , Tobias Ritschel , Pere-Pau Vázquez , Àlvar Vinacua , Timo Ropinski

The irregularity and permutation invariance of point cloud data pose challenges for effective learning. Conventional methods for addressing this issue involve converting raw point clouds to intermediate representations such as 3D voxel…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Athrva Atul Pandhare

Recent works have demonstrated that global covariance pooling (GCP) has the ability to improve performance of deep convolutional neural networks (CNNs) on visual classification task. Despite considerable advance, the reasons on…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Qilong Wang , Li Zhang , Banggu Wu , Dongwei Ren , Peihua Li , Wangmeng Zuo , Qinghua Hu

In this paper, we propose a point cloud classification method based on graph neural network and manifold learning. Different from the conventional point cloud analysis methods, this paper uses manifold learning algorithms to embed point…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Dinghao Yang , Wei Gao

Deep learning on point clouds has made a lot of progress recently. Many point cloud dedicated deep learning frameworks, such as PointNet and PointNet++, have shown advantages in accuracy and speed comparing to those using traditional 3D…

Computational Geometry · Computer Science 2018-12-18 Guanghua Pan , Jun Wang , Rendong Ying , Peilin Liu

Pooling layers are essential building blocks of convolutional neural networks (CNNs), to reduce computational overhead and increase the receptive fields of proceeding convolutional operations. Their goal is to produce downsampled volumes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Alexandros Stergiou , Ronald Poppe

Transformer models have become the dominant backbone for sequence modeling, leveraging self-attention to produce contextualized token representations. These are typically aggregated into fixed-size vectors via pooling operations for…

Machine Learning · Computer Science 2025-10-07 Sofiane Ennadir , Levente Zólyomi , Oleg Smirnov , Tianze Wang , John Pertoft , Filip Cornell , Lele Cao

In this paper, we present a comprehensive study on the utility of deep convolutional neural networks with two state-of-the-art pooling layers which are placed after convolutional layers and fine-tuned in an end-to-end manner for visual…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Farid Alijani , Esa Rahtu

As a pioneering work exploring transformer architecture for 3D point cloud understanding, Point Transformer achieves impressive results on multiple highly competitive benchmarks. In this work, we analyze the limitations of the Point…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Xiaoyang Wu , Yixing Lao , Li Jiang , Xihui Liu , Hengshuang Zhao

The inception network has been shown to provide good performance on image classification problems, but there are not much evidences that it is also effective for the image restoration or pixel-wise labeling problems. For image restoration…

Computer Vision and Pattern Recognition · Computer Science 2017-01-24 Yoonsik Kim , Insung Hwang , Nam Ik Cho

Classifying whole images is a classic problem in machine learning, and graph neural networks are a powerful methodology to learn highly irregular geometries. It is often the case that certain parts of a point cloud are more important than…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Lindsey Gray , Thomas Klijnsma , Shamik Ghosh

Existing position based point cloud filtering methods can hardly preserve sharp geometric features. In this paper, we rethink point cloud filtering from a non-learning non-local non-normal perspective, and propose a novel position based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Jinxi Wang , Jincen Jiang , Xuequan Lu , Meili Wang

Recent advances in deep learning for 3D point clouds have shown great promises in scene understanding tasks thanks to the introduction of convolution operators to consume 3D point clouds directly in a neural network. Point cloud data,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Zhiyuan Zhang , Binh-Son Hua , Wei Chen , Yibin Tian , Sai-Kit Yeung