English
Related papers

Related papers: Revisiting Transformation Invariant Geometric Deep…

200 papers

We propose a learning paradigm for numerical approximation of differential invariants of planar curves. Deep neural-networks' (DNNs) universal approximation properties are utilized to estimate geometric measures. The proposed framework is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Roy Velich , Ron Kimmel

We survey the mathematical foundations of geometric deep learning, focusing on group equivariant and gauge equivariant neural networks. We develop gauge equivariant convolutional neural networks on arbitrary manifolds $\mathcal{M}$ using…

Recurrent neural networks (RNNs) are known to be difficult to train due to the gradient vanishing and exploding problems and thus difficult to learn long-term patterns and construct deep networks. To address these problems, this paper…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Shuai Li , Wanqing Li , Chris Cook , Yanbo Gao

Group equivariant and steerable convolutional neural networks (regular and steerable G-CNNs) have recently emerged as a very effective model class for learning from signal data such as 2D and 3D images, video, and other data where…

Machine Learning · Computer Science 2018-04-02 Taco S. Cohen , Mario Geiger , Maurice Weiler

The rapid development of deep learning has significant implications for the advancement of Computational Fluid Dynamics (CFD). Currently, most pixel-grid-based deep learning methods for flow field prediction exhibit significantly reduced…

Fluid Dynamics · Physics 2024-04-11 Tianyu Li , Shufan Zou , Xinghua Chang , Laiping Zhang , Xiaogang Deng

Convolutional Neural Network (CNN) features have been successfully employed in recent works as an image descriptor for various vision tasks. But the inability of the deep CNN features to exhibit invariance to geometric transformations and…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Konda Reddy Mopuri , R. Venkatesh Babu

Graph-based data present unique challenges and opportunities for machine learning. Graph Neural Networks (GNNs), and especially those algorithms that capture graph topology through message passing for neighborhood aggregation, have been a…

Machine Learning · Computer Science 2024-04-19 Zheyi Qin , Randy Paffenroth , Anura P. Jayasumana

Convolutional Neural Networks (CNNs) achieve impressive performance in a wide variety of fields. Their success benefited from a massive boost when very deep CNN models were able to be reliably trained. Despite their merits, CNNs fail to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Guohao Li , Matthias Müller , Ali Thabet , Bernard Ghanem

A number of recent approaches have used deep convolutional neural networks (CNNs) to build texture representations. Nevertheless, it is still unclear how these models represent texture and invariances to categorical variations. This work…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Tsung-Yu Lin , Subhransu Maji

General graphs are difficult for learning due to their irregular structures. Existing works employ message passing along graph edges to extract local patterns using customized graph kernels, but few of them are effective for the integration…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Yecheng Lyu , Ming Li , Xinming Huang , Ulkuhan Guler , Patrick Schaumont , Ziming Zhang

Effectively predicting molecular interactions has the potential to accelerate molecular dynamics by multiple orders of magnitude and thus revolutionize chemical simulations. Graph neural networks (GNNs) have recently shown great successes…

Computational Physics · Physics 2024-06-25 Johannes Gasteiger , Florian Becker , Stephan Günnemann

In this paper we present a new strategy to model the subgrid-scale scalar flux in a three-dimensional turbulent incompressible flow using physics-informed neural networks (NNs). When trained from direct numerical simulation (DNS) data,…

Fluid Dynamics · Physics 2021-03-03 Hugo Frezat , Guillaume Balarac , Julien Le Sommer , Ronan Fablet , Redouane Lguensat

Graph neural networks (GNN) extends deep learning to graph-structure dataset. Similar to Convolutional Neural Networks (CNN) using on image prediction, convolutional and pooling layers are the foundation to success for GNN on graph…

Machine Learning · Computer Science 2023-02-28 Lingjie Kong , Yun Liao

Convolutional Neural Networks (CNNs) define an exceptionally powerful class of models for image classification, but the theoretical background and the understanding of how invariances to certain transformations are learned is limited. In a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Charlotte Bunne , Lukas Rahmann , Thomas Wolf

Graph neural networks (GNN) are very popular methods in machine learning and have been applied very successfully to the prediction of the properties of molecules and materials. First-order GNNs are well known to be incomplete, i.e., there…

Machine Learning · Statistics 2022-11-08 Sergey N. Pozdnyakov , Michele Ceriotti

In recent years, neural implicit representations have made remarkable progress in modeling of 3D shapes with arbitrary topology. In this work, we address two key limitations of such representations, in failing to capture local 3D geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yunlu Chen , Basura Fernando , Hakan Bilen , Matthias Nießner , Efstratios Gavves

Graph neural networks (GNNs) are composed of layers consisting of graph convolutions and pointwise nonlinearities. Due to their invariance and stability properties, GNNs are provably successful at learning representations from data…

Machine Learning · Computer Science 2023-08-09 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro

This paper is devoted to signal processing on point-clouds by means of neural networks. Nowadays, state-of-the-art in image processing and computer vision is mostly based on training deep convolutional neural networks on large datasets.…

Machine Learning · Computer Science 2021-04-06 Amitoz Azad , Julien Rabin , Abderrahim Elmoataz

Triangular meshes are widely used to represent three-dimensional objects. As a result, many recent works have address the need for geometric deep learning on 3D mesh. However, we observe that the complexities in many of these architectures…

Machine Learning · Computer Science 2024-02-20 Thuan Trang , Nhat Khang Ngo , Daniel Levy , Thieu N. Vo , Siamak Ravanbakhsh , Truong Son Hy

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser