English
Related papers

Related papers: On Explicit Curvature Regularization in Deep Gener…

200 papers

We give estimates on the intrinsic and the extrinsic curvature of manifolds that are isometrically immersed as cylindrically bounded submanifolds of warped products. We also address extensions of the results in the case of submanifolds of…

Differential Geometry · Mathematics 2010-09-20 L. J. Alias , G. P. Bessa , J. F. Montenegro , P. Piccione

Overparameterized shallow neural networks admit substantial parameter redundancy: distinct parameter vectors may represent the same predictor due to hidden-unit permutations, rescalings, and related symmetries. As a result, geometric…

Machine Learning · Computer Science 2026-03-24 Hang-Cheng Dong , Pengcheng Cheng

Convolutional neural networks are capable of learning powerful representational spaces, which are necessary for tackling complex learning tasks. However, due to the model capacity required to capture such representations, they are often…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Terrance DeVries , Graham W. Taylor

Many scientific datasets are of high dimension, and the analysis usually requires visual manipulation by retaining the most important structures of data. Principal curve is a widely used approach for this purpose. However, many existing…

Artificial Intelligence · Computer Science 2016-01-19 Qi Mao , Li Wang , Ivor W. Tsang , Yijun Sun

Existing deep learning methods have made significant progress in gait representation learning. Quantization can facilitate the application of gait models as a model-agnostic general compression technique. Typically, appearance-based models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 S. Tian , H. Gao , G. Hong , S. Wang , J. Wang , X. Yu , S. Zhang

Currently, deep neural networks are deployed on low-power portable devices by first training a full-precision model using powerful hardware, and then deriving a corresponding low-precision model for efficient inference on such systems.…

Machine Learning · Computer Science 2017-11-15 Hao Li , Soham De , Zheng Xu , Christoph Studer , Hanan Samet , Tom Goldstein

Euclidean geometry has historically been the typical "workhorse" for machine learning applications due to its power and simplicity. However, it has recently been shown that geometric spaces with constant non-zero curvature improve…

Machine Learning · Computer Science 2020-02-14 Ondrej Skopek , Octavian-Eugen Ganea , Gary Bécigneul

Recent works in medical image registration have proposed the use of Implicit Neural Representations, demonstrating performance that rivals state-of-the-art learning-based methods. However, these implicit representations need to be optimized…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Louis D. van Harten , Jaap Stoker , Ivana Išgum

This paper deals with the concept of curvature of framed space curves, their higher-order derivatives, variations, and co-rotational derivatives. We realize that parametrizing rotation tensor using the Gibbs vector is effective in deriving…

Differential Geometry · Mathematics 2019-08-07 Mayank Chadha , Michael D. Todd

The goal of this paper is to analyze the geometric properties of deep neural network classifiers in the input space. We specifically study the topology of classification regions created by deep networks, as well as their associated decision…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Alhussein Fawzi , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard , Stefano Soatto

Standard supervised learning optimizes for predictive accuracy but remains agnostic to the internal geometry of learned features, often yielding representations that are entangled and brittle. We propose Class-Conditional Activation…

Machine Learning · Computer Science 2026-04-21 Akash Samanta , Manish Pratap Singh , Debasis Chaudhuri

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

Accurate estimation of spatial derivatives from discrete and noisy data is central to scientific machine learning and numerical solutions of PDEs. We extend kinetic-based regularization (KBR), a localized multidimensional kernel regression…

Numerical Analysis · Mathematics 2026-03-09 Abhisek Ganguly , Santosh Ansumali , Sauro Succi

This paper introduces a generative model for 3D surfaces based on a representation of shapes with mean curvature and metric, which are invariant under rigid transformation. Hence, compared with existing 3D machine learning frameworks, our…

Graphics · Computer Science 2020-09-08 Zi Ye , Nobuyuki Umetani , Takeo Igarashi , Tim Hoffmann

Over-parameterized neural networks generalize well in practice without any explicit regularization. Although it has not been proven yet, empirical evidence suggests that implicit regularization plays a crucial role in deep learning and…

Machine Learning · Computer Science 2019-03-07 Masayoshi Kubo , Ryotaro Banno , Hidetaka Manabe , Masataka Minoji

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

Deep Neural Networks can generalize despite being significantly overparametrized. Recent research has tried to examine this phenomenon from various view points and to provide bounds on the generalization error or measures predictive of the…

Machine Learning · Computer Science 2020-12-07 Parth Natekar , Manik Sharma

Neural-Network (NN) based turbulence closures have been developed for being used as pre-trained surrogates for traditional turbulence closures, with the aim to increase computational efficiency and prediction accuracy of CFD simulations.…

Machine Learning · Computer Science 2025-08-26 Cody Grogan , Som Dhulipala , Mauricio Tano , Izabela Gutowska , Som Dutta

Model compression techniques allow to significantly reduce the computational cost associated with data processing by deep neural networks with only a minor decrease in average accuracy. Simultaneously, reducing the model size may have a…

Machine Learning · Computer Science 2021-09-28 Sebastian Cygert , Andrzej Czyżewski

We consider the problem of learning implicit neural representations (INRs) for signals on non-Euclidean domains. In the Euclidean case, INRs are trained on a discrete sampling of a signal over a regular lattice. Here, we assume that the…

Machine Learning · Computer Science 2022-10-06 Daniele Grattarola , Pierre Vandergheynst