English
Related papers

Related papers: Learning Smooth Neural Functions via Lipschitz Reg…

200 papers

Learning robust 3D shape segmentation functions with deep neural networks has emerged as a powerful paradigm, offering promising performance in producing a consistent part segmentation of each 3D shape. Generalizing across 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yu Hao , Hao Huang , Shuaihang Yuan , Yi Fang

Visual localization techniques rely upon some underlying scene representation to localize against. These representations can be explicit such as 3D SFM map or implicit, such as a neural network that learns to encode the scene. The former…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Maxime Pietrantoni , Gabriela Csurka , Martin Humenberger , Torsten Sattler

Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models surpassing the resolution-memory trade-off faced by the explicit representations using meshes and point clouds. However, most…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Rahul Venkatesh , Tejan Karmali , Sarthak Sharma , Aurobrata Ghosh , R. Venkatesh Babu , László A. Jeni , Maneesh Singh

This paper focuses on over-parameterized deep neural networks (DNNs) with ReLU activation functions and proves that when the data distribution is well-separated, DNNs can achieve Bayes-optimal test error for classification while obtaining…

Machine Learning · Computer Science 2023-06-01 Zhenyu Zhu , Fanghui Liu , Grigorios G Chrysos , Francesco Locatello , Volkan Cevher

This paper presents a framework for bounding the approximation error in imitation model predictive controllers utilizing neural networks. Leveraging the Lipschitz properties of these neural networks, we derive a bound that guides dataset…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Hendrik Alsmeier , Lukas Theiner , Anton Savchenko , Ali Mesbah , Rolf Findeisen

We introduce Explicit Neural Surfaces (ENS), an efficient smooth surface representation that directly encodes topology with a deformation field from a known base domain. We apply this representation to reconstruct explicit surfaces from…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Thomas Walker , Octave Mariotti , Amir Vaxman , Hakan Bilen

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

This paper proposes a regularizer called Implicit Neural Representation Regularizer (INRR) to improve the generalization ability of the Implicit Neural Representation (INR). The INR is a fully connected network that can represent signals…

Machine Learning · Computer Science 2023-03-29 Zhemin Li , Hongxia Wang , Deyu Meng

In this work, we aim to address the 3D scene stylization problem - generating stylized images of the scene at arbitrary novel view angles. A straightforward solution is to combine existing novel view synthesis and image/video style transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Pei-Ze Chiang , Meng-Shiun Tsai , Hung-Yu Tseng , Wei-sheng Lai , Wei-Chen Chiu

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

We propose a novel 3D shape correspondence method based on the iterative alignment of so-called smooth shells. Smooth shells define a series of coarse-to-fine shape approximations designed to work well with multiscale algorithms. The main…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Marvin Eisenberger , Zorah Lähner , Daniel Cremers

Regularization plays an important role in generalization of deep neural networks, which are often prone to overfitting with their numerous parameters. L1 and L2 regularizers are common regularization tools in machine learning with their…

Machine Learning · Computer Science 2019-10-21 Dae Hoon Park , Chiu Man Ho , Yi Chang , Huaqing Zhang

We propose a novel shape representation useful for analyzing and processing shape collections, as well for a variety of learning and inference tasks. Unlike most approaches that capture variability in a collection by using a template model…

Graphics · Computer Science 2018-06-13 Ruqi Huang , Panos Achlioptas , Leonidas Guibas , Maks Ovsjanikov

Random projections are able to perform dimension reduction efficiently for datasets with nonlinear low-dimensional structures. One well-known example is that random matrices embed sparse vectors into a low-dimensional subspace nearly…

Machine Learning · Computer Science 2019-01-11 Jian-Feng Cai , Dong Li , Jiaze Sun , Ke Wang

Humans effortlessly infer the 3D shape of objects. What computations underlie this ability? Although various computational models have been proposed, none of them capture the human ability to match object shape across viewpoints. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Thomas P. O'Connell , Tyler Bonnen , Yoni Friedman , Ayush Tewari , Josh B. Tenenbaum , Vincent Sitzmann , Nancy Kanwisher

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

Effective regularisation of neural networks is essential to combat overfitting due to the large number of parameters involved. We present an empirical analogue to the Lipschitz constant of a feed-forward neural network, which we refer to as…

Machine Learning · Statistics 2018-07-03 Henry Gouk , Bernhard Pfahringer , Eibe Frank , Michael Cree

The recent advance of neural fields, such as neural radiance fields, has significantly pushed the boundary of scene representation learning. Aiming to boost the computation efficiency and rendering quality of 3D scenes, a popular line of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Fangneng Zhan , Lingjie Liu , Adam Kortylewski , Christian Theobalt

To minimize or upper-bound the value of a function "robustly", we might instead minimize or upper-bound the "epsilon-robust regularization", defined as the map from a point to the maximum value of the function within an epsilon-radius. This…

Optimization and Control · Mathematics 2010-06-10 Adrian S. Lewis , C. H. Jeffrey Pang

Lipschitz-constrained neural networks have several advantages over unconstrained ones and can be applied to a variety of problems, making them a topic of attention in the deep learning community. Unfortunately, it has been shown both…

Machine Learning · Computer Science 2023-12-20 Stanislas Ducotterd , Alexis Goujon , Pakshal Bohra , Dimitris Perdios , Sebastian Neumayer , Michael Unser