English
Related papers

Related papers: Lipschitz regularization for softening material mo…

200 papers

B-spline models are a powerful way to represent scientific data sets with a functional approximation. However, these models can suffer from spurious oscillations when the data to be approximated are not uniformly distributed. Model…

Numerical Analysis · Mathematics 2023-01-04 David Lenz , Raine Yeh , Vijay Mahadevan , Iulian Grindeanu , Tom Peterka

We investigate the properties of minimizers of one-dimensional variational problems when the Lagrangian has no higher smoothness than continuity. An elementary approximation result is proved, but it is shown that this cannot be in general…

Classical Analysis and ODEs · Mathematics 2017-04-12 Richard Gratwick

Machine learning models suffer from overfitting, which is caused by a lack of labeled data. To tackle this problem, we proposed a framework of regularization methods, called density-fixing, that can be used commonly for supervised and…

Machine Learning · Computer Science 2020-09-08 Masanari Kimura , Ryohei Izawa

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network…

Machine Learning · Computer Science 2020-07-07 Weizhi Li , Gautam Dasarathy , Visar Berisha

Principled decision-making in continuous state--action spaces is impossible without some assumptions. A common approach is to assume Lipschitz continuity of the Q-function. We show that, unfortunately, this property fails to hold in many…

Machine Learning · Computer Science 2021-10-26 Omer Gottesman , Kavosh Asadi , Cameron Allen , Sam Lobel , George Konidaris , Michael Littman

Generative models have attracted considerable attention for their ability to produce novel shapes. However, their application in mechanical design remains constrained due to the limited size and variability of available datasets. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yongmin Kwon , Namwoo Kang

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

In recent years, continual learning, a prediction setting in which the problem environment may evolve over time, has become an increasingly popular research field due to the framework's gearing towards complex, non-stationary objectives.…

Machine Learning · Computer Science 2024-09-27 Max Koster , Jude Kukla

Localized features such as singularities, sharp gradients, discontinuities, and moving sources require adaptive finite element discretizations. Conventional refinement strategies introduce significant computational overhead through…

Computational Engineering, Finance, and Science · Computer Science 2026-04-29 Jan Niklas Schmäke , Martin Ruess

Usually, given a continuous-time nonlinear model, a closed form solution for an exact discretization cannot be found explicitly, originating the need of approximating discrete-time models. This note studies the preservation of the Lipschitz…

Systems and Control · Computer Science 2020-04-21 Masoud Abbaszadeh

This paper addresses Lipschitzian stability issues that play an important role in both theoretical and numerical aspects of variational analysis, optimization, and their applications. We particularly concentrate on the so-called relaxed…

Functional Analysis · Mathematics 2019-02-27 Andrew C. Eberhard , Boris S. Mordukhovich , Janosch Rieger

Real-life applications of deep neural networks are hindered by their unsteady predictions when faced with noisy inputs and adversarial attacks. The certified radius in this context is a crucial indicator of the robustness of models. However…

Machine Learning · Computer Science 2024-03-19 Blaise Delattre , Alexandre Araujo , Quentin Barthélemy , Alexandre Allauzen

Randomized smoothing has become a leading approach for certifying adversarial robustness in machine learning models. However, a persistent gap remains between theoretical certified robustness and empirical robustness accuracy. This paper…

Machine Learning · Computer Science 2025-04-10 Blaise Delattre , Paul Caillon , Quentin Barthélemy , Erwan Fagnou , Alexandre Allauzen

Training materials through periodic drive allows to endow materials and structures with complex elastic functions. As a result of the driving, the system explores the high dimensional space of structures, ultimately converging to a…

Soft Condensed Matter · Physics 2023-08-10 Himangsu Bhaumik , Daniel Hexner

The local behavior of the lowest order boundary element method on quasi-uniform meshes for Symm's integral equation and the stabilized hyper-singular integral equation on polygonal/polyhedral Lipschitz domains is analyzed. We prove local a…

Numerical Analysis · Mathematics 2019-10-07 Markus Faustmann , Jens Markus Melenk

To improve the robustness of deep classifiers against adversarial perturbations, many approaches have been proposed, such as designing new architectures with better robustness properties (e.g., Lipschitz-capped networks), or modifying the…

Machine Learning · Computer Science 2025-03-27 Mahyar Fazlyab , Taha Entesari , Aniket Roy , Rama Chellappa

Recent quasi-optimal error estimates for the finite element approximation of total-variation regularized minimization problems require the existence of a Lipschitz continuous dual solution. We discuss the validity of this condition and…

Numerical Analysis · Mathematics 2021-06-28 Sören Bartels , Robert Tovey , Friedrich Wassmer

In this paper a higher-order mixed finite element method for elastoplasticity with linear kinematic hardening is analyzed. Thereby, the non-differentiability of the involved plasticity functional is resolved by a Lagrange multiplier leading…

Numerical Analysis · Mathematics 2024-01-18 Patrick Bammer , Lothar Banz , Andreas Schröder

Sampling-based methods, e.g., Deep Ensembles and Bayesian Neural Nets have become promising approaches to improve the quality of uncertainty estimation and robust generalization. However, they suffer from a large model size and high latency…

Machine Learning · Computer Science 2024-05-29 Ha Manh Bui , Anqi Liu

Label Smoothing (LS) is an effective regularizer to improve the generalization of state-of-the-art deep models. For each training sample the LS strategy smooths the one-hot encoded training signal by distributing its distribution mass over…

Machine Learning · Computer Science 2020-12-04 Hongyu Guo