English
Related papers

Related papers: Proper Implicit Discretization of Arbitrary-Order …

200 papers

Previous papers have shown the impact of partial convergence of discretized PDE on the accuracy of tangent and adjoint linearizations. A series of papers suggested linearization of the fixed point iteration used in the solution process as a…

Numerical Analysis · Mathematics 2022-02-24 Emmett Padway , Dimitri Mavriplis

Linear inverse problems are ubiquitous. Often the measurements do not follow a Gaussian distribution. Additionally, a model matrix with a large condition number can complicate the problem further by making it ill-posed. In this case, the…

This paper deals with the backward Euler method applied to semilinear parabolic stochastic partial differential equations (SPDEs) driven by additive noise. The SPDE is discretized in space by the finite element method and in time by the…

Numerical Analysis · Mathematics 2020-01-01 Jean Daniel Mukam , Antoine Tambue

Real-world learning tasks often encounter uncertainty due to covariate shift and noisy or inconsistent labels. However, existing robust learning methods merge these effects into a single distributional uncertainty set. In this work, we…

Methodology · Statistics 2026-03-17 Varun Venkatesh , Eyke Hüllermeier , Bernd Bischl , Mina Rezaei

Outlier-robust estimation is a fundamental problem and has been extensively investigated by statisticians and practitioners. The last few years have seen a convergence across research fields towards "algorithmic robust statistics", which…

Machine Learning · Statistics 2022-12-19 Luca Carlone

We revisit the problem of spurious modes that are sometimes encountered in partial differential equations discretizations. It is generally suspected that one of the causes for spurious modes is due to how boundary conditions are treated,…

Numerical Analysis · Mathematics 2024-03-11 Pascal R Karam , Bassam Bamieh

We demonstrate that the choice of optimizer, neural network architecture, and regularizer significantly affect the adversarial robustness of linear neural networks, providing guarantees without the need for adversarial training. To this…

Machine Learning · Computer Science 2021-06-08 Fartash Faghri , Sven Gowal , Cristina Vasconcelos , David J. Fleet , Fabian Pedregosa , Nicolas Le Roux

For a model convection-diffusion problem, we address the presence of oscillatory discrete solutions, and study difficulties in recovering standard approximation results for its solution. We justify the presence of non-physical oscillations…

Numerical Analysis · Mathematics 2026-01-15 Constantin Bacuta

Deep learning-based industrial anomaly detection models have achieved remarkably high accuracy on commonly used benchmark datasets. However, the robustness of those models may not be satisfactory due to the existence of adversarial…

Machine Learning · Computer Science 2024-08-12 Yuanpu Cao , Lu Lin , Jinghui Chen

We examine gradient descent on unregularized logistic regression problems, with homogeneous linear predictors on linearly separable datasets. We show the predictor converges to the direction of the max-margin (hard margin SVM) solution. The…

Machine Learning · Statistics 2024-10-29 Daniel Soudry , Elad Hoffer , Mor Shpigel Nacson , Suriya Gunasekar , Nathan Srebro

We study the robustness of conformal prediction, a powerful tool for uncertainty quantification, to label noise. Our analysis tackles both regression and classification problems, characterizing when and how it is possible to construct…

Machine Learning · Computer Science 2024-11-27 Bat-Sheva Einbinder , Shai Feldman , Stephen Bates , Anastasios N. Angelopoulos , Asaf Gendler , Yaniv Romano

We consider parameter estimation of ordinary differential equation (ODE) models from noisy observations. For this problem, one conventional approach is to fit numerical solutions (e.g., Euler, Runge--Kutta) of ODEs to data. However, such a…

Methodology · Statistics 2021-09-01 Takeru Matsuda , Yuto Miyatake

Strong approximation errors of both finite element semi-discretization and spatio-temporal full discretization are analyzed for the stochastic Allen-Cahn equation driven by additive noise in space dimension $d \leq 3$. The full…

Numerical Analysis · Mathematics 2020-08-04 Ruisheng Qi , Xiaojie Wang

This work is concerned with quasi-optimal a-priori finite element error estimates for the obstacle problem in the $L^2$-norm. The discrete approximations are introduced as solutions to a finite element discretization of an accordingly…

Numerical Analysis · Mathematics 2018-11-26 Dominik Hafemeyer , Christian Kahle , Johannes Pfefferer

It is well known that exact notions of model abstraction and reduction for dynamical systems may not be robust enough in practice because they are highly sensitive to the specific choice of parameters. In this paper we consider this problem…

Systems and Control · Computer Science 2018-07-19 Luca Cardelli , Mirco Tribastone , Max Tschaikowski , Andrea Vandin

This paper addresses the classical problem of determining the sets of possible states of a linear discrete-time system subject to bounded disturbances from measurements corrupted by bounded noise. These so-called uncertainty sets evolve…

Optimization and Control · Mathematics 2014-05-08 Robin Hill , Yousong Luo , Uwe Schwerdtfeger

We show when maximizing a properly defined $f$-divergence measure with respect to a classifier's predictions and the supervised labels is robust with label noise. Leveraging its variational form, we derive a nice decoupling property for a…

Machine Learning · Computer Science 2021-08-20 Jiaheng Wei , Yang Liu

Efficient high order numerical methods for evolving the solution of an ordinary differential equation are widely used. The popular Runge--Kutta methods, linear multi-step methods, and more broadly general linear methods, all have a global…

Numerical Analysis · Mathematics 2020-03-16 Adi Ditkowski , Sigal Gottlieb , Zachary J. Grant

An influential line of recent work has focused on the generalization properties of unregularized gradient-based learning procedures applied to separable linear classification with exponentially-tailed loss functions. The ability of such…

Machine Learning · Computer Science 2022-06-24 Matan Schliserman , Tomer Koren

Gradient descent can be surprisingly good at optimizing deep neural networks without overfitting and without explicit regularization. We find that the discrete steps of gradient descent implicitly regularize models by penalizing gradient…

Machine Learning · Computer Science 2022-07-20 David G. T. Barrett , Benoit Dherin