English
Related papers

Related papers: Regularisation for the approximation of functions …

200 papers

Regularisation theory in Banach spaces, and non--norm-squared regularisation even in finite dimensions, generally relies upon Bregman divergences to replace norm convergence. This is comparable to the extension of first-order optimisation…

Optimization and Control · Mathematics 2021-03-19 Tuomo Valkonen

Randomized smoothing is a general technique for computing sample-dependent robustness guarantees against adversarial attacks for deep classifiers. Prior works on randomized smoothing against L_1 adversarial attacks use additive smoothing…

Machine Learning · Computer Science 2021-06-14 Alexander Levine , Soheil Feizi

For a convex class of functions $F$, a regularization functions $\Psi(\cdot)$ and given the random data $(X_i, Y_i)_{i=1}^N$, we study estimation properties of regularization procedures of the form \begin{equation*} \hat f \in {\rm…

Statistics Theory · Mathematics 2016-08-30 Guillaume Lecué , Shahar Mendelson

In this paper, we consider the numerical approximation of a general second order semilinear stochastic partial differential equation (SPDE) driven by multiplicative and additive noise. Our main interest is on such SPDEs where the nonlinear…

Numerical Analysis · Mathematics 2020-11-19 Jean Daniel Mukam , Antoine Tambue

In this paper, a higher-order time-discretization scheme is proposed, where the iterates approximate the solution of the stochastic semilinear wave equation driven by multiplicative noise with general drift and diffusion. We employ a…

Numerical Analysis · Mathematics 2022-07-20 Xiaobing Feng , Akash Ashirbad Panda , Andreas Prohl

We propose dynamic sampled stochastic approximation (SA) methods for stochastic optimization with a heavy-tailed distribution (with finite 2nd moment). The objective is the sum of a smooth convex function with a convex regularizer.…

Optimization and Control · Mathematics 2017-05-26 Alejandro Jofré , Philip Thompson

Robust fine-tuning aims to achieve competitive in-distribution (ID) performance while maintaining the out-of-distribution (OOD) robustness of a pre-trained model when transferring it to a downstream task. To remedy this, most robust…

Machine Learning · Computer Science 2025-09-09 Xiang Yuan , Jun Shu , Deyu meng , Zongben Xu

In this work (Part I), we study three time-discretization procedures of the Dynamical Low-Rank Approximation (DLRA) of high-dimensional stochastic differential equations (SDEs). Specifically, we consider the Dynamically Orthogonal (DO)…

Numerical Analysis · Mathematics 2026-01-30 Yoshihito Kazashi , Fabio Nobile , Fabio Zoccolan

It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, popular regularization methods have been the penalized Variational approaches. In recent years, the…

Machine Learning · Computer Science 2022-02-17 Abinash Nayak

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Regularisation allows one to handle ill-posed inverse problems. Here we focus on discrete unfolding problems. The properties of the results are characterised by the consistency between measurements and unfolding result and by the posterior…

Data Analysis, Statistics and Probability · Physics 2023-09-07 Michael Schmelling

Many inverse problems and signal processing problems involve low-rank regularizers based on the nuclear norm. Commonly, proximal gradient methods (PGM) are adopted to solve this type of non-smooth problems as they can offer fast and…

Signal Processing · Electrical Eng. & Systems 2025-11-25 Rodrigo A. Lobos , Javier Salazar Cavazos , Raj Rao Nadakuditi , Jeffrey A. Fessler

We apply convex regularization techniques to the problem of calibrating the local volatility surface model of Dupire taking into account the practical requirement of discrete grids and noisy data. Such requirements are the consequence of…

Numerical Analysis · Mathematics 2013-08-13 Vinicius V. L. Albani , Adriano De Cezaro , Jorge Passamani Zubelli

We present a closed-form finite-dimensional projection method for regularizing a function defined by a discrete set of measurement data, which have been contaminated by random, zero mean errors, and for estimating the derivative and…

Numerical Analysis · Mathematics 2018-05-28 Timothy J. Burns , Bert W. Rust

Learning approaches have recently become very popular in the field of inverse problems. A large variety of methods has been established in recent years, ranging from bi-level learning to high-dimensional machine learning techniques. Most…

Optimization and Control · Mathematics 2017-04-05 Martin Benning , Guy Gilboa , Joana Sarah Grah , Carola-Bibiane Schönlieb

Over the past few years, trace regression models have received considerable attention in the context of matrix completion, quantum state tomography, and compressed sensing. Estimation of the underlying matrix from regularization-based…

Machine Learning · Statistics 2015-04-24 Martin Slawski , Ping Li , Matthias Hein

We consider infinitely dimensional classes of functions and instead of the relative error setting, which was used in previous papers on the integral norm discretization, we consider the absolute error setting. We demonstrate how known…

Numerical Analysis · Mathematics 2022-03-15 V. N. Temlyakov

We propose a new iterative unfolding method for experimental data, making use of a regularization function. The use of this function allows one to build an improved normalization procedure for Monte Carlo spectra, unbiased by the presence…

Data Analysis, Statistics and Probability · Physics 2009-07-23 Bogdan Malaescu

Regularizing neural networks is important for anticipating model behavior in regions of the data space that are not well represented. In this work, we propose a regularization technique for enforcing a level of smoothness in the mapping…

Machine Learning · Computer Science 2025-03-05 Ali Hasan , Haoming Yang , Yuting Ng , Vahid Tarokh

In this paper, we consider a new approach for semi-discretization in time and spatial discretization of a class of semi-linear stochastic partial differential equations (SPDEs) with multiplicative noise. The drift term of the SPDEs is only…

Numerical Analysis · Mathematics 2023-07-10 Yukun Li , Liet Vo , Guanqian Wang