English
Related papers

Related papers: The regularizing properties of multistep methods f…

200 papers

While nowadays most gradient-based optimization methods focus on exploring the high-dimensional geometric features, the random error accumulated in a stochastic version of any algorithm implementation has not been stressed yet. In this…

Machine Learning · Computer Science 2020-08-14 Tong Yang , Long Sha , Pengyu Hong

The aim of the paper is to demonstrate the use of the Galerkin method for some kind of Volterra equations, determininistic and stochastic as well. The paper consists of two parts: the theoretical and numerical one. In the first part we…

Probability · Mathematics 2007-05-23 Anna Karczewska , Piotr Rozmej

We consider the problem of minimizing the average of a large number of smooth but possibly non-convex functions. In the context of most machine learning applications, each loss function is non-negative and thus can be expressed as the…

Optimization and Control · Mathematics 2024-07-08 Antonio Orvieto , Lin Xiao

We present complexity and numerical results for a new asynchronous parallel algorithmic method for the minimization of the sum of a smooth nonconvex function and a convex nonsmooth regularizer, subject to both convex and nonconvex…

Optimization and Control · Mathematics 2017-01-23 Loris Cannelli , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

This paper describes an algorithm for selecting parameter values (e.g. temperature values) at which to measure equilibrium properties with Parallel Tempering Monte Carlo simulation. Simple approaches to choosing parameter values can lead to…

Other Condensed Matter · Physics 2015-05-18 Firas Hamze , Neil Dickson , Kamran Karimi

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

Methodology · Statistics 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

We consider a fractional order viscoelasticity problem modelled by a power-law type stress relaxation function. This viscoelastic problem is a Volterra integral equation of the second kind with a weakly singular kernel where the convolution…

Numerical Analysis · Mathematics 2021-05-31 Yongseok Jang , Simon Shaw

This paper presents several new algorithms for the regularized reconstruction of a surface from its measured gradient field. By taking a matrix-algebraic approach, we establish general framework for the regularized reconstruction problem…

Numerical Analysis · Mathematics 2013-08-21 Matthew Harker , Paul O'Leary

This paper concerns the asymptotic behaviour of solutions of a linear convolution Volterra summation equation with an unbounded forcing term. In particular, we suppose the kernel is summable and ascribe growth bounds to the exogenous…

Dynamical Systems · Mathematics 2019-08-07 John A. D. Appleby , Denis D. Patterson

Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most…

Optimization and Control · Mathematics 2022-04-22 Cristian Vega , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

We study stochastic Volterra equations in Hilbert spaces driven by cylindrical Gaussian noise. We derive a mild formulation for the stochastic Volterra equation, prove the equivalence of mild and strong solutions, the existence and…

Probability · Mathematics 2023-11-14 Luigi Amedeo Bianchi , Stefano Bonaccorsi , Martin Friesen

In this paper we consider ill-posed inverse problems, both linear and nonlinear, by a heavy ball method in which a strongly convex regularization function is incorporated to detect the feature of the sought solution. We develop ideas on how…

Numerical Analysis · Mathematics 2024-04-05 Qinian Jin , Qin Huang

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

In this work, we consider the regularity property of stochastic convolutions for a class of abstract linear stochastic retarded functional differential equations with unbounded operator coefficients. We first establish some useful estimates…

Probability · Mathematics 2019-06-04 Kai Liu

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

We consider optimization algorithms that successively minimize simple Taylor-like models of the objective function. Methods of Gauss-Newton type for minimizing the composition of a convex function and a smooth map are common examples. Our…

Optimization and Control · Mathematics 2016-10-12 Dmitriy Drusvyatskiy , Alexander D. Ioffe , Adrian S. Lewis

A lattice Boltzmann method (LBM) with enhanced stability and accuracy is presented for various Hermite tensor-based lattice structures. The collision operator relies on a regularization step, which is here improved through a recursive…

Computational Physics · Physics 2017-09-20 Christophe Coreixas , Gauthier Wissocq , Guillaume Puigt , Jean-François Boussuge , Pierre Sagaut

In this paper we propose a new class of iterative regularization methods for solving ill-posed linear operator equations. The prototype of these iterative regularization methods is in the form of second order evolution equation with a…

Numerical Analysis · Mathematics 2020-06-24 Rongfang Gong , B. Hofmann , Ye Zhang

Large-time behaviour of solutions to stochastic evolution equations driven by two-sided regular Volterra processes is studied. The solution is understood in the mild sense and takes values in a separable Hilbert space. Sufficient conditions…

Probability · Mathematics 2017-06-20 Petr Čoupek
‹ Prev 1 4 5 6 7 8 10 Next ›