English
Related papers

Related papers: Stochastic Convergence Analysis for Large-Scale Li…

200 papers

We demonstrate the large deviation property for the mild solutions of stochastic evolution equations with monotone nonlinearity and multiplica- tive noise. This is achieved using the recently developed weak convergence method, in studying…

Probability · Mathematics 2010-03-17 Hassan Dadashi-Arani , Bijan Z. Zangeneh

A general stochastic algorithm for solving mixed linear and nonlinear problems was introduced in [11]. We show in this paper how it can be used to solve the fault inverse problem, where a planar fault in elastic half-space and a slip on…

Numerical Analysis · Mathematics 2021-03-19 Darko Volkov

We provide a modified augmented Lagrange method coupled with a Tikhonov regularization for solving ill-posed state-constrained elliptic optimal control problems with sparse controls. We consider a linear quadratic optimal control problem…

Optimization and Control · Mathematics 2017-08-14 Veronika Karl , Frank Pörner

Reliable state estimation depends on accurately modeled noise covariances, which are difficult to determine in practice. This paper formulates the noise covariance estimation as a bilevel optimization problem that factorizes the joint…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Haoying Li , Yifan Peng , Yuchi Wu , Junfeng Wu

We consider a statistical inverse learning problem, where the task is to estimate a function $f$ based on noisy point evaluations of $Af$, where $A$ is a linear operator. The function $Af$ is evaluated at i.i.d. random design points $u_n$,…

Machine Learning · Statistics 2021-11-02 Tatiana A. Bubba , Martin Burger , Tapio Helin , Luca Ratti

In this short note, we formulate the convergence rates of the well known Tikhonov regularization scheme for solving the nonlinear ill-posed problems in Banach spaces. For deriving the convergence rates, we employ the novel smoothness…

Numerical Analysis · Mathematics 2022-11-30 Gaurav Mittal , Ankik Kumar Giri

This paper presents a detailed theoretical analysis of the three stochastic approximation proximal gradient algorithms proposed in our companion paper [49] to set regularization parameters by marginal maximum likelihood estimation. We prove…

Statistics Theory · Mathematics 2020-08-14 Valentin De Bortoli , Alain Durmus , Ana F. Vidal , Marcelo Pereyra

The Arnoldi-Tikhonov method is a well-established regularization technique for solving large-scale ill-posed linear inverse problems. This method leverages the Arnoldi decomposition to reduce computational complexity by projecting the…

Numerical Analysis · Mathematics 2025-06-02 Davide Bianchi , Marco Donatelli , Davide Furchì , Lothar Reichel

The numerical solution of linear discrete ill-posed problems typically requires regularization, i.e., replacement of the available ill-conditioned problem by a nearby better conditioned one. The most popular regularization methods for…

Numerical Analysis · Mathematics 2016-02-11 Silvia Noschese , Lothar Reichel

Consider estimating a structured signal $\mathbf{x}_0$ from linear, underdetermined and noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\mathbf{z}$, via solving a variant of the lasso algorithm: $\hat{\mathbf{x}}=\arg\min_\mathbf{x}\{…

Optimization and Control · Mathematics 2014-01-28 Christos Thrampoulidis , Samet Oymak , Babak Hassibi

We propose a novel Galerkin discretization scheme for stochastic optimal control problems on an indefinite time horizon. The control problems are linear-quadratic in the controls, but possibly nonlinear in the state variables, and the…

Optimization and Control · Mathematics 2013-10-01 Ralf Banisch , Carsten Hartmann

We investigate a fully discrete finite element approximation for the stochastic Kuramoto-Sivashinsky equation, combining the standard finite element methods in spatial discretization with the implicit Euler-Maruyama scheme in time. Rigorous…

Numerical Analysis · Mathematics 2025-10-08 Hung D. Nguyen , Liet Vo

This work investigates a three-dimensional slow-fast stochastic system with quadratic nonlinearity and additive noise, inspired by fluid dynamics. The deterministic counterpart exhibits a periodic orbit and a slow manifold. We demonstrate…

Dynamical Systems · Mathematics 2025-01-22 Mickaël D. Chekroun , Jeroen S. W. Lamb , Christian J. Pangerl , Martin Rasmussen

This paper presents a general approach to linear stochastic processes driven by various random noises. Mathematically, such processes are described by linear stochastic differential equations of arbitrary order (the simplest non-trivial…

Condensed Matter · Physics 2009-10-28 Alon Drory

In this paper, we investigate iterative methods that are based on sampling of the data for computing Tikhonov-regularized solutions. We focus on very large inverse problems where access to the entire data set is not possible all at once…

Numerical Analysis · Mathematics 2018-12-18 J. Tanner Slagel , Julianne Chung , Matthias Chung , David Kozak , Luis Tenorio

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that…

Systems and Control · Computer Science 2015-06-30 Henri Nurminen , Tohid Ardeshiri , Robert Piché , Fredrik Gustafsson

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola

We consider an initial- and Dirichlet boundary- value problem for a fourth-order linear stochastic parabolic equation, in two or three space dimensions, forced by an additive space-time white noise. Discretizing the space-time white noise a…

Numerical Analysis · Mathematics 2009-06-11 Georgios T. Kossioris , Georgios E. Zouraris

Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the…

Numerical Analysis · Mathematics 2018-09-06 Nick Schenkels , Wim Vanroose

Motivated by engineering applications such as resource allocation in networks and inventory systems, we consider average-reward Reinforcement Learning with unbounded state space and reward function. Recent works studied this problem in the…

Machine Learning · Computer Science 2025-11-10 Shaan Ul Haque , Siva Theja Maguluri