English
Related papers

Related papers: Parameter Estimation in Nonlinear Multivariate Sto…

200 papers

Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent…

Statistics Theory · Mathematics 2023-06-23 Charlotte Baey , Maud Delattre , Estelle Kuhn , Jean-Benoist Leger , Sarah Lemler

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

Machine Learning · Statistics 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

We design and analyze a posteriori error estimators for the Stokes system with singular sources in suitable $\mathbf{W}^{1,p}\times \mathrm{L}^p$ spaces. We consider classical low-order inf-sup stable and stabilized finite element…

Numerical Analysis · Mathematics 2019-12-19 Francisco Fuica , Felipe Lepe , Enrique Otarola , Daniel Quero

In this paper, we prove convergence rates for time discretisation schemes for semi-linear stochastic evolution equations with additive or multiplicative Gaussian noise, where the leading operator $A$ is the generator of a strongly…

Numerical Analysis · Mathematics 2024-12-19 Katharina Klioba , Mark Veraar

We address numerical differentiation under coarse, non-uniform sampling and Gaussian noise. A maximum-likelihood estimator with $L_2$-norm constraint on a higher-order derivative is obtained, yielding spline-based solution. We introduce a…

Methodology · Statistics 2025-07-31 Konstantin E. Avrachenkov , Leonid B. Freidovich

We consider the problem of numerically estimating expectations of solutions to stochastic differential equations driven by Brownian motions in the commonly occurring small noise regime. We consider (i) standard Monte Carlo methods combined…

Numerical Analysis · Mathematics 2015-06-08 David F. Anderson , Desmond J. Higham , Yu Sun

We consider a problem of parameter estimation for the state space model described by linear stochastic differential equations. We assume that an unobservable Ornstein-Uhlenbeck process drives another observable process by the linear…

Statistics Theory · Mathematics 2022-03-25 Masahiro Kurisaki

A dynamic sampled stochastic approximated (DS-SA) extragradient method for stochastic variational inequalities (SVI) is proposed that is \emph{robust} with respect to an unknown Lipschitz constant $L$. To the best of our knowledge, it is…

Optimization and Control · Mathematics 2017-08-28 Alfredo Iusem , Alejandro Jofré , Roberto I. Oliveira , Philip Thompson

For numerical approximations to stochastic differential equations using the Euler-Maruyama scheme, we propose incorporating approximate random variables computed using low precisions, such as single and half precision. We propose and…

Numerical Analysis · Mathematics 2024-07-17 Oliver Sheridan-Methven , Michael Giles

We propose sequential Monte Carlo based algorithms for maximum likelihood estimation of the static parameters in hidden Markov models with an intractable likelihood using ideas from approximate Bayesian computation. The static parameter…

Computation · Statistics 2013-11-19 Sinan Yildirim , Sumeetpal Singh , Thomas Dean , Ajay Jasra

Consider the problem of joint parameter estimation and prediction in a Markov random field: i.e., the model parameters are estimated on the basis of an initial set of data, and then the fitted model is used to perform prediction (e.g.,…

Machine Learning · Computer Science 2007-07-13 Martin J. Wainwright

This paper develops a unified and computationally efficient method for change-point estimation along the time dimension in a non-stationary spatio-temporal process. By modeling a non-stationary spatio-temporal process as a piecewise…

Methodology · Statistics 2023-10-09 Zifeng Zhao , Ting Fung Ma , Wai Leong Ng , Chun Yip Yau

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

In order to approximate solutions of stochastic partial differential equations (SPDEs) that do not possess commutative noise, one has to simulate the involved iterated stochastic integrals. Recently, two approximation methods for iterated…

Probability · Mathematics 2019-10-09 Claudine von Hallern , Andreas Rößler

We study the problem of parameter estimation using maximum likelihood for fast/slow systems of stochastic differential equations. Our aim is to shed light on the problem of model/data mismatch at small scales. We consider two classes of…

Statistics Theory · Mathematics 2008-06-20 A. Papavasiliou , G. A. Pavliotis , A. M. Stuart

Sequential change-point detection in non-Gaussian stochastic processes is challenging because the underlying densities are rarely known in real time. Classical parametric procedures such as CUSUM lose optimality under distributional…

Methodology · Statistics 2026-05-28 Serhii Zabolotnii

An explicit first-order drift-randomized Milstein scheme for a regime switching stochastic differential equation is proposed and its bi-stability and rate of strong convergence are investigated for a non-differentiable drift coefficient.…

Probability · Mathematics 2025-03-11 Divyanshu Vashistha , Chaman Kumar

For finite-dimensional problems, stochastic approximation methods have long been used to solve stochastic optimization problems. Their application to infinite-dimensional problems is less understood, particularly for nonconvex objectives.…

Optimization and Control · Mathematics 2021-01-14 Caroline Geiersbach , Teresa Scarinci

Multi-sensor state space models underpin fusion applications in networks of sensors. Estimation of latent parameters in these models has the potential to provide highly desirable capabilities such as network self-calibration. Conventional…

Systems and Control · Computer Science 2018-01-04 Murat Uney , Bernard Mulgrew , Daniel E Clark

Location estimation is a central problem in functional data analysis. In this paper, we investigate penalized spline estimators of location for discretely sampled functional data under a broad class of convex loss functions. Our framework…

Methodology · Statistics 2025-08-19 Ioannis Kalogridis