English
Related papers

Related papers: Empirical risk minimization algorithm for multicla…

200 papers

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

We present an algorithm for the efficient sampling of conditional paths of stochastic differential equations (SDEs). While unconditional path sampling of SDEs is straightforward, albeit expensive for high dimensional systems of SDEs,…

Numerical Analysis · Mathematics 2011-02-11 Panagiotis Stinis

Diffusion-based classifiers such as those relying on the Personalized PageRank and the Heat kernel, enjoy remarkable classification accuracy at modest computational requirements. Their performance however is affected by the extent to which…

Machine Learning · Statistics 2019-02-20 Dimitris Berberidis , Athanasios N. Nikolakopoulos , Georgios B. Giannakis

In this work, we will show strong convergence of the Multilevel Monte-Carlo (MLMC) algorithm with split-step backward Euler (SSBE) and backward (drift-implicit) Euler (BE) schemes for nonlinear jump-diffusion stochastic differential…

Numerical Analysis · Mathematics 2018-10-30 Azadeh Ghasemifard , Mahdieh Tahmasebi

We consider the setting of multiscale overdamped Langevin stochastic differential equations, and study the problem of learning the drift function of the homogenized dynamics from continuous-time observations of the multiscale system. We…

Numerical Analysis · Mathematics 2024-11-12 Max Hirsch , Andrea Zanoni

We consider nonparametric invariant density and drift estimation for a class of multidimensional degenerate resp. hypoelliptic diffusion processes, so-called stochastic damping Hamiltonian systems or kinetic diffusions, under anisotropic…

Statistics Theory · Mathematics 2022-05-24 Niklas Dexheimer , Claudia Strauch

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

This paper deals with the problem of inference associated with linear fractional diffusion process with random effects in the drift. In particular we are concerned with the maximum likelihood estimators (MLE) of the random effect…

Statistics Theory · Mathematics 2019-12-04 El Omari Mohamed , Hamid El Maroufy , Christiane Fuchs

This paper introduces a drift optimization model of stochastic optimization problems driven by regulated stochastic processes. A broad range of problems across operations research, machine learning, and statistics can be viewed as…

Optimization and Control · Mathematics 2025-06-10 Zihe Zhou , Harsha Honnappa , Raghu Pasupathy

Langevin Dynamics is a Stochastic Differential Equation (SDE) central to sampling and generative modeling and is implemented via time discretization. Langevin Monte Carlo (LMC), based on the Euler-Maruyama discretization, is the simplest…

Machine Learning · Computer Science 2025-10-10 Saravanan Kandasamy , Dheeraj Nagaraj

Nowadays, algorithms with fast convergence, small memory footprints, and low per-iteration complexity are particularly favorable for artificial intelligence applications. In this paper, we propose a doubly stochastic algorithm with a novel…

Machine Learning · Computer Science 2023-04-25 Zebang Shen , Hui Qian , Tongzhou Mu , Chao Zhang

We consider a composite convex minimization problem associated with regularized empirical risk minimization, which often arises in machine learning. We propose two new stochastic gradient methods that are based on stochastic dual averaging…

Optimization and Control · Mathematics 2016-03-09 Tomoya Murata , Taiji Suzuki

Inferring a diffusion equation from discretely-observed measurements is a statistical challenge of significant importance in a variety of fields, from single-molecule tracking in biophysical systems to modeling financial instruments.…

Machine Learning · Statistics 2023-12-12 Yinuo Ren , Yiping Lu , Lexing Ying , Grant M. Rotskoff

In this paper, we investigate the problem of strong approximation of the solutions of stochastic differential equations (SDEs) when the drift coefficient is given in integral form. We investigate its upper error bounds, in terms of the…

Numerical Analysis · Mathematics 2025-11-20 Paweł Przybyłowicz , Michał Sobieraj

In this paper, we consider the density estimation problem associated with the stationary measure of ergodic It\^o diffusions from a discrete-time series that approximate the solutions of the stochastic differential equations. To take an…

Numerical Analysis · Mathematics 2021-09-10 Yiqi Gu , John Harlim , Senwei Liang , Haizhao Yang

Cross-classified data frequently arise in scientific fields such as education, healthcare, and social sciences. A common modeling strategy is to introduce crossed random effects within a regression framework. However, this approach often…

Methodology · Statistics 2025-07-22 Shota Takeishi , Shonosuke Sugasawa

We develop a distributed algorithm for convex Empirical Risk Minimization, the problem of minimizing large but finite sum of convex functions over networks. The proposed algorithm is derived from directly discretizing the second-order…

Optimization and Control · Mathematics 2018-11-07 Jingzhao Zhang , César A. Uribe , Aryan Mokhtari , Ali Jadbabaie

We study the problem of drift estimation for two-scale continuous time series. We set ourselves in the framework of overdamped Langevin equations, for which a single-scale surrogate homogenized equation exists. In this setting, estimating…

Numerical Analysis · Mathematics 2021-06-08 Assyr Abdulle , Giacomo Garegnani , Grigorios A. Pavliotis , Andrew M. Stuart , Andrea Zanoni

In the context of PDE-constrained optimization theory, source identification problems traditionally entail particles emerging from an unknown source distribution inside a domain, moving according to a prescribed stochastic process,…

Optimization and Control · Mathematics 2025-08-22 Richard B. Lehoucq , Scott A. McKinley , Petr Plecháč
‹ Prev 1 3 4 5 6 7 10 Next ›