English
Related papers

Related papers: Maximum incremental (minimum decremental) ratio an…

200 papers

The incremental gradient method is a prominent algorithm for minimizing a finite sum of smooth convex functions, used in many contexts including large-scale data processing applications and distributed optimization over networks. It is a…

Optimization and Control · Mathematics 2022-02-09 Mert Gürbüzbalaban , Asuman Ozdaglar , Pablo Parrilo

Soft robotic systems offer benefits over traditional rigid systems through reduced contact trauma with soft tissues and by enabling access through tortuous paths in minimally invasive surgery. However, the inherent deformability of soft…

Robotics · Computer Science 2020-05-04 James Avery , Mark Runciman , Ara Darzi , George P. Mylonas

In this paper, we explore a specific optimization problem that combines a differentiable nonconvex function with a nondifferentiable function for multi-block variables, which is particularly relevant to tackle the multilinear…

Optimization and Control · Mathematics 2025-01-10 Zehui Liu , Qingsong Wang , Chunfeng Cui

Stochastic Gradient Descent (SGD) is a popular tool in training large-scale machine learning models. Its performance, however, is highly variable, depending crucially on the choice of the step sizes. Accordingly, a variety of strategies for…

Machine Learning · Statistics 2021-06-11 Xiaoyu Li , Zhenxun Zhuang , Francesco Orabona

In this thesis, we extend the recently introduced theory of stochastic modified equations (SMEs) for stochastic gradient optimization algorithms. In Ch. 3 we study time-inhomogeneous SDEs driven by Brownian motion. For certain SDEs we prove…

Probability · Mathematics 2025-11-26 Stefan Perko

In [1] is proposed a simplified DeC method, that, when combined with the residual distribution (RD) framework, allows to construct a high order, explicit FE scheme with continuous approximation avoiding the inversion of the mass matrix for…

Numerical Analysis · Mathematics 2022-11-17 Rémi Abgrall , Elise Le Mélédo , Philipp Öffner , Davide Torlo

We present a comprehensive evaluation of the robustness and explainability of ResNet-like models in the context of Unintended Radiated Emission (URE) classification and suggest a new approach leveraging Neural Stochastic Differential…

Machine Learning · Computer Science 2023-09-28 Sumit Kumar Jha , Susmit Jha , Rickard Ewetz , Alvaro Velasquez

Based on the stochastic maximum principle for the partially coupled forward-backward stochastic control system (FBSCS for short), a modified method of successive approximations (MSA for short) is established for stochastic recursive optimal…

Optimization and Control · Mathematics 2022-01-11 Shaolin Ji , Rundong Xu

Stochastic reaction networks are a fundamental model to describe interactions between species where random fluctuations are relevant. The master equation provides the evolution of the probability distribution across the discrete state space…

Molecular Networks · Quantitative Biology 2021-06-15 Tabea Waizmann , Luca Bortolussi , Andrea Vandin , Mirco Tribastone

Physics-informed machine learning and inverse modeling require the solution of ill-conditioned non-convex optimization problems. First-order methods, such as SGD and ADAM, and quasi-Newton methods, such as BFGS and L-BFGS, have been applied…

Numerical Analysis · Mathematics 2021-05-18 Kailai Xu , Eric Darve

This work studies a variational formulation and numerical solution of a regularized morphoelasticity problem of shape evolution. The foundation of our analysis is based on the governing equations of linear elasticity, extended to account…

Numerical Analysis · Mathematics 2026-05-13 Ziqin Zhou

The approximation of invariant measures for nonlinear ergodic stochastic differential equations (SDEs) is a central problem in scientific computing, with important applications in stochastic sampling, physics, and ecology. We first propose…

Numerical Analysis · Mathematics 2025-11-18 Shan Huang , Xiaoyue Li

We give a new take on the error analysis of approximations of stochastic differential equations (SDEs), utilizing and developing the stochastic sewing lemma of L\^e (2020). This approach allows one to exploit regularization by noise effects…

Probability · Mathematics 2021-08-10 Oleg Butkovsky , Konstantinos Dareiotis , Máté Gerencsér

We present a framework for solving time-dependent partial differential equations (PDEs) in the spirit of the random feature method. The numerical solution is constructed using a space-time partition of unity and random feature functions.…

Numerical Analysis · Mathematics 2023-04-17 Jingrun Chen , Weinan E , Yixin Luo

We present R and C implementations for metric (ratio) and non-metric (ordinal) versions of Elastic MDS, the multidimensional scaling technique proposed by McGee (1966). The R and C versions are compared for speed, with the C version…

Computation · Statistics 2025-11-25 Jan de Leeuw

This paper presents a review of the literature on State Estimation (SE) in power systems. While covering some works related to SE in transmission systems, the main focus of this paper is Distribution System State Estimation (DSSE). The…

Systems and Control · Computer Science 2018-09-21 Kaveh Dehghanpour , Zhaoyu Wang , Jianhui Wang , Yuxuan Yuan , Fankun Bu

Given a single trajectory of a dynamical system, we analyze the performance of the nonparametric least squares estimator (LSE). More precisely, we give nonasymptotic expected $l^2$-distance bounds between the LSE and the true regression…

Machine Learning · Computer Science 2022-02-22 Ingvar Ziemann , Henrik Sandberg , Nikolai Matni

High-dimensional partial differential equations (PDE) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment (CVA) models, or portfolio optimization models. The PDEs in…

Numerical Analysis · Mathematics 2020-07-15 Christian Beck , Weinan E , Arnulf Jentzen

Stochastic (sub)gradient methods require step size schedule tuning to perform well in practice. Classical tuning strategies decay the step size polynomially and lead to optimal sublinear rates on (strongly) convex problems. An alternative…

Optimization and Control · Mathematics 2019-07-24 Damek Davis , Dmitriy Drusvyatskiy , Vasileios Charisopoulos

Evaluation of a variable Yd from certain measured variable(s) Xi(s), by making use of their system-specific-relationship (SSR), is generally referred as the indirect measurement. Naturally the SSR may stand for a simple data-translation…

Data Analysis, Statistics and Probability · Physics 2009-09-10 B. P. Datta