English
Related papers

Related papers: Dynamical Low-Rank Approximation for Stochastic Di…

200 papers

We present a model and variance reduction method for the fast and reliable computation of statistical outputs of stochastic elliptic partial differential equations. Our method consists of three main ingredients: (1) the hybridizable…

Numerical Analysis · Mathematics 2018-04-13 Ferran Vidal-Codina , Ngoc-Cuong Nguyen , Mike B. Giles , Jaime Peraire

Ecological Momentary Assessment (EMA) studies enable the collection of high-frequency self-reports of suicidal thoughts and behaviors (STBs) via smartphones. Latent stochastic differential equations (SDEs) are a promising model class for…

Machine Learning · Statistics 2026-05-26 Malinda Lu , Yue-Jane Liu , Matthew K. Nock , Yaniv Yacoby

We examine the challenges associated with numerical integration when applying Neural Networks to solve Partial Differential Equations (PDEs). We specifically investigate the Deep Ritz Method (DRM), chosen for its practical applicability and…

Numerical Analysis · Mathematics 2025-05-09 Jamie M. Taylor , David Pardo

There is recent interest in finding a potential formulation for Stochastic Partial Differential Equations (SPDEs). The rationale behind this idea lies in obtaining all the dynamical information of the system under study from one single…

Exactly Solvable and Integrable Systems · Physics 2007-05-23 A. G. Munoz , J. Ojeda , D. Sierra , T. Soldovieri

We study pathwise approximation of scalar stochastic differential equations at a single time point or globally in time by means of methods that are based on finitely many observations of the driving Brownian motion. We prove lower error…

Numerical Analysis · Mathematics 2017-10-25 Mario Hefter , André Herzwurm , Thomas Müller-Gronbach

Stochastic Differential Equations (SDEs) serve as a powerful modeling tool in various scientific domains, including systems science, engineering, and ecological science. While the specific form of SDEs is typically known for a given…

Methodology · Statistics 2024-02-27 Xin Cai , Jingyu Yang , Zhibao Li , Hongqiao Wang , Miao Huang

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional approximations to…

Econometrics · Economics 2022-12-23 Karun Adusumilli , Dita Eckardt

In in this paper we show how using D.A. it is found a simple change of variables (c.v.) that brings us to obtain differential equations simpler than the original one. In a pedagogical way (at least we try to do that) and in order to make…

Physics Education · Physics 2007-05-23 José Antonio Belinchón

Stochastic Gradient (SG) is the defacto iterative technique to solve stochastic optimization (SO) problems with a smooth (non-convex) objective $f$ and a stochastic first-order oracle. SG's attractiveness is due in part to its simplicity of…

Optimization and Control · Mathematics 2024-03-08 David Newton , Raghu Bollapragada , Raghu Pasupathy , Nung Kwan Yip

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

Numerical Analysis · Mathematics 2021-03-17 Quanhui Zhu , Jiang Yang

Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning (PEFT) method widely used in large language models (LLMs). It approximates the update of a pretrained weight matrix $W\in\mathbb{R}^{m\times n}$ by the product of two low-rank…

Machine Learning · Computer Science 2025-08-12 Shiwei Li , Xiandi Luo , Haozhao Wang , Xing Tang , Ziqiang Cui , Dugang Liu , Yuhua Li , Xiuqiang He , Ruixuan Li

This work focuses on the numerical approximations of random periodic solutions of stochastic differential equations (SDEs). Under non-globally Lipschitz conditions, we prove the existence and uniqueness of random periodic solutions for the…

Numerical Analysis · Mathematics 2024-06-21 Ziheng Chen , Liangmin Cao , Lin Chen

Linear discriminant analysis (LDA) is a widely used technique for data classification. The method offers adequate performance in many classification problems, but it becomes inefficient when the data covariance matrix is ill-conditioned.…

Machine Learning · Statistics 2024-02-08 Maaz Mahadi , Tarig Ballal , Muhammad Moinuddin , Tareq Y. Al-Naffouri , Ubaid M. Al-Saggaf

Ordinary and stochastic differential equations (ODEs and SDEs) are widely used to model continuous-time processes across various scientific fields. While ODEs offer interpretability and simplicity, SDEs incorporate randomness, providing…

Methodology · Statistics 2025-05-20 Qingchuan Sun , Susanne Ditlevsen

Pseudospectral analysis is fundamental for quantifying the sensitivity and transient behavior of nonnormal matrices, yet its computational cost scales cubically with dimension, rendering it prohibitive for large-scale systems. While…

Numerical Analysis · Mathematics 2026-02-03 Vladimir R. Kostic , Dragana Lj. Cvetkovic , Ljiljana Cvetkovic

Implicit layer deep learning techniques, like Neural Differential Equations, have become an important modeling framework due to their ability to adapt to new problems automatically. Training a neural differential equation is effectively a…

Machine Learning · Computer Science 2023-06-05 Avik Pal , Alan Edelman , Chris Rackauckas

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

Machine Learning · Statistics 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

This paper explores the rates of convergence of solutions for multivariate stochastic differential equations (SDEs) driven by L\'evy processes within the small-time stable domain of attraction (DoA). Explicit bounds are derived for the…

Probability · Mathematics 2025-09-17 Jorge González Cázares , David Kramer-Bang

The estimation of direction of arrival (DOA) is a crucial issue in conventional radar, wireless communication, and integrated sensing and communication (ISAC) systems. However, low-cost systems often suffer from imperfect factors, such as…

Signal Processing · Electrical Eng. & Systems 2024-03-21 Peng Chen , Zhimin Chen , Liang Liu , Yun Chen , Xianbin Wang

We present a novel, fast (exponential rate adaption), ab initio (hyper-parameter-free) gradient based optimizer algorithm. The main idea of the method is to adapt the learning rate $\alpha$ by situational awareness, mainly striving for…

Machine Learning · Computer Science 2023-09-13 Alexander Kleinsorge , Stefan Kupper , Alexander Fauck , Felix Rothe