English
Related papers

Related papers: Deep learning algorithms for solving high dimensio…

200 papers

We propose a finite-dimensional control-based method to approximate solution operators for evolutional partial differential equations (PDEs), particularly in high-dimensions. By employing a general reduced-order model, such as a deep neural…

Numerical Analysis · Mathematics 2024-01-22 Nathan Gaby , Xiaojing Ye

Derivation of the probability density evolution provides invaluable insight into the behavior of many stochastic systems and their performance. However, for most real-time applica-tions, numerical determination of the probability density…

Machine Learning · Computer Science 2022-07-06 Seid H. Pourtakdoust , Amir H. Khodabakhsh

This work studies the deep learning-based numerical algorithms for optimal hedging problems in markets with general convex transaction costs on the trading rates, focusing on their scalability of trading time horizon. Based on the…

Mathematical Finance · Quantitative Finance 2022-12-29 Xiaofei Shi , Daran Xu , Zhanhao Zhang

Conventional research attributes the improvements of generalization ability of deep neural networks either to powerful optimizers or the new network design. Different from them, in this paper, we aim to link the generalization ability of a…

Machine Learning · Computer Science 2018-11-06 Hui-Ling Zhen , Xi Lin , Alan Z. Tang , Zhenhua Li , Qingfu Zhang , Sam Kwong

Delay Differential Equations (DDEs) are a class of differential equations that can model diverse scientific phenomena. However, identifying the parameters, especially the time delay, that make a DDE's predictions match experimental results…

Machine Learning · Computer Science 2024-05-16 Robert Stephany

This paper investigates the stochastic optimization problem with a focus on developing scalable parallel algorithms for deep learning tasks. Our solution involves a reformation of the objective function for stochastic optimization in neural…

Machine Learning · Computer Science 2020-04-09 Pengzhan Guo , Zeyang Ye , Keli Xiao , Wei Zhu

We present a theoretically well-founded deep learning algorithm for nonparametric regression. It uses over-parametrized deep neural networks with logistic activation function, which are fitted to the given data via gradient descent. We…

Statistics Theory · Mathematics 2025-04-14 Michael Kohler , Adam Krzyzak

Parabolic partial differential equations (PDEs) and backward stochastic differential equations (BSDEs) have a wide range of applications. In particular, high-dimensional PDEs with gradient-dependent nonlinearities appear often in the…

Numerical Analysis · Mathematics 2022-04-18 Martin Hutzenthaler , Thomas Kruse

Bilevel optimization enjoys a wide range of applications in emerging machine learning and signal processing problems such as hyper-parameter optimization, image reconstruction, meta-learning, adversarial training, and reinforcement…

Machine Learning · Computer Science 2025-01-08 Han Shen , Quan Xiao , Tianyi Chen

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

Latent neural stochastic differential equations (SDEs) have recently emerged as a promising approach for learning generative models from stochastic time series data. However, they systematically underestimate the noise level inherent in…

Machine Learning · Computer Science 2025-06-11 Linus Heck , Maximilian Gelbrecht , Michael T. Schaub , Niklas Boers

In this paper, we consider the balancing domain decomposition by constraints (BDDC) algorithm with adaptive coarse spaces for a class of stochastic elliptic problems. The key ingredient in the construction of the coarse space is the…

Numerical Analysis · Mathematics 2021-04-20 Eric Chung , Hyea Hyun Kim , Ming Fai Lam , Lina Zhao

We study the problem of training deep neural networks with Rectified Linear Unit (ReLU) activation function using gradient descent and stochastic gradient descent. In particular, we study the binary classification problem and show that for…

Machine Learning · Computer Science 2018-12-31 Difan Zou , Yuan Cao , Dongruo Zhou , Quanquan Gu

Overparameterized stochastic differential equation (SDE) models have achieved remarkable success in various complex environments, such as PDE-constrained optimization, stochastic control and reinforcement learning, financial engineering,…

Optimization and Control · Mathematics 2024-09-27 Shengbo Wang , Jose Blanchet , Peter Glynn

We study the numerical approximation of backward stochastic Volterra integral equations (BSVIEs) and their reflected extensions, which naturally arise in problems with time inconsistency, path dependent preferences, and recursive utilities…

Probability · Mathematics 2025-11-26 Nacira Agram , Giulia Pucci

We propose an {\em implementable} numerical scheme for the discretization of linear-quadratic optimal control problems involving SDEs in higher dimensions with {\em control constraint}. For time discretization, we employ the implicit Euler…

Analysis of PDEs · Mathematics 2024-12-12 Abhishek Chaudhary

In this introductory paper, we discuss how quantitative finance problems under some common risk factor dynamics for some common instruments and approaches can be formulated as time-continuous or time-discrete forward-backward stochastic…

Computational Finance · Quantitative Finance 2019-11-29 Bernhard Hientzsch

Deep learning is a powerful tool for solving nonlinear differential equations, but usually, only the solution corresponding to the flattest local minimizer can be found due to the implicit regularization of stochastic gradient descent. This…

Numerical Analysis · Mathematics 2021-03-17 Yiqi Gu , Chunmei Wang , Haizhao Yang

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

We present a novel optimization-based decoding algorithm for LDPC codes that is suitable for hardware architectures specialized to feed-forward neural networks. The algorithm is based on the projected gradient descent algorithm with a…

Information Theory · Computer Science 2019-01-16 Tadashi Wadayama , Satoshi Takabe