English
Related papers

Related papers: Finite-difference least square methods for solving…

200 papers

We studied the least-squares ReLU neural network (LSNN) method for solving linear advection-reaction equation with discontinuous solution in [Cai, Zhiqiang, Jingshuang Chen, and Min Liu. ``Least-squares ReLU neural network (LSNN) method for…

Numerical Analysis · Mathematics 2024-10-29 Zhiqiang Cai , Junpyo Choi , Min Liu

A highly recurrent traditional bottleneck in applied mathematics, for which the most popular codes (Mathematica and Matlab) do not offer a solution, is to find all the real solutions of a system of N nonlinear equations in a certain finite…

Systems and Control · Electrical Eng. & Systems 2023-12-12 Fernando Chueca-Diez , Alfonso M. Ganan-Calvo

CASL-HJX is a computational framework designed for solving deterministic and stochastic Hamilton-Jacobi equations in two spatial dimensions. It provides a flexible and efficient approach to modeling front propagation problems, optimal…

Optimization and Control · Mathematics 2025-05-21 Faranak Rajabi , Jacob Fingerman , Andrew Wang , Jeff Moehlis , Frederic Gibou

Bilevel optimization has arisen as a powerful tool in modern machine learning. However, due to the nested structure of bilevel optimization, even gradient-based methods require second-order derivative approximations via Jacobian- or/and…

Machine Learning · Computer Science 2022-06-07 Daouda Sow , Kaiyi Ji , Yingbin Liang

In \cite{christlieb2019kernel}, the authors developed a class of high-order numerical schemes for the Hamilton-Jacobi (H-J) equations, which are unconditionally stable, yet take the form of an explicit scheme. This paper extends such…

Numerical Analysis · Mathematics 2020-06-24 Andrew Christlieb , William Sands , Hyoseon Yang

The widespread application of modern machine learning has increased the need for robust statistical algorithms. This work studies one such fundamental statistical measure known as the Tukey depth. We study the problem in the continuum…

Statistics Theory · Mathematics 2021-04-06 Martin Molina-Fructuoso , Ryan Murray

Optimal control of diffusion processes is intimately connected to the problem of solving certain Hamilton-Jacobi-Bellman equations. Building on recent machine learning inspired approaches towards high-dimensional PDEs, we investigate the…

Optimization and Control · Mathematics 2023-01-31 Nikolas Nüsken , Lorenz Richter

In the Dynamic Programming approach to optimal control problems a crucial role is played by the value function that is characterized as the unique viscosity solution of a Hamilton-Jacobi-Bellman (HJB) equation. It is well known that this…

Numerical Analysis · Mathematics 2022-10-19 Luca Saluzzi , Alessandro Alla , Maurizio Falcone

The least-squares ReLU neural network (LSNN) method was introduced and studied for solving linear advection-reaction equation with discontinuous solution in \cite{Cai2021linear,cai2023least}. The method is based on an equivalent…

Numerical Analysis · Mathematics 2024-10-29 Zhiqiang Cai , Junpyo Choi , Min Liu

We present an algorithm for minimizing a sum of functions that combines the computational efficiency of stochastic gradient descent (SGD) with the second order curvature information leveraged by quasi-Newton methods. We unify these…

Machine Learning · Computer Science 2014-12-02 Jascha Sohl-Dickstein , Ben Poole , Surya Ganguli

We present a fast sweeping method for a class of Hamilton-Jacobi equations that arise from time-independent problems in optimal control theory. The basic method in two dimensions uses a four point stencil and is extremely simple to…

Numerical Analysis · Mathematics 2021-02-10 Christian Parkinson

In this paper, we propose an adaptive finite difference scheme in order to numerically solve total variation type problems for image processing tasks. The automatic generation of the grid relies on indicators derived from a local estimation…

Numerical Analysis · Mathematics 2024-10-18 Thomas Jacumin , Andreas Langer

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

The Classic Howard's algorithm, a technique of resolution for discrete Hamilton-Jacobi equations, is of large use in applications for its high efficiency and good performances. A special beneficial characteristic of the method is the…

Numerical Analysis · Mathematics 2014-07-21 Adriano Festa

This paper introduces the stochastic Fej\'{e}r-monotone hybrid steepest descent method (S-FM-HSDM) to solve affinely constrained and composite convex minimization tasks. The minimization task is not known exactly; noise contaminates the…

Optimization and Control · Mathematics 2019-05-22 Konstantinos Slavakis

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

Hamilton-Jacobi (HJ) reachability analysis is a widely adopted verification tool to provide safety and performance guarantees for autonomous systems. However, it involves solving a partial differential equation (PDE) to compute a safety…

Robotics · Computer Science 2025-05-12 Aditya Singh , Zeyuan Feng , Somil Bansal

We present a stochastic inexact Gauss-Newton method for the solution of nonlinear least-squares. To reduce the computational cost with respect to the classical method, at each iteration the proposed algorithm approximately minimizes the…

Optimization and Control · Mathematics 2025-06-05 Stefania Bellavia , Greta Malaspina , Benedetta Morini

In this paper we present a new algorithm for the solution of Hamilton-Jacobi-Bellman equations related to optimal control problems. The key idea is to divide the domain of computation into subdomains which are shaped by the optimal dynamics…

Numerical Analysis · Mathematics 2014-08-04 Simone Cacace , Emiliano Cristiani , Maurizio Falcone , Athena Picarelli

In this paper, a meshless Hermite-HDMR finite difference method is proposed to solve high-dimensional Dirichlet problems. The approach is based on the local Hermite-HDMR expansion with an additional smoothing technique. First, we introduce…

Numerical Analysis · Mathematics 2019-05-27 Xiaopeng Luo , Xin Xu , Herschel Rabitz