English
Related papers

Related papers: Dynamical systems gradient method for solving ill-…

200 papers

Differential Dynamic Programming (DDP) has become a well established method for unconstrained trajectory optimization. Despite its several applications in robotics and controls however, a widely successful constrained version of the…

Optimization and Control · Mathematics 2020-05-05 Yuichiro Aoyama , George Boutselis , Akash Patel , Evangelos A. Theodorou

Fine-tuning pretrained models has become a standard approach to adapting pretrained knowledge to improve the accuracy on new sparse, imbalance datasets. However, issues arise when optimization falls into a collapsed state, where the model…

Machine Learning · Computer Science 2026-05-01 Nghia Bui , Lijing Wang

We present a preconditioner based on spectral projection that is combined with a deflated Krylov subspace method for solving ill conditioned linear systems of equations. Our results show that the proposed algorithm requires many fewer…

Numerical Analysis · Mathematics 2016-09-23 Man-Chung Yeung , Craig C. Douglas , Long Lee

We introduce novel dynamical low-rank methods for solving large-scale matrix differential equations, motivated by algorithms from randomized numerical linear algebra. In terms of performance (cost and accuracy), our methods overperform…

Numerical Analysis · Mathematics 2025-10-13 Benjamin Carrel

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled

We propose a new homotopy-based conditional gradient method for solving convex optimization problems with a large number of simple conic constraints. Instances of this template naturally appear in semidefinite programming problems arising…

Optimization and Control · Mathematics 2025-01-31 Pavel Dvurechensky , Gabriele Iommazzo , Shimrit Shtern , Mathias Staudigl

This paper addresses the design and analysis of a multivariable gradient-based stochastic extremum-seeking control method for multi-input systems with arbitrary input delays. The approach accommodates systems with distinct time delays…

Optimization and Control · Mathematics 2024-11-19 Paulo Cesar Souza Silva , Paulo Cesar Pellanda , Tiago Roux Oliveira

We adapt the Gradient Discretisation Method (GDM), originally designed for elliptic and parabolic partial differential equations, to the case of a linear scalar hyperbolic equations. This enables the simultaneous design and convergence…

Numerical Analysis · Mathematics 2019-10-28 Jérôme Droniou , Robert Eymard , T. Gallouët , R. Herbin

Linear multistep methods (LMMs) are popular time discretization techniques for the numerical solution of differential equations. Traditionally they are applied to solve for the state given the dynamics (the forward problem), but here we…

Numerical Analysis · Mathematics 2020-08-18 Rachael Keller , Qiang Du

The method of this paper is my original creation. A new method for solving linear differential equations is proposed in this paper. The important conclusion of this paper is that arbitrary order linear ordinary differential equations with…

General Mathematics · Mathematics 2018-06-05 Daiyuan Zhang

Computation biology helps to understand all processes in organisms from interaction of molecules to complex functions of whole organs. Therefore, there is a need for mathematical methods and models that deliver logical explanations in a…

Molecular Networks · Quantitative Biology 2018-10-10 Ines Abdeljaoued-Tej , Alia BenKahla , Ghassen Haddad , Annick Valibouze

A weak Galerkin (WG) finite element method for solving the stationary Stokes equations in two- or three- dimensional spaces by using discontinuous piecewise polynomials is developed and analyzed. The variational form we considered is based…

Numerical Analysis · Mathematics 2016-01-22 Ruishu Wang , Xiaoshen Wang , Qilong Zhai , Ran Zhang

We propose randomized subspace gradient methods for high-dimensional constrained optimization. While there have been similarly purposed studies on unconstrained optimization problems, there have been few on constrained optimization problems…

Optimization and Control · Mathematics 2023-07-10 Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

$L^1$ based optimization is widely used in image denoising, machine learning and related applications. One of the main features of such approach is that it naturally provide a sparse structure in the numerical solutions. In this paper, we…

Numerical Analysis · Mathematics 2023-02-13 Weifeng Qiu , Jin Ren , Ke Shi , Yuesheng Xu

Many physical problems can be formulated as operator equations of the form Au = f. If these operator equations are ill-posed, we then resort to finding the approximate solutions numerically. Ill-posed problems can be found in the fields of…

Numerical Analysis · Mathematics 2016-11-11 Suresh B. Srinivasamurthy

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

This paper is an attempt to solve an important class of hypersingular integral equations of the second kind. To this end, we apply a new weighted and modified perturbation method which includes some special cases of the Adomian…

Classical Analysis and ODEs · Mathematics 2017-06-08 Mostafa Akrami , Taher Lotfi , Farajollah Mohammadi Yaghoobi

We present an infinite lattice DMRG sweeping procedure which can be used as a replacement for the standard infinite lattice blocking schemes. Although the scheme is generally applicable to any system, its main advantages are the correct…

Strongly Correlated Electrons · Physics 2018-04-25 Peter Schmitteckert

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

Parameters of differential equations are essential to characterize intrinsic behaviors of dynamic systems. Numerous methods for estimating parameters in dynamic systems are computationally and/or statistically inadequate, especially for…

Methodology · Statistics 2026-01-27 Jianbin Tan , Guoyu Zhang , Xueqin Wang , Hui Huang , Fang Yao