English
Related papers

Related papers: A general regularization strategy for singular Sto…

200 papers

We study the possible regularization of collision solutions for one centre problems with a weak singularity. In the case of logarithmic singularities, we consider the method of regularization via smoothing of the potential. With this…

Dynamical Systems · Mathematics 2009-05-12 Castelli Roberto , Terracini Susanna

In this paper we present an all-at-once multigrid method for a distributed Stokes control problem (velocity tracking problem). For solving such a problem, we use the fact that the solution is characterized by the optimality system…

Numerical Analysis · Mathematics 2015-12-15 Stefan Takacs

In this paper, we consider a class of non-convex and non-smooth sparse optimization problems, which encompass most existing nonconvex sparsity-inducing terms. We show the second-order optimality conditions only depend on the nonzeros of the…

Optimization and Control · Mathematics 2024-12-13 Luwei Bai , Yaohua Hu , Hao Wang , Xiaoqi Yang

We present a scheme implementing an a posteriori refinement strategy in the context of a high-order meshless method for problems involving point singularities and fluid-solid interfaces. The generalized moving least squares (GMLS)…

Computational Physics · Physics 2019-07-24 Wei Hu , Nathaniel Trask , Xiaozhe Hu , Wenxiao Pan

We propose and analyze several inexact regularized Newton-type methods for finding a global saddle point of convex-concave unconstrained min-max optimization problems. Compared to first-order methods, our understanding of second-order…

Optimization and Control · Mathematics 2026-05-27 Tianyi Lin , Panayotis Mertikopoulos , Michael I. Jordan

We describe novel subgradient methods for a broad class of matrix optimization problems involving nuclear norm regularization. Unlike existing approaches, our method executes very cheap iterations by combining low-rank stochastic…

Machine Learning · Computer Science 2012-07-03 Haim Avron , Satyen Kale , Shiva Kasiviswanathan , Vikas Sindhwani

For solving linear ill-posed problems regularization methods are required when the right hand side is with some noise. In the present paper regularized solutions are obtained by implicit iteration methods in Hilbert scales. % By exploiting…

Numerical Analysis · Mathematics 2015-05-20 Qinian Jin , Ulrich Tautenhahn

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang

In this paper, we are concerned with a nonlinear optimal control problem of ordinary differential equations. We consider a discretization of the problem with the discontinuous Galerkin method with arbitrary order $r \in \mathbb{N}\cup…

Numerical Analysis · Mathematics 2020-05-25 Woocheol Choi , Young-Pil Choi

Regularization is a widely recognized technique in mathematical optimization. It can be used to smooth out objective functions, refine the feasible solution set, or prevent overfitting in machine learning models. Due to its simplicity and…

Optimization and Control · Mathematics 2024-12-31 Filip Nikolovski , Irena Stojkovska , Katerina Hadzi-Velkova Saneva , Zoran Hadzi-Velkov

Fully implicit Runge-Kutta (IRK) methods have many desirable properties as time integration schemes in terms of accuracy and stability, but high-order IRK methods are not commonly used in practice with numerical PDEs due to the difficulty…

Numerical Analysis · Mathematics 2021-10-07 Ben S. Southworth , Oliver Krzysik , Will Pazner , Hans De Sterck

For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$ with $b$ contaminated by a white noise, Lanczos bidiagonalization based LSQR and its mathematically equivalent CGLS are most commonly used. They have intrinsic…

Numerical Analysis · Mathematics 2016-11-03 Zhongxiao Jia

This paper proposes a novel method for designing finite-horizon discrete-valued switching signals in linear switched systems based on discreteness-promoting regularization. The inherent combinatorial optimization problem is reformulated as…

Optimization and Control · Mathematics 2025-05-06 Masaaki Nagahara , Takuya Ikeda , Ritsuki Hoshimoto

We propose a novel framework of generalised Petrov-Galerkin Dynamical Low Rank Approximations (DLR) in the context of random PDEs. It builds on the standard Dynamical Low Rank Approximations in their Dynamically Orthogonal formulation. It…

Numerical Analysis · Mathematics 2024-07-02 Fabio Nobile , Thomas Trigo Trindade

We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone…

Optimization and Control · Mathematics 2026-02-12 Ching-pei Lee , Stephen J. Wright

This paper considers the regularization continuation method and the trust-region updating strategy for the optimization problem with linear equality constraints.The proposed method utilizes the linear conservation law of the regularization…

Numerical Analysis · Mathematics 2022-04-11 Xin-long Luo , Hang Xiao

Regularization is essential for avoiding over-fitting to training data in network optimization, leading to better generalization of the trained networks. The label noise provides a strong implicit regularization by replacing the target…

Machine Learning · Computer Science 2022-05-04 Kensuke Nakamura , Bong-Soo Sohn , Kyoung-Jae Won , Byung-Woo Hong

Strong coupling between geomechanical deformation and multiphase fluid flow appears in a variety of geoscience applications. A common discretization strategy for these problems is a continuous Galerkin finite element scheme for the momentum…

Numerical Analysis · Mathematics 2019-09-19 Julia T. Camargo , Joshua A. White , Ronaldo I. Borja

We develop efficient hierarchical preconditioners for optimal control problems governed by partial differential equations with uncertain coefficients. Adopting a discretize-then-optimize framework that integrates finite element…

Optimization and Control · Mathematics 2026-02-24 Zhendong Li , Akwum Onwunta , Bedřich Sousedík

For the singular saddle-point problems with nonsymmetric positive definite $(1,1)$ block, we present a general constraint preconditioning (GCP) iteration method based on a singular constraint preconditioner. Using the properties of the…

Numerical Analysis · Mathematics 2013-12-30 Ai-Li Yang , Guo-Feng Zhang , Yu-Jiang Wu