English
Related papers

Related papers: IMRO: a proximal quasi-Newton method for solving $…

200 papers

This paper presents a unified Least-Squares framework for solving nonlinear partial differential equations by recasting the governing system as a residual minimisation problem. A Least-Squares functional is formulated and the corresponding…

Numerical Analysis · Mathematics 2025-11-10 Fleurianne Bertrand , Maximilian Brodbeck , Tim Ricken , Henrik Schneider

We propose a proximal variable smoothing algorithm for nonsmooth optimization problem with sum of three functions involving weakly convex composite function. The proposed algorithm is designed as a time-varying forward-backward splitting…

Optimization and Control · Mathematics 2025-04-29 Keita Kume , Isao Yamada

Overdetermined systems of first kind integral equations appear in many applications. When the right-hand side is discretized, the resulting finite-data problem is ill-posed and admits infinitely many solutions. We propose a numerical method…

Numerical Analysis · Mathematics 2023-07-26 Patricia Díaz de Alba , Luisa Fermo , Federica Pes , Giuseppe Rodriguez

The first-order optimality condition of convexly constrained nonconvex nonconcave min-max optimization problems with box constraints formulates a nonmonotone variational inequality (VI), which is equivalent to a system of nonsmooth…

Optimization and Control · Mathematics 2024-04-17 Zicheng Qiu , Jie Jiang , Xiaojun Chen

Numerical methods that approximate the solution of the Vlasov-Poisson equation by a low-rank representation have been considered recently. These methods can be extremely effective from a computational point of view, but contrary to most…

Numerical Analysis · Mathematics 2018-07-09 Lukas Einkemmer , Christian Lubich

We propose a new modified primal-dual proximal best approximation method for solving convex not necessarily differentiable optimization problems. The novelty of the method relies on introducing memory by taking into account iterates…

Optimization and Control · Mathematics 2018-04-18 Ewa M. Bednarczuk , Anna Jezierska , Krzysztof E. Rutkowski

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

This paper focuses on recovering a low-rank tensor from its incomplete measurements. We propose a novel algorithm termed the Single Mode Quasi Riemannian Gradient Descent (SM-QRGD). By exploiting the benefits of both fixed-rank matrix…

Optimization and Control · Mathematics 2024-01-30 Yuanwei Zhang , Ya-Nan Zhu , Xiaoqun Zhang

This paper considers the problem of recovering either a low rank matrix or a sparse vector from observations of linear combinations of the vector or matrix elements. Recent methods replace the non-convex regularization with $\ell_1$ or…

Optimization and Control · Mathematics 2017-03-22 Carl Olsson , Marcus Carlsson , Fredrik Andersson , Viktor Larsson

We extend the geometrical inverse approximation approach for solving linear least-squares problems. For that we focus on the minimization of $1-\cos(X(A^TA),I)$, where $A$ is a given rectangular coefficient matrix and $X$ is the approximate…

Numerical Analysis · Mathematics 2019-02-25 Jean-Paul Chehab , Marcos Raydan

A linear implicit finite difference method is proposed for the approximation of the solution to a periodic, initial value problem for a Schrodinger-Hirota equation. Optimal, second order convergence in the discrete $H^1-$norm is proved,…

Numerical Analysis · Mathematics 2017-06-14 Georgios E. Zouraris

Over the years, computational imaging with accurate nonlinear physical models has garnered considerable interest due to its ability to achieve high-quality reconstructions. However, using such nonlinear models for reconstruction is…

Optimization and Control · Mathematics 2026-02-24 Tao Hong , Thanh-an Pham , Irad Yavneh , Michael Unser

We investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. In the Tucker decomposition framework, we show that the Riemannian optimization algorithm with initial value…

Machine Learning · Statistics 2019-11-13 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

Updating a linear least squares solution can be critical for near real-time signalprocessing applications. The Greville algorithm proposes a simple formula for updating the pseudoinverse of a matrix A $\in$ R nxm with rank r. In this paper,…

Mathematical Software · Computer Science 2021-06-23 Ruben Staub , Stephan N. Steinmann

In this paper, we introduce the Adaptive Inertial Method (AIM), a novel framework for accelerated first-order methods through a customizable inertial term. We provide a rigorous convergence analysis establishing a global convergence rate of…

Optimization and Control · Mathematics 2025-05-22 Han Long , Bingsheng He , Yinyu Ye , Jiheng Zhang

We consider a variant of inexact Newton Method, called Newton-MR, in which the least-squares sub-problems are solved approximately using Minimum Residual method. By construction, Newton-MR can be readily applied for unconstrained…

Optimization and Control · Mathematics 2022-05-09 Fred Roosta , Yang Liu , Peng Xu , Michael W. Mahoney

In this paper we study general $l_p$ regularized unconstrained minimization problems. In particular, we derive lower bounds for nonzero entries of first- and second-order stationary points, and hence also of local minimizers of the $l_p$…

Optimization and Control · Mathematics 2012-10-02 Zhaosong Lu

We propose a proximal point algorithm to solve LAROS problem, that is the problem of finding a "large approximately rank-one submatrix". This LAROS problem is used to sequentially extract features in data. We also develop a new stopping…

Optimization and Control · Mathematics 2011-08-05 Xuan Vinh Doan , Kim-Chuan Toh , Stephen Vavasis

We propose a new stochastic proximal quasi-Newton method for minimizing the sum of two convex functions in the particular context that one of the functions is the average of a large number of smooth functions and the other one is nonsmooth.…

Optimization and Control · Mathematics 2024-12-24 Yongcun Song , Zimeng Wang , Xiaoming Yuan , Hangrui Yue