English
Related papers

Related papers: Optimal parameter for the SOR-like iteration metho…

200 papers

The choice of relaxation parameter in the projected successive overrelaxation (PSOR) method for nonnegative quadratic programming problems is problem-dependent. We present novel adaptive PSOR algorithms that adaptively control the…

Optimization and Control · Mathematics 2024-09-10 Yuto Miyatake , Tomohiro Sogabe

The last two decades witnessed the increasing of the interests on the absolute value equations (AVE) of finding $x\in\mathbb{R}^n$ such that $Ax-|x|-b=0$, where $A\in \mathbb{R}^{n\times n}$ and $b\in \mathbb{R}^n$. In this paper, we pay…

Optimization and Control · Mathematics 2022-02-15 Cairong Chen , Dongmei Yu , Deren Han

In this paper, we proposed a monotone block coordinate descent method for solving absolute value equation (AVE). Under appropriate conditions, we analyzed the global convergence of the algorithm and conduct numerical experiments to…

Numerical Analysis · Mathematics 2024-12-17 Tingting Luo , Jiayu Liu , Cairong Chen , Qun Wang

This paper investigates the optimal ergodic sublinear convergence rate of the relaxed proximal point algorithm for solving monotone variational inequality problems. The exact worst case convergence rate is computed using the performance…

Optimization and Control · Mathematics 2019-07-15 Guoyong Gu , Junfeng Yang

In this paper, we study the finite-sum convex optimization problem focusing on the general convex case. Recently, the study of variance reduced (VR) methods and their accelerated variants has made exciting progress. However, the step size…

Optimization and Control · Mathematics 2022-01-31 Zijian Liu , Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

For solving strongly convex optimization problems, we propose and study the global convergence of variants of the A-HPE and large-step A-HPE algorithms of Monteiro and Svaiter. We prove linear and the superlinear…

Optimization and Control · Mathematics 2021-10-05 M. Marques Alves

The ultimate goal of any numerical scheme for partial differential equations (PDEs) is to compute an approximation of user-prescribed accuracy at quasi-minimal computational time. To this end, algorithmically, the standard adaptive finite…

Numerical Analysis · Mathematics 2025-01-30 Philipp Bringmann , Michael Feischl , Ani Miraci , Dirk Praetorius , Julian Streitberger

In this paper, we study the fundamental open question of finding the optimal high-order algorithm for solving smooth convex minimization problems. Arjevani et al. (2019) established the lower bound $\Omega\left(\epsilon^{-2/(3p+1)}\right)$…

Optimization and Control · Mathematics 2022-05-20 Dmitry Kovalev , Alexander Gasnikov

In this paper, we investigate global convergence properties of the inexact nonsmooth Newton method for solving the system of absolute value equations (AVE). Global $Q$-linear convergence is established under suitable assumptions. Moreover,…

Optimization and Control · Mathematics 2015-11-13 J. Y. Bello Cruz , O. P. Ferreira , L. F. Prudente

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

Optimization and Control · Mathematics 2020-10-05 Guanghui Lan , Zhiqiang Zhou

Over the past decade, various matrix completion algorithms have been developed. Thresholded singular value decomposition (SVD) is a popular technique in implementing many of them. A sizable number of studies have shown its theoretical and…

Methodology · Statistics 2016-05-10 Juhee Cho , Donggyu Kim , Karl Rohe

We consider a suboptimal solution path algorithm for the Support Vector Machine. The solution path algorithm is an effective tool for solving a sequence of a parametrized optimization problems in machine learning. The path of the solutions…

Machine Learning · Computer Science 2011-05-04 Masayuki Karasuyama , Ichiro Takeuchi

Sparse inverse covariance selection is a fundamental problem for analyzing dependencies in high dimensional data. However, such a problem is difficult to solve since it is NP-hard. Existing solutions are primarily based on convex…

Numerical Analysis · Computer Science 2018-04-05 Ganzhao Yuan , Haoxian Tan , Wei-Shi Zheng

We study the average-case version of the Orthogonal Vectors problem, in which one is given as input $n$ vectors from $\{0,1\}^d$ which are chosen randomly so that each coordinate is $1$ independently with probability $p$. Kane and Williams…

Data Structures and Algorithms · Computer Science 2024-10-31 Josh Alman , Alexandr Andoni , Hengjie Zhang

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

In this paper, we consider the {\it tensor absolute value equations} (TAVEs), which is a newly introduced problem in the context of multilinear systems. Although the system of TAVEs is an interesting generalization of matrix {\it absolute…

Optimization and Control · Mathematics 2018-10-16 Chen Ling , Weijie Yan , Hongjin He , Liqun Qi

In this paper, a new analytic method with a convergence-control parameter $c$ is first proposed. The parameter $c$ is used to adjust and control the convergence region and rate of the resulting series solution. It turns out that the…

Numerical Analysis · Mathematics 2021-03-23 Xiaolong Zhang , Songxin Liang

We consider a class of statistical estimation problems in which we are given a random data matrix ${\boldsymbol X}\in {\mathbb R}^{n\times d}$ (and possibly some labels ${\boldsymbol y}\in{\mathbb R}^n$) and would like to estimate a…

Computation · Statistics 2022-01-14 Andrea Montanari , Yuchen Wu

We develop Second Order Asymptotical Regularization (SOAR) methods for solving inverse source problems in elliptic partial differential equations with both Dirichlet and Neumann boundary data. We show the convergence results of SOAR with…

Numerical Analysis · Mathematics 2019-01-23 Ye Zhang , Rongfang Gong

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton…

Machine Learning · Statistics 2015-06-15 Praneeth Netrapalli , Prateek Jain , Sujay Sanghavi