English
Related papers

Related papers: Extrapolation Methods for fixed-point Multilinear …

200 papers

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called…

Optimization and Control · Mathematics 2021-12-08 Quoc Tran-Dinh , Yang Luo

This paper studies the issues about tensors. Three typical kinds of tensor decomposition are mentioned. Among these decompositions, the t-SVD is proposed in this decade. Different definitions of rank derive from tensor decompositions. Based…

Numerical Analysis · Mathematics 2020-05-26 Jun Han

To efficiently express tensor data using the Tucker format, a critical task is to minimize the multilinear rank such that the model would not be over-flexible and lead to overfitting. Due to the lack of rank minimization tools in tensor,…

Signal Processing · Electrical Eng. & Systems 2024-09-11 Xueke Tong , Hancheng Zhu , Lei Cheng , Yik-Chung Wu

In the present work, we study how to develop an efficient solver for the fast resolution of large and sparse linear systems that occur while discretizing elliptic partial differential equations using isogeometric analysis. Our new approach…

Numerical Analysis · Mathematics 2024-12-31 Abdellatif Mouhssine , Ahmed Ratnani , Hassane Sadok

This paper proposes an accelerated proximal point method for maximally monotone operators. The proof is computer-assisted via the performance estimation problem approach. The proximal point method includes various well-known convex…

Optimization and Control · Mathematics 2021-03-25 Donghwan Kim

Tensors are a natural way to express correlations among many physical variables, but storing tensors in a computer naively requires memory which scales exponentially in the rank of the tensor. This is not optimal, as the required memory is…

Computational Physics · Physics 2018-12-03 Adam S. Jermyn

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

Despite the broad use of fixed-point iterations throughout applied mathematics, the optimal convergence rate of general fixed-point problems with nonexpansive nonlinear operators has not been established. This work presents an acceleration…

Optimization and Control · Mathematics 2022-06-28 Jisun Park , Ernest K. Ryu

Most successful applications of deep learning involve similar training and test conditions. However, tasks such as biological sequence design involve searching for sequences that improve desirable properties beyond previously known values,…

Machine Learning · Computer Science 2025-05-27 Sophia Hager , Aleem Khan , Andrew Wang , Nicholas Andrews

The recursive Neville algorithm allows one to calculate interpolating functions recursively. Upon a judicious choice of the abscissas used for the interpolation (and extrapolation), this algorithm leads to a method for convergence…

Numerical Analysis · Mathematics 2024-07-11 U. D. Jentschura , L. T. Giorgini

The widespread use of multi-sensor technology and the emergence of big datasets has highlighted the limitations of standard flat-view matrix models and the necessity to move towards more versatile data analysis tools. We show that…

Numerical Analysis · Computer Science 2015-06-19 A. Cichocki , D. Mandic , A-H. Phan , C. Caiafa , G. Zhou , Q. Zhao , L. De Lathauwer

There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that…

Numerical Analysis · Mathematics 2021-09-09 Ilya Kisil , Giuseppe G. Calvi , Kriton Konstantinidis , Yao Lei Xu , Danilo P. Mandic

Machine learning systems, especially with overparameterized deep neural networks, can generalize to novel test instances drawn from the same distribution as the training data. However, they fare poorly when evaluated on out-of-support test…

Machine Learning · Computer Science 2023-04-28 Aviv Netanyahu , Abhishek Gupta , Max Simchowitz , Kaiqing Zhang , Pulkit Agrawal

In this paper we propose an algorithm to classify tensor data. Our methodology is built on recent studies about matrix classification with the trace norm constrained weight matrix and the tensor trace norm. Similar to matrix classification,…

Numerical Analysis · Computer Science 2011-09-08 Ziqiang Shi , Tieran Zheng , Jiqing Han

We study the general approach to accelerating the convergence of the most widely used solution method of Markov decision processes with the total expected discounted reward. Inspired by the monotone behavior of the contraction mappings in…

Optimization and Control · Mathematics 2008-03-28 Oleksandr Shlakhter , Chi-Guhn Lee , Dmitry Khmelev , Nasser Jaber

We present some accelerated variants of fixed point iterations for computing the minimal non-negative solution of the unilateral matrix equation associated with an M/G/1-type Markov chain. These variants derive from certain staircase…

Numerical Analysis · Mathematics 2022-09-30 Luca Gemignani , Beatrice Meini

We propose a new method for low-rank approximation of Moore-Penrose pseudoinverses (MPPs) of large-scale matrices using tensor networks. The computed pseudoinverses can be useful for solving or preconditioning of large-scale overdetermined…

Numerical Analysis · Mathematics 2016-07-06 Namgil Lee , Andrzej Cichocki

Recent work on eigenvalues and eigenvectors for tensors of order m >= 3 has been motivated by applications in blind source separation, magnetic resonance imaging, molecular conformation, and more. In this paper, we consider methods for…

Numerical Analysis · Mathematics 2011-11-14 Tamara G. Kolda , Jackson R. Mayo

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

We propose inertial versions of block coordinate descent methods for solving non-convex non-smooth composite optimization problems. Our methods possess three main advantages compared to current state-of-the-art accelerated first-order…

Optimization and Control · Mathematics 2020-06-03 Le Thi Khanh Hien , Nicolas Gillis , Panagiotis Patrinos