English
Related papers

Related papers: Filtering for Anderson acceleration

200 papers

The alternating direction multiplier method (ADMM) is widely used in computer graphics for solving optimization problems that can be nonsmooth and nonconvex. It converges quickly to an approximate solution, but can take a long time to…

Optimization and Control · Mathematics 2020-06-29 Wenqing Ouyang , Yue Peng , Yuxin Yao , Juyong Zhang , Bailin Deng

Anderson acceleration (or Anderson mixing) is an efficient acceleration method for fixed point iterations $x_{t+1}=G(x_t)$, e.g., gradient descent can be viewed as iteratively applying the operation $G(x) \triangleq x-\alpha\nabla f(x)$. It…

Optimization and Control · Mathematics 2020-03-03 Zhize Li , Jian Li

Given a matrix the seriation problem consists in permuting its rows in such way that all its columns have the same shape, for example, they are monotone increasing. We propose a statistical approach to this problem where the matrix of…

Statistics Theory · Mathematics 2016-08-02 Nicolas Flammarion , Cheng Mao , Philippe Rigollet

We propose a novel stochastic gradient descent method for solving linear least squares problems with partially observed data. Our method uses submatrices indexed by a randomly selected pair of row and column index sets to update the iterate…

Numerical Analysis · Mathematics 2020-07-10 Kui Du , Xiao-Hui Sun

A subspace method is introduced to solve large-scale trace ratio problems. This approach is matrix-free, requiring only the action of the two matrices involved in the trace ratio. At each iteration, a smaller trace ratio problem is…

Numerical Analysis · Mathematics 2024-12-04 G. Ferrandi , M. E. Hochstenbach , M. R. Oliveira

This article focuses on the problem of reconstructing low-rank matrices from underdetermined measurements using alternating optimization strategies. We endeavour to combine an alternating least-squares based estimation strategy with ideas…

Statistics Theory · Mathematics 2014-07-15 Kezhi Li , Martin Sundin , Cristian R. Rojas , Saikat Chatterjee , Magnus Jansson

Thinning is the removal of contour pixels/points of connected components in an image to produce their skeleton with retained connectivity and structural properties. The output requirements of a thinning procedure often vary with…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Himanshu Jain , Archana Praveen Kumar

Tensor ring (TR) decomposition has been widely applied as an effective approach in a variety of applications to discover the hidden low-rank patterns in multidimensional data. A well-known method for TR decomposition is the alternating…

Numerical Analysis · Mathematics 2022-10-21 Yajie Yu , Hanyu Li

In this paper, the elliptic PDE-constrained optimization problem with box constraints on the control is studied. To numerically solve the problem, we apply the 'optimize-discretize-optimize' strategy. Specifically, the alternating direction…

Optimization and Control · Mathematics 2019-08-14 Xiaotong Chen , Xiaoliang Song , Zixuan Chen , Bo Yu

The problem of the optimal allocation (in the expected mean square error sense) of a measurement budget for particle filtering is addressed. We propose three different optimal intermittent filters, whose optimality criteria depend on the…

Systems and Control · Electrical Eng. & Systems 2022-06-29 Antoine Aspeel , Amaury Gouverneur , Raphaël M. Jungers , Benoit Macq

In this paper, we focus on solving a sequence of linear systems with an identical (or similar) coefficient matrix. For this type of problems, we investigate the subspace correction and deflation methods, which use an auxiliary matrix…

Numerical Analysis · Mathematics 2022-03-17 Takeshi Iwashita , Kota Ikehara , Takeshi Fukaya , Takeshi Mifune

The Schur decomposition of a square matrix $A$ is an important intermediate step of state-of-the-art numerical algorithms for addressing eigenvalue problems, matrix functions, and matrix equations. This work is concerned with the following…

Numerical Analysis · Mathematics 2022-03-22 Zvonimir Bujanović , Daniel Kressner , Christian Schröder

This article investigates a fast and stable method to solve Henderson's mixed model equation. The proposed algorithm is stable in that it avoids inverting a matrix of a large dimension and hence is free from the curse of dimensionality.…

Computation · Statistics 2017-10-27 Jiwoong Kim

We consider two matrix completion problems, in which we are given a matrix with missing entries and the task is to complete the matrix in a way that (1) minimizes the rank, or (2) minimizes the number of distinct rows. We study the…

Data Structures and Algorithms · Computer Science 2018-09-14 Robert Ganian , Iyad Kanj , Sebastian Ordyniak , Stefan Szeider

It is classical that, when the small deformation is assumed, the incremental analysis problem of an elastoplastic structure with a piecewise-linear yield condition and a linear strain hardening model can be formulated as a convex quadratic…

Optimization and Control · Mathematics 2017-08-22 Yoshihiro Kanno

Iterative sketching and sketch-and-precondition are well-established randomized algorithms for solving large-scale, over-determined linear least-squares problems. In this paper, we introduce a new perspective that interprets Iterative…

Numerical Analysis · Mathematics 2024-10-18 Ruihan Xu , Yiping Lu

This article is concerned with a new filtered two-step variational integrator for solving the charged-particle dynamics in a mildly non-uniform moderate or strong magnetic field with a dimensionless parameter $\varepsilon$ inversely…

Numerical Analysis · Mathematics 2026-03-05 Ting Li , Bin Wang

Filtering and parameter estimation under partial information for multiscale problems is studied in this paper. After proving mean square convergence of the nonlinear filter to a filter of reduced dimension, we establish that the conditional…

Probability · Mathematics 2014-09-09 Andrew Papanicolaou , Konstantinos Spiliopoulos

In this paper we accomplish the development of the fast rank-adaptive solver for tensor-structured symmetric positive definite linear systems in higher dimensions. In [arXiv:1301.6068] this problem is approached by alternating minimization…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

An adaptive iterative decision multi-feedback detection algorithm with constellation constraints is proposed for multiuser multi-antenna systems. An enhanced detection and interference cancellation is performed by introducing multiple…

Information Theory · Computer Science 2013-04-24 Peng Li , Jingjing Liu , Rodrigo C. de Lamare