English
Related papers

Related papers: On Inner Iterations in the Shift-Invert Residual A…

200 papers

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

A bottleneck of sufficient dimension reduction (SDR) in the modern era is that, among numerous methods, only the sliced inverse regression (SIR) is generally applicable under the high-dimensional settings. The higher-order inverse…

Methodology · Statistics 2024-07-24 Yin Jin , Wei Luo

We develop a new randomized iterative algorithm---stochastic dual ascent (SDA)---for finding the projection of a given vector onto the solution space of a linear system. The method is dual in nature: with the dual being a non-strongly…

Numerical Analysis · Mathematics 2016-01-29 Robert Mansel Gower , Peter Richtarik

In this paper, we describe a new algorithm that approximates the extreme eigenvalue/eigenvector pairs of a symmetric matrix. The proposed algorithm can be viewed as an extension of the Jacobi eigenvalue method for symmetric matrices…

Numerical Analysis · Mathematics 2025-09-16 Cristian Rusu

Sliced inverse regression (SIR) is a popular sufficient dimension reduction method that identifies a few linear transformations of the covariates without losing regression information with the response. In high-dimensional settings, SIR can…

Methodology · Statistics 2025-12-04 Linh H. Nghiem , Francis. K. C. Hui , Samuel Muller , A. H. Welsh

In this work, we propose an efficient adaptive multilevel preconditioned Jacobi-Davidson (PJD) method for eigenvalue problems with singularity. Our multilevel method utilizes a local smoothing strategy to solve the preconditioned…

Numerical Analysis · Mathematics 2026-05-14 Jianing Guo , Qigang Liang , Xuejun Xu

We propose a novel sparse sliced inverse regression method based on random projections in a large $p$ small $n$ setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of…

Methodology · Statistics 2023-08-04 Jia Zhang , Runxiong Wu , Xin Chen

We propose a versatile, parameter-less approach for solving the shape matching problem, specifically in the context of atomic structures when atomic assignments are not known a priori. The algorithm Iteratively suggests Rotated…

Computational Physics · Physics 2021-11-02 Miha Gunde , Nicolas Salles , Anne Hémeryck , Layla Martin-Samos

The analysis of second-order optimization methods based either on sub-sampling, randomization or sketching has two serious shortcomings compared to the conventional Newton method. The first shortcoming is that the analysis of the iterates…

Optimization and Control · Mathematics 2024-04-05 Nick Tsipinakis , Panos Parpas

A new algorithm for eigenvalue problems for the fractional Jacobi type ODE is proposed. The algorithm is based on piecewise approximation of the coefficients of the differential equation with subsequent recursive procedure adapted from some…

Numerical Analysis · Mathematics 2018-06-27 Ivan Gavrilyuk , Volodymyr Makarov , Nataliia Romaniuk

One of the most widely used methods for eigenvalue computation is the $QR$ iteration with Wilkinson's shift: here the shift $s$ is the eigenvalue of the bottom $2\times 2$ principal minor closest to the corner entry. It has been a…

Spectral Theory · Mathematics 2010-01-25 Ricardo S. Leite , Nicolau C. Saldanha , Carlos Tomei

We consider Riemannian optimization problems with inequality and equality constraints and analyze a class of Riemannian interior point methods for solving them. The algorithm of interest consists of outer and inner iterations. We show that,…

Optimization and Control · Mathematics 2026-05-12 Mitsuaki Obara , Takayuki Okuno , Akiko Takeda

This paper analyzes a special instance of nonsymmetric algebraic matrix Riccati equations arising from transport theory. Traditional approaches for finding the minimal nonnegative solution of the matrix Riccati equations are based on the…

Numerical Analysis · Mathematics 2011-09-26 Chun-Yueh Chiang , Matthew M. Lin

For a general third-order tensor $\mathcal{A}\in\mathbb{R}^{n\times n\times n}$ the paper studies two closely related problems, an SVD-like tensor decomposition and an (approximate) tensor diagonalization. We develop a Jacobi-type algorithm…

Numerical Analysis · Mathematics 2024-03-20 Erna Begovic

The Iterative Rational Krylov Algorithm (IRKA) of [8] is an interpolatory model reduction approach to the optimal $\mathcal{H}_2$ approximation problem. Even though the method has been illustrated to show rapid convergence in various…

Numerical Analysis · Mathematics 2013-01-23 Garret Flagg , Christopher Beattie , Serkan Gugercin

Previous works have shown that reducing parameter overhead and computations for transformer-based single image super-resolution (SISR) models (e.g., SwinIR) usually leads to a reduction of performance. In this paper, we present GRFormer, an…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yuzhen Li , Zehang Deng , Yuxin Cao , Lihua Liu

Psychoacoustic experiments have shown that directional properties of the direct sound, salient reflections, and the late reverberation of an acoustic room response can have a distinct influence on the auditory perception of a given room.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-28 Thomas Deppisch , Sebastià V. Amengual Garí , Paul Calamia , Jens Ahrens

We present an approximate inference method, based on a synergistic combination of R\'enyi $\alpha$-divergence variational inference (RDVI) and rejection sampling (RS). RDVI is based on minimization of R\'enyi $\alpha$-divergence…

Machine Learning · Computer Science 2019-10-30 Rahul Sharma , Abhishek Kumar , Piyush Rai

In this paper, we propose a simple sparse approximate inverse for triangular matrices (SAIT). Using the Jacobi iteration method, we obtain an expression of the exact inverse of triangular matrix, which is a finite series. The SAIT is…

Numerical Analysis · Mathematics 2021-11-19 Zhongjie Lu

Parameter reduction can enable otherwise infeasible design and uncertainty studies with modern computational science models that contain several input parameters. In statistical regression, techniques for sufficient dimension reduction…

Numerical Analysis · Mathematics 2018-12-12 Andrew T. Glaws , Paul G. Constantine , R. Dennis Cook