English
Related papers

Related papers: A note on Kaczmarz algorithm with remotest set con…

200 papers

Sparse reduced rank regression is an essential statistical learning method. In the contemporary literature, estimation is typically formulated as a nonconvex optimization that often yields to a local optimum in numerical computation. Yet,…

Methodology · Statistics 2022-12-06 Canhong Wen , Ruipeng Dong , Xueqin Wang , Weiyu Li , Heping Zhang

The randomized Kaczmarz method and its accelerated variants are a powerful class of iterative methods for solving large-scale linear systems, offering guaranteed convergence with low per-iteration cost. However, their numerical stability…

Numerical Analysis · Mathematics 2026-05-19 Michał Dereziński , Ethan N. Epperly , Deanna Needell , Alexander Xue

We propose a novel sparse sliced inverse regression method based on random projections in a large $p$ small $n$ setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of…

Methodology · Statistics 2023-08-04 Jia Zhang , Runxiong Wu , Xin Chen

Randomized Kaczmarz (RK) is a simple and fast solver for consistent overdetermined systems, but it is known to be fragile under noise. We study overdetermined $m\times n$ linear systems with a sparse set of corrupted equations, $ {\bf…

Numerical Analysis · Mathematics 2026-02-16 Sofiia Shvaiko , Longxiu Huang , Elizaveta Rebrova

A new fast algebraic method for obtaining an $\mathcal{H}^2$-approximation of a matrix from its entries is presented. The main idea behind the method is based on the nested representation and the maximum-volume principle to select…

Numerical Analysis · Mathematics 2015-11-17 A. Yu Mikhalev , I. V. Oseledets

Reconstructing a dynamic object with affine motion in computerized tomography (CT) leads to motion artifacts if the motion is not taken into account. In most cases, the actual motion is neither known nor can be determined easily. As a…

Numerical Analysis · Mathematics 2024-03-14 Gesa Sarnighausen , Anne Wald , Alexander Meaney

Projection methods are popular algorithms for iteratively solving feasibility problems in Euclidean or even Hilbert spaces. They employ (selections of) nearest point mappings to generate sequences that are designed to approximate a point in…

Optimization and Control · Mathematics 2019-01-25 Heinz H. Bauschke , Sylvain Gretchko , Walaa M. Moursi

Phase retrieval has been an attractive but difficult problem rising from physical science, and there has been a gap between state-of-the-art theoretical convergence analyses and the corresponding efficient retrieval methods. Firstly, these…

Information Theory · Computer Science 2017-12-06 Gen Li , Yuchen Jiao , Yuantao Gu

Random Projection is a foundational research topic that connects a bunch of machine learning algorithms under a similar mathematical basis. It is used to reduce the dimensionality of the dataset by projecting the data points efficiently to…

Machine Learning · Computer Science 2017-10-10 Mahmoud Nabil

This paper considers a risk-constrained infinite-horizon optimal control problem and proposes to solve it in an iterative manner. Each iteration of the algorithm generates a trajectory from the starting point to the target equilibrium state…

Optimization and Control · Mathematics 2021-11-29 Alireza Zolanvari , Ashish Cherukuri

We analyze a random projection method for adjacency matrices, studying its utility in representing sparse graphs. We show that these random projections retain the functionality of their underlying adjacency matrices while having extra…

Data Structures and Algorithms · Computer Science 2023-09-06 Frank Qiu

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisfy $z^2=z$, to model…

Optimization and Control · Mathematics 2021-12-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Given a max-plus linear system and a semimodule, the problem of computing the maximal controlled invariant subsemimodule is still open to this day. In this paper, we consider this problem for the specific class of fully actuated systems and…

Optimization and Control · Mathematics 2026-02-10 Davide Zorzenon , Jörg Raisch

Recursive stochastic algorithms have gained significant attention in the recent past due to data driven applications. Examples include stochastic gradient descent for solving large-scale optimization problems and empirical dynamic…

Machine Learning · Computer Science 2020-07-27 Abhishek Gupta , Hao Chen , Jianzong Pi , Gaurav Tendolkar

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

In this study, we consider a general time-space system, whose model operator and observation operator are locally Lipschitz continuous, over a finite time horizon and parameter identification by using Landweber-Kaczmarz regularization. The…

Analysis of PDEs · Mathematics 2019-02-20 Tram Thi Ngoc Nguyen

Random projections are random linear maps, sampled from appropriate distributions, that approx- imately preserve certain geometrical invariants so that the approximation improves as the dimension of the space grows. The well-known…

Optimization and Control · Mathematics 2017-06-12 Ky Vu , Pierre-Louis Poirion , Leo Liberti

The performance of an iterative reconstruction algorithm for X-ray tomography is strongly determined by the features of the used forward and backprojector. For this reason, a large number of studies has focused on the to design of…

Computer Vision and Pattern Recognition · Computer Science 2016-12-19 Filippo Arcadu , Marco Stampanoni , Federica Marone

In this paper we analyse convergence of projected fixed-point iteration on a Riemannian manifold of matrices with fixed rank. As a retraction method we use `projector splitting scheme'. We prove that the projector splitting scheme converges…

Numerical Analysis · Mathematics 2016-04-08 Denis Kolesnikov , Ivan Oseledets

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

Statistics Theory · Mathematics 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon