English
Related papers

Related papers: On a generalization of iterated and randomized rou…

200 papers

We make the interprecision transfers explicit in an algorithmic description of iterative refinement and obtain new insights into the algorithm. One example is the classic variant of iterative refinement where the matrix and the…

Numerical Analysis · Mathematics 2024-07-02 C. T. Kelley

Within a statistical learning setting, we propose and study an iterative regularization algorithm for least squares defined by an incremental gradient method. In particular, we show that, if all other parameters are fixed a priori, the…

Machine Learning · Statistics 2015-06-16 Lorenzo Rosasco , Silvia Villa

The choice of the parameter value for regularized inverse problems is critical to the results and remains a topic of interest. This article explores a criterion for selecting a good parameter value by maximizing the probability of the data,…

Numerical Analysis · Mathematics 2020-02-11 Toby Sanders , Rodrigo B. Platte , Robert D. Skeel

In this paper, we present a generalized version of the matrix chain algorithm to generate efficient code for linear algebra problems, a task for which human experts often invest days or even weeks of works. The standard matrix chain problem…

Mathematical Software · Computer Science 2018-04-12 Henrik Barthels , Marcin Copik , Paolo Bientinesi

Answering a question of Haugland, we show that the pooling problem with one pool and a bounded number of inputs can be solved in polynomial time by solving a polynomial number of linear programs of polynomial size. We also give an overview…

Optimization and Control · Mathematics 2017-02-09 Natashia Boland , Thomas Kalinowski , Fabian Rigterink

We describe a seriation algorithm for ranking a set of items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compare similarly with all others. It does so by constructing a…

Machine Learning · Computer Science 2016-03-11 Fajwel Fogel , Alexandre d'Aspremont , Milan Vojnovic

In this article we investigate the connection between regularization theory for inverse problems and dynamic programming theory. This is done by developing two new regularization methods, based on dynamic programming techniques. The aim of…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

When proving the correctness of a method for slicing probabilistic programs, it was previously discovered by the authors that for a fixed point iteration to work one needs a non-standard starting point for the iteration. This paper presents…

Programming Languages · Computer Science 2024-12-11 Torben Amtoft , Anindya Banerjee

Based on the column pivoted QR decomposition, we propose some randomized algorithms including pass-efficient ones for the generalized CUR decompositions of matrix pair and matrix triplet. Detailed error analyses of these algorithms are…

Numerical Analysis · Mathematics 2023-03-14 Guihua Zhang , Hanyu Li , Yimin Wei

Image restoration refers to the process of reconstructing noisy, destroyed, or missing parts of an image, which is an ill-posed inverse problem. A specific regularization term and image degradation are typically assumed to achieve…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Jianwei Ke

Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little…

Optimization and Control · Mathematics 2010-09-28 Y. Censor , R. Davidi , G. T. Herman

We propose a general modeling and algorithmic framework for discrete structure recovery that can be applied to a wide range of problems. Under this framework, we are able to study the recovery of clustering labels, ranks of players, signs…

Statistics Theory · Mathematics 2020-09-29 Chao Gao , Anderson Y. Zhang

Progressive Hedging is a popular decomposition algorithm for solving multi-stage stochastic optimization problems. A computational bottleneck of this algorithm is that all scenario subproblems have to be solved at each iteration. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-28 Gilles Bareilles , Yassine Laguel , Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick

This paper provides a set of cycling problems in linear programming. These problems should be useful for researchers to develop and test new simplex algorithms. As matter of the fact, this set of problems is used to test a recently proposed…

Optimization and Control · Mathematics 2021-07-20 Yaguang Yang

For linear systems $Ax=b$ we develop iterative algorithms based on a sketch-and-project approach. By using judicious choices for the sketch, such as the history of residuals, we develop weighting strategies that enable short recursive…

Numerical Analysis · Mathematics 2024-07-02 Johannes J Brust , Michael A Saunders

Iterative refinement is particularly popular for numerical solution of linear systems of equations. We extend it to Low Rank Approximation of a matrix (LRA) and observe close link of the resulting algorithm to oversampling techniques,…

Numerical Analysis · Mathematics 2024-11-28 Victor Y. Pan , Qi Luan , Soo Go

The Kaczmarz algorithm is an iterative method that solves linear systems of equations. It stands out among iterative algorithms when dealing with large systems for two reasons. First, at each iteration, the Kaczmarz algorithm uses a single…

Numerical Analysis · Mathematics 2024-04-10 Inês A. Ferreira , Juan A. Acebrón , José Monteiro

Learned image reconstruction has become a pillar in computational imaging and inverse problems. Among the most successful approaches are learned iterative networks, which are formulated by unrolling classical iterative optimisation…

Image and Video Processing · Electrical Eng. & Systems 2025-12-10 Andreas Hauptmann , Ozan Öktem

This study investigates the iterative refinement method applied to the solution of linear discrete inverse problems by considering its application to the Tikhonov problem in mixed precision. Previous works on mixed precision iterative…

Numerical Analysis · Mathematics 2025-10-22 James G. Nagy , Lucas Onisk

We present algorithms for efficiently learning regularizers that improve generalization. Our approach is based on the insight that regularizers can be viewed as upper bounds on the generalization gap, and that reducing the slack in the…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter