English
Related papers

Related papers: A novel greedy Gauss-Seidel method for solving lar…

200 papers

We present a simple greedy procedure to compute an $(\alpha,\beta)$-spanner for a graph $G$. We then show that this procedure is useful for building fault-tolerant spanners, as well as spanners for weighted graphs. Our first main result is…

Data Structures and Algorithms · Computer Science 2026-03-19 Elizaveta Popova , Elad Tzalik

A greedy randomized augmented Kaczmarz (GRAK) method was proposed in [Z.-Z. Bai and W.-T. WU, SIAM J. Sci. Comput., 43 (2021), pp. A3892-A3911] for large and sparse inconsistent linear systems. However, one has to construct two new index…

Numerical Analysis · Mathematics 2023-10-24 Shunchang Li , Gang Wu

We propose a novel algorithm for greedy forward feature selection for regularized least-squares (RLS) regression and classification, also known as the least-squares support vector machine or ridge regression. The algorithm, which we call…

Machine Learning · Statistics 2010-03-19 Tapio Pahikkala , Antti Airola , Tapio Salakoski

We study the problem of scheduling sensors in a resource-constrained linear dynamical system, where the objective is to select a small subset of sensors from a large network to perform the state estimation task. We formulate this problem as…

Systems and Control · Computer Science 2018-04-05 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

This work considers a weighted POD-greedy method to estimate statistical outputs parabolic PDE problems with parametrized random data. The key idea of weighted reduced basis methods is to weight the parameter-dependent error estimate…

Numerical Analysis · Mathematics 2017-12-21 Christopher Spannring , Sebastian Ullmann , Jens Lang

The Gauss-Seidel method has been used for more than 100 years as the standard method for the solution of linear systems of equations under certain restrictions. This method, as well as Cramer and Jacobi, is widely used in education and…

Numerical Analysis · Mathematics 2025-03-31 Luis Saucedo-Mora , Luis Irastorza-Valera

We propose a randomized first order optimization algorithm Gradient Projection Iterative Sketch (GPIS) and an accelerated variant for efficiently solving large scale constrained Least Squares (LS). We provide theoretical convergence…

Optimization and Control · Mathematics 2017-07-18 Junqi Tang , Mohammad Golbabaee , Mike Davies

We study an algorithm which has been proposed by Chinesta et al. to solve high-dimensional partial differential equations. The idea is to represent the solution as a sum of tensor products and to compute iteratively the terms of this sum.…

Analysis of PDEs · Mathematics 2013-09-18 José Arturo Infante Acevedo , Tony Lelievre

The randomized Gauss--Seidel method and its extension have attracted much attention recently and their convergence rates have been considered extensively. However, the convergence rates are usually determined by upper bounds, which cannot…

Numerical Analysis · Mathematics 2021-05-25 Yanjun Zhang , Hanyu Li

We propose a new stochastic optimization framework for empirical risk minimization problems such as those that arise in machine learning. The traditional approaches, such as (mini-batch) stochastic gradient descent (SGD), utilize an…

Machine Learning · Statistics 2020-02-04 Kenji Kawaguchi , Haihao Lu

Motivated by the successful use of greedy algorithms for Reduced Basis Methods, a greedy method is proposed that selects N input data in an asymptotically optimal way to solve well-posed operator equations using these N data. The operator…

Numerical Analysis · Mathematics 2019-03-28 Robert Schaback

We propose a Randomised Subspace Gauss-Newton (R-SGN) algorithm for solving nonlinear least-squares optimization problems, that uses a sketched Jacobian of the residual in the variable domain and solves a reduced linear least-squares on…

Optimization and Control · Mathematics 2022-11-11 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

In the first part of this paper, we prove that, under some natural non-degeneracy assumptions, the Greedy Parabolic Target-Following Method, based on {\em universal tangent direction} has a favorable local behavior. In view of its global…

Optimization and Control · Mathematics 2024-12-20 Yurii Nesterov

We study the problem of sampling and reconstructing spectrally sparse graph signals where the objective is to select a subset of nodes of prespecified cardinality that ensures interpolation of the original signal with the lowest possible…

Signal Processing · Electrical Eng. & Systems 2021-11-24 Abolfazl Hashemi , Rasoul Shafipour , Haris Vikalo , Gonzalo Mateos

We study the approximability of the maximum size independent set (MIS) problem in bounded degree graphs. This is one of the most classic and widely studied NP-hard optimization problems. We focus on the well known minimum degree greedy…

Data Structures and Algorithms · Computer Science 2020-02-03 Piotr Krysta , Mathieu Mari , Nan Zhi

The nonlinear Kaczmarz method was recently proposed to solve the system of nonlinear equations. In this paper, we first discuss two greedy selection rules, i.e., the maximum residual and maximum distance rules, for the nonlinear Kaczmarz…

Numerical Analysis · Mathematics 2022-09-14 Yanjun Zhang , Hanyu Li , Ling Tang

In this project, we propose a Variational Inference algorithm to approximate posterior distributions. Building on prior methods, we develop the Gradient-Steered Stein Variational Gradient Descent (G-SVGD) approach. This method introduces a…

Computation · Statistics 2025-02-03 Jose L. Varona-Santana , Marcos A. Capistrán

We study the problem of $k$-center clustering with outliers in arbitrary metrics and Euclidean space. Though a number of methods have been developed in the past decades, it is still quite challenging to design quality guaranteed algorithm…

Computational Geometry · Computer Science 2019-04-30 Hu Ding , Haikuo Yu , Zixiu Wang

Cost-efficient compressive sensing is challenging when facing large-scale data, {\em i.e.}, data with large sizes. Conventional compressive sensing methods for large-scale data will suffer from low computational efficiency and massive…

Data Structures and Algorithms · Computer Science 2016-03-18 Sung-Hsien Hsieh , Chun-Shien Lu , Soo-Chang Pei

This paper introduces Rewired Sequential Greedy (ResQue Greedy), an enhanced approach for submodular maximization under cardinality constraints. By integrating a novel set curvature metric within a lattice-based framework, ResQue Greedy…

Discrete Mathematics · Computer Science 2025-05-21 Joan Vendrell Gallart , Alan Kuhnle , Solmaz Kia