English
Related papers

Related papers: Greedy algorithms for high-dimensional non-symmetr…

200 papers

In the first part of this paper, we prove that, under some natural non-degeneracy assumptions, the Greedy Parabolic Target-Following Method, based on {\em universal tangent direction} has a favorable local behavior. In view of its global…

Optimization and Control · Mathematics 2024-12-20 Yurii Nesterov

We study the problem of maximizing constrained non-monotone submodular functions and provide approximation algorithms that improve existing algorithms in terms of either the approximation factor or simplicity. Our algorithms combine…

Data Structures and Algorithms · Computer Science 2016-03-01 Salman Fadaei , MohammadAmin Fazli , MohammadAli Safari

An algorithm is proposed, analyzed, and tested for solving continuous nonlinear-equality-constrained optimization problems where the objective and constraint functions are defined by expectations or averages over large, finite numbers of…

Optimization and Control · Mathematics 2026-05-14 Frank E. Curtis , Lingjun Guo , Daniel P. Robinson

We reinterpret some online greedy algorithms for a class of nonlinear "load-balancing" problems as solving a mathematical program online. For example, we consider the problem of assigning jobs to (unrelated) machines to minimize the sum of…

Data Structures and Algorithms · Computer Science 2011-09-28 Anupam Gupta , Ravishankar Krishnaswamy , Kirk Pruhs

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

This paper is devoted to studying the global and finite convergence of the semi-smooth Newton method for solving a piecewise linear system that arises in cone-constrained quadratic programming problems and absolute value equations. We first…

Optimization and Control · Mathematics 2023-01-24 Nicolas F. Armijo , Yunier Bello-Cruz , Gabriel Haeser

An approach for effective implementation of greedy selection methodologies, to approximate an image partitioned into blocks, is proposed. The method is specially designed for approximating partitions on a transformed image. It evolves by…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Laura Rebollo-Neira , Ryszard Maciol , Shabnam Bibi

Results on two different settings of asymptotic behavior of approximation characteristics of individual functions are presented. First, we discuss the following classical question for sparse approximation. Is it true that for any individual…

Numerical Analysis · Mathematics 2019-11-11 L. Burusheva , V. Temlyakov

In this paper, we present a new ellipsoid-type algorithm for solving nonsmooth problems with convex structure. Examples of such problems include nonsmooth convex minimization problems, convex-concave saddle-point problems and variational…

Optimization and Control · Mathematics 2021-06-28 Anton Rodomanov , Yurii Nesterov

The rate of convergence of the classical Thresholding Greedy Algorithm with respect to bases is studied in this paper. We bound the error of approximation by the product of both norms -- the norm of $f$ and the $A_1$-norm of $f$. We obtain…

Numerical Analysis · Mathematics 2024-07-29 V. N. Temlyakov

We consider the problem of studying the performance of greedy algorithm on sensor selection problem for stable linear systems with Kalman Filter. Specifically, the objective is to find the system parameters that affects the performance of…

Data Structures and Algorithms · Computer Science 2017-07-10 Jingyuan Liu

This paper describes a massively parallel algebraic multigrid method based on non-smoothed aggregation. It is especially suited for solving heterogeneous elliptic problems as it uses a greedy heuristic algorithm for the aggregation that…

Numerical Analysis · Mathematics 2013-10-01 Markus Blatt , Olaf Ippisch , Peter Bastian

Large-scale L1-regularized loss minimization problems arise in high-dimensional applications such as compressed sensing and high-dimensional supervised learning, including classification and regression problems. High-performance algorithms…

Machine Learning · Statistics 2012-12-19 Chad Scherrer , Ambuj Tewari , Mahantesh Halappanavar , David Haglin

This paper addresses the task allocation problem for multi-robot systems. The main issue with the task allocation problem is inherent complexity that makes finding an optimal solution within a reasonable time almost impossible. To hand the…

Multiagent Systems · Computer Science 2019-01-11 Hyo-Sang Shin , Teng Li , Pau Segui-Gasco

We describe a greedy algorithm that approximates the Carleson constant of a collection of general sets. The approximation has a logarithmic loss in a general setting, but is optimal up to a constant with only mild geometric assumptions. The…

Classical Analysis and ODEs · Mathematics 2022-02-22 Guillermo Rey

A greedy randomized nonlinear Bregman-Kaczmarz method by sampling the working index with residual information is developed for the solution of the constrained nonlinear system of equations. Theoretical analyses prove the convergence of the…

Numerical Analysis · Mathematics 2024-06-25 Aqin Xiao , Junfeng Yin

In this paper, a class of optimization problems with nonlinear inequality constraints is discussed. Based on the ideas of sequential quadratic programming algorithm and the method of strongly sub-feasible directions, a new superlinearly…

Optimization and Control · Mathematics 2012-06-28 Jin-Bao Jian , Chuan-Hao Guo , Chun-Ming Tang , Yan-Qin Bai

In this paper we analyze several new methods for solving nonconvex optimization problems with the objective function formed as a sum of two terms: one is nonconvex and smooth, and another is convex but simple and its structure is known.…

Optimization and Control · Mathematics 2014-06-25 A. Patrascu , I. Necoara

We show for several computational problems how classical greedy algorithms for special cases can be derived in a simple way from dynamic programs for the general case: interval scheduling (restricted to unit weights), knapsack (restricted…

Data Structures and Algorithms · Computer Science 2026-02-26 Dieter van Melkebeek

We consider the sparse contextual bandit problem where arm feature affects reward through the inner product of sparse parameters. Recent studies have developed sparsity-agnostic algorithms based on the greedy arm selection policy. However,…

Machine Learning · Computer Science 2024-04-01 Koji Ichikawa , Shinji Ito , Daisuke Hatano , Hanna Sumita , Takuro Fukunaga , Naonori Kakimura , Ken-ichi Kawarabayashi