English
Related papers

Related papers: Super Greedy Type Algorithms

200 papers

The paper gives a systematic study of the approximate versions of three greedy-type algorithms that are widely used in convex optimization. By approximate version we mean the one where some of evaluations are made with an error. Importance…

Machine Learning · Statistics 2014-12-11 Vladimir Temlyakov

We investigate at decision trees that incorporate both traditional queries based on one attribute and queries based on hypotheses about the values of all attributes. Such decision trees are similar to ones studied in exact learning, where…

Computational Complexity · Computer Science 2022-03-18 Mohammad Azad , Igor Chikalov , Shahid Hussain , Mikhail Moshkov , Beata Zielosko

The change-making problem consists of representing a certain amount of money with the least possible number of coins, from a given, pre-established set of denominations. The greedy algorithm works by choosing the coins of largest possible…

Combinatorics · Mathematics 2025-07-14 Hebert Pérez-Rosés

Collective communications are ubiquitous in parallel applications. We present two new algorithms for performing a reduction. The operation associated with our reduction needs to be associative and commutative. The two algorithms are…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-18 Bradley R. Lowery , Julien Langou

Subset selection is a popular topic in recent years and a number of subset selection methods have been proposed. Among those methods, hypervolume subset selection is widely used. Greedy hypervolume subset selection algorithms can achieve…

Neural and Evolutionary Computing · Computer Science 2020-07-07 Weiyu Chen , Hisao Ishibuhci , Ke Shang

Many problems in signal processing and machine learning can be formalized as weak submodular optimization tasks. For such problems, a simple greedy algorithm (\textsc{Greedy}) is guaranteed to find a solution achieving the objective with a…

Discrete Mathematics · Computer Science 2021-11-24 Abolfazl Hashemi , Haris Vikalo , Gustavo de Veciana

We perform an experimental study of algorithms for online bipartite matching under the known i.i.d. input model with integral types. In the last decade, there has been substantial effort in designing complex algorithms with the goal of…

Data Structures and Algorithms · Computer Science 2018-08-16 Allan Borodin , Christodoulos Karavasilis , Denis Pankratov

It is known that greedy methods perform well for maximizing monotone submodular functions. At the same time, such methods perform poorly in the face of non-monotonicity. In this paper, we show - arguably, surprisingly - that invoking the…

Machine Learning · Computer Science 2017-04-07 Moran Feldman , Christopher Harshaw , Amin Karbasi

The greedy strategy is an approximation algorithm to solve optimization problems arising in decision making with multiple actions. How good is the greedy strategy compared to the optimal solution? In this survey, we mainly consider two…

Optimization and Control · Mathematics 2019-05-10 Yajing Liu , Edwin K. P. Chong , Ali Pezeshki , Zhenliang Zhang

In this article, we present a family of numerical approaches to solve high-dimensional linear non-symmetric problems. The principle of these methods is to approximate a function which depends on a large number of variates by a sum of tensor…

Functional Analysis · Mathematics 2012-10-26 Eric Cances , Virginie Ehrlacher , Tony Lelievre

Determinantal point processes (DPPs) are popular probabilistic models that arise in many machine learning tasks, where distributions of diverse sets are characterized by matrix determinants. In this paper, we develop fast algorithms to find…

Discrete Mathematics · Computer Science 2017-06-15 Insu Han , Prabhanjan Kambadur , Kyoungsoo Park , Jinwoo Shin

Greedy algorithms have long been a workhorse for learning graphical models, and more broadly for learning statistical models with sparse structure. In the context of learning directed acyclic graphs, greedy algorithms are popular despite…

Machine Learning · Computer Science 2021-11-01 Goutham Rajendran , Bohdan Kivva , Ming Gao , Bryon Aragam

Optimal selection of a subset of items from a given set is a hard problem that requires combinatorial optimization. In this paper, we propose a subset selection algorithm that is trainable with gradient-based methods yet achieves…

Machine Learning · Computer Science 2018-10-31 Thomas Powers , Rasool Fakoor , Siamak Shakeri , Abhinav Sethy , Amanjit Kainth , Abdel-rahman Mohamed , Ruhi Sarikaya

Consider the puzzle: given a number, remove $k$ digits such that the resulting number is as large as possible. Various techniques were employed to derive a linear-time solution to the puzzle: predicate logic was used to justify the…

Programming Languages · Computer Science 2023-12-01 Richard Bird , Shin-Cheng Mu

Several recent deep neural networks experiments leverage the generalist-specialist paradigm for classification. However, no formal study compared the performance of different clustering algorithms for class assignment. In this paper we…

Machine Learning · Computer Science 2016-09-14 Sébastien Arnold

In this paper, we propose a unified framework and an algorithm for the problem of group recommendation where a fixed number of items or alternatives can be recommended to a group of users. The problem of group recommendation arises…

Information Retrieval · Computer Science 2017-12-27 Shameem A Puthiya Parambath , Nishant Vijayakumar , Sanjay Chawla

The task of outlier detection is to find small groups of data objects that are exceptional when compared with rest large amount of data. In [38], the problem of outlier detection in categorical data is defined as an optimization problem and…

Databases · Computer Science 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

We discuss the upper and lower estimates for the rate of convergence of Pure and Orthogonal Greedy Algorithms for dictionary with bounded cumulative coherence.

Numerical Analysis · Mathematics 2009-11-10 Eugene Livshitz

We consider interactive learning and covering problems, in a setting where actions may incur different costs, depending on the response to the action. We propose a natural greedy algorithm for response-dependent costs. We bound the…

Machine Learning · Computer Science 2018-11-21 Sivan Sabato

Students of Computer Science often wonder when, exactly, one can apply a greedy algorithm to a problem, and when one must use the more complicated and time-consuming techniques of dynamic programming. This paper argues that the existing…

Data Structures and Algorithms · Computer Science 2020-11-20 Eugene Callahan , Robert Murphy , Anas Elghafari