English
Related papers

Related papers: A global optimum-informed greedy algorithm for A-o…

200 papers

The random greedy algorithm for finding a maximal independent set in a graph constructs a maximal independent set by inspecting the graph's vertices in a random order, adding the current vertex to the independent set if it is not adjacent…

Combinatorics · Mathematics 2023-09-28 Michael Krivelevich , Tamás Mészáros , Peleg Michaeli , Clara Shikhelman

Learning of low-rank matrices is fundamental to many machine learning applications. A state-of-the-art algorithm is the rank-one matrix pursuit (R1MP). However, it can only be used in matrix completion problems with the square loss. In this…

Machine Learning · Computer Science 2016-07-28 Quanming Yao , James T. Kwok

A $k$-submodular function is a generalization of the submodular set function. Many practical applications can be modeled as maximizing a $k$-submodular function, such as multi-cooperative games, sensor placement with $k$ type sensors,…

Combinatorics · Mathematics 2023-12-13 Hongyang Zhang , Wenchang Luo

With the rising importance of large-scale network control, the problem of actuator placement has received increasing attention. Our goal in this paper is to find a set of actuators minimizing the metric that measures the average energy…

Optimization and Control · Mathematics 2021-07-14 Baiwei Guo , Orcun Karaca , Tyler Summers , Maryam Kamgarpour

We study the fundamental problem of selecting optimal features for model construction. This problem is computationally challenging on large datasets, even with the use of greedy algorithm variants. To address this challenge, we extend the…

Sparse approximation is important in many applications because of concise form of an approximant and good accuracy guarantees. The theory of compressed sensing, which proved to be very useful in the image processing and data sciences, is…

Numerical Analysis · Mathematics 2025-02-20 V. Temlyakov

The paper gives a systematic study of the approximate versions of three greedy-type algorithms that are widely used in convex optimization. By approximate version we mean the one where some of evaluations are made with an error. Importance…

Machine Learning · Statistics 2014-12-11 Vladimir Temlyakov

Sparse signal recovery deals with finding the sparsest solution of an under-determined linear system $\vx = \mQ\vs$. In this paper, we propose a novel greedy approach to addressing the challenges from such a problem. Such an approach is…

Information Theory · Computer Science 2026-04-09 Gang Li , Qiuwei Li , Shuang Li , Wu Angela Li

The concept of jump system, introduced by Bouchet and Cunningham (1995), is a set of integer points satisfying a certain exchange property. We consider the minimization of a separable convex function on a jump system. It is known that the…

Optimization and Control · Mathematics 2022-06-22 Norito Minamikawa

The present study proposes a sensor selection method based on the proximal splitting algorithm and the A-optimal design of experiment using the alternating direction method of multipliers (ADMM) algorithm. The performance of the proposed…

Systems and Control · Electrical Eng. & Systems 2021-07-13 Takayuki Nagata , Taku Nonomura , Kumi Nakai , Keigo Yamada , Yuji Saito , Shunsuke Ono

We present convergence estimates of two types of greedy algorithms in terms of the metric entropy of underlying compact sets. In the first part, we measure the error of a standard greedy reduced basis method for parametric PDEs by the…

Numerical Analysis · Mathematics 2024-10-29 Yuwen Li , Jonathan Siegel

Motivated by, e.g., sensitivity analysis and end-to-end learning, the demand for differentiable optimization algorithms has been significantly increasing. In this paper, we establish a theoretically guaranteed versatile framework that makes…

Data Structures and Algorithms · Computer Science 2020-06-15 Shinsaku Sakaue

In dictionary selection, several atoms are selected from finite candidates that successfully approximate given data points in the sparse representation. We propose a novel efficient greedy algorithm for dictionary selection. Not only does…

Machine Learning · Computer Science 2018-09-10 Kaito Fujii , Tasuku Soma

The approximation of a discrete probability distribution $\mathbf{t}$ by an $M$-type distribution $\mathbf{p}$ is considered. The approximation error is measured by the informational divergence $\mathbb{D}(\mathbf{t}\Vert\mathbf{p})$, which…

Information Theory · Computer Science 2016-07-28 Bernhard C. Geiger , Georg Böcherer

In computational inverse problems, the optimal experimental design (OED) problem seeks the best locations in time and space at which to take measurements. We investigate the nonlinear OED problem in the context of continuously-indexed…

Numerical Analysis · Mathematics 2025-06-10 Ruhui Jin , Qin Li , Stephen O. Mussmann , Stephen J. Wright

We demonstrate that the greedy algorithm for reduction of divisors on metric graphs need not terminate by modeling the Euclidean algorithm in this context. We observe that any infinite reduction has a well defined limit allowing us to treat…

Combinatorics · Mathematics 2015-04-17 Spencer Backman

We study online fair allocation of $T$ sequentially arriving items among $n$ agents with heterogeneous preferences, with the objective of maximizing generalized-mean welfare, defined as the $p$-mean of agents' time-averaged utilities, with…

Computer Science and Game Theory · Computer Science 2026-02-12 Zongjun Yang , Rachitesh Kumar , Christian Kroer

Optimal experimental design (OED) provides a systematic approach to quantify and maximize the value of experimental data. Under a Bayesian approach, conventional OED maximizes the expected information gain (EIG) on model parameters.…

Computation · Statistics 2026-04-08 Shijie Zhong , Wanggang Shen , Tommie Catanach , Xun Huan

In today's clinical practice, magnetic resonance imaging (MRI) is routinely accelerated through subsampling of the associated Fourier domain. Currently, the construction of these subsampling strategies - known as experimental design -…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Tim Bakker , Herke van Hoof , Max Welling

Subset selection is a popular topic in recent years and a number of subset selection methods have been proposed. Among those methods, hypervolume subset selection is widely used. Greedy hypervolume subset selection algorithms can achieve…

Neural and Evolutionary Computing · Computer Science 2020-07-07 Weiyu Chen , Hisao Ishibuhci , Ke Shang