English
Related papers

Related papers: Greedy algorithms for prediction

200 papers

We address the problem of efficient and unobstructed surveillance or communication in complex environments. On one hand, one wishes to use a minimal number of sensors to cover the environment. On the other hand, it is often important to…

Machine Learning · Computer Science 2023-09-18 Lukas Taus , Yen-Hsi Richard Tsai

The approximation of a discrete probability distribution $\mathbf{t}$ by an $M$-type distribution $\mathbf{p}$ is considered. The approximation error is measured by the informational divergence $\mathbb{D}(\mathbf{t}\Vert\mathbf{p})$, which…

Information Theory · Computer Science 2016-07-28 Bernhard C. Geiger , Georg Böcherer

We present a novel stagewise strategy for improving greedy algorithms for sparse recovery. We demonstrate its efficiency both for synthesis and analysis sparse priors, where in both cases we demonstrate its computational efficiency and…

Numerical Analysis · Mathematics 2020-12-02 Guy Leibovitz , Raja Giryes

We investigate at decision trees that incorporate both traditional queries based on one attribute and queries based on hypotheses about the values of all attributes. Such decision trees are similar to ones studied in exact learning, where…

Computational Complexity · Computer Science 2022-03-18 Mohammad Azad , Igor Chikalov , Shahid Hussain , Mikhail Moshkov , Beata Zielosko

Motivated by sequential budgeted allocation problems, we investigate online matching problems where connections between vertices are not i.i.d., but they have fixed degree distributions -- the so-called configuration model. We estimate the…

Data Structures and Algorithms · Computer Science 2021-07-05 Nathan Noiry , Flore Sentenac , Vianney Perchet

We study adaptive greedy algorithms for the problems of stochastic set cover with perfect and imperfect coverages. In stochastic set cover with perfect coverage, we are given a set of items and a ground set B. Evaluating an item reveals its…

Data Structures and Algorithms · Computer Science 2018-06-19 Srinivasan Parthasarathy

The reliable fraction of information is an attractive score for quantifying (functional) dependencies in high-dimensional data. In this paper, we systematically explore the algorithmic implications of using this measure for optimization. We…

Artificial Intelligence · Computer Science 2018-09-17 Panagiotis Mandros , Mario Boley , Jilles Vreeken

The Column Subset Selection Problem provides a natural framework for unsupervised feature selection. Despite being a hard combinatorial optimization problem, there exist efficient algorithms that provide good approximations. The drawback of…

Machine Learning · Computer Science 2018-04-13 Bruno Ordozgoiti , Alberto Mozo , Jesús García López de Lacalle

The priority model was introduced to capture "greedy-like" algorithms. Motivated by the success of advice complexity in the area of online algorithms, the fixed priority model was extended to include advice, and a reduction-based framework…

Data Structures and Algorithms · Computer Science 2022-01-27 Joan Boyar , Kim S. Larsen , Denis Pankratov

We consider the problem of studying the performance of greedy algorithm on sensor selection problem for stable linear systems with Kalman Filter. Specifically, the objective is to find the system parameters that affects the performance of…

Data Structures and Algorithms · Computer Science 2017-07-10 Jingyuan Liu

A greedy algorithm is proposed for sparse-sensor selection in reduced-order sensing that contains correlated noise in measurement. The sensor selection is carried out by maximizing the determinant of the Fisher information matrix in a…

Optimization and Control · Mathematics 2021-04-28 Keigo Yamada , Yuji Saito , Koki Nankai , Taku Nonomura , Keisuke Asai , Daisuke Tsubakino

In this paper, we consider a subset selection problem in a spatial field where we seek to find a set of k locations whose observations provide the best estimate of the field value at a finite set of prediction locations. The measurements…

Optimization and Control · Mathematics 2022-04-12 Shamak Dutta , Nils Wilde , Stephen L. Smith

This paper studies the estimation of the conditional density f (x, $\times$) of Y i given X i = x, from the observation of an i.i.d. sample (X i , Y i) $\in$ R d , i = 1,. .. , n. We assume that f depends only on r unknown components with…

Statistics Theory · Mathematics 2021-06-29 Minh-Lien Jeanne Nguyen , Claire Lacour , Vincent Rivoirard

The realisation of sensing modalities based on the principles of compressed sensing is often hindered by discrepancies between the mathematical model of its sensing operator, which is necessary during signal recovery, and its actual…

Information Theory · Computer Science 2018-02-21 Valerio Cambareri , Amirafshar Moshtaghpour , Laurent Jacques

Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test…

Optimization and Control · Mathematics 2021-11-22 Md Saiful Islam , Md Sarowar Morshed , Md. Noor-E-Alam

We provide new approximation guarantees for greedy low rank matrix estimation under standard assumptions of restricted strong convexity and smoothness. Our novel analysis also uncovers previously unknown connections between the low rank…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban

We study the problem of scheduling sensors in a resource-constrained linear dynamical system, where the objective is to select a small subset of sensors from a large network to perform the state estimation task. We formulate this problem as…

Systems and Control · Computer Science 2018-04-05 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

Identifying breakpoints in piecewise regression is critical in enhancing the reliability and interpretability of data fitting. In this paper, we propose novel algorithms based on the greedy algorithm to accurately and efficiently identify…

Machine Learning · Statistics 2026-04-14 Taehyeong Kim , Hyungu Lee , Myungjin Kim , Hayoung Choi

A basic combinatorial online resource allocation problem is considered, where multiple servers have individual capacity constraints, and at each time slot, a set of jobs arrives, that have potentially different weights to different servers.…

Data Structures and Algorithms · Computer Science 2015-12-02 Ajil Jalal , Rahul Vaze , Umang Bhaskar

Motivated by modern applications such as computerized adaptive testing, sequential rank aggregation, and heterogeneous data source selection, we study the problem of active sequential estimation, which involves adaptively selecting…

Statistics Theory · Mathematics 2024-02-14 Xiaoou Li , Hongru Zhao