English
Related papers

Related papers: A global optimum-informed greedy algorithm for A-o…

200 papers

We propose a novel greedy algorithm for the support recovery of a sparse signal from a small number of noisy measurements. In the proposed method, a new support index is identified for each iteration based on bit-wise maximum a posteriori…

Information Theory · Computer Science 2019-10-29 J. Chae , S. -N. Hong

Models based on recursive adaptive partitioning such as decision trees and their ensembles are popular for high-dimensional regression as they can potentially avoid the curse of dimensionality. Because empirical risk minimization (ERM) is…

Machine Learning · Statistics 2025-09-11 Yan Shuo Tan , Jason M. Klusowski , Krishnakumar Balasubramanian

It was recently shown that a version of the greedy algorithm gives a construction of fault-tolerant spanners that is size-optimal, at least for vertex faults. However, the algorithm to construct this spanner is not polynomial-time, and the…

Data Structures and Algorithms · Computer Science 2020-05-26 Michael Dinitz , Caleb Robelle

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

A vector-measurement-sensor problem for the least squares estimation is considered, by extending a previous novel approach in this paper. An extension of the vector-measurement-sensor selection of the greedy algorithm is proposed and is…

Signal Processing · Electrical Eng. & Systems 2020-07-01 Yuji Saito , Taku Nonomura , Koki Nankai , Keigo Yamada , Keisuke Asai , Yasuo Sasaki , Daisuke Tsubakino

Optimal design of experiments for Bayesian inverse problems has recently gained wide popularity and attracted much attention, especially in the computational science and Bayesian inversion communities. An optimal design maximizes a…

Optimization and Control · Mathematics 2023-05-09 Ahmed Attia , Sven Leyffer , Todd Munson

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

The realisation of sensing modalities based on the principles of compressed sensing is often hindered by discrepancies between the mathematical model of its sensing operator, which is necessary during signal recovery, and its actual…

Information Theory · Computer Science 2018-02-21 Valerio Cambareri , Amirafshar Moshtaghpour , Laurent Jacques

We consider optimal experimental design (OED) for Bayesian inverse problems, where the experimental design variables have a certain multiway structure. Given $d$ different experimental variables with $m_i$ choices per design variable $1 \le…

Numerical Analysis · Mathematics 2025-06-03 Hugo Díaz , Arvind K. Saibaba , Srinivas Eswar , Vishwas Rao , Zichao Wendy Di

We consider infinite-dimensional linear Gaussian Bayesian inverse problems with uncorrelated sensor data, and focus on the problem of finding sensor placements that maximize the expected information gain (EIG). This study is motivated by…

Optimization and Control · Mathematics 2026-02-11 Alen Alexanderian , Steven Maio

We consider the *adaptive influence maximization problem*: given a network and a budget $k$, iteratively select $k$ seeds in the network to maximize the expected number of adopters. In the *full-adoption feedback model*, after selecting…

Social and Information Networks · Computer Science 2022-06-15 Wei Chen , Binghui Peng , Grant Schoenebeck , Biaoshuai Tao

We propose a control-oriented optimal experimental design (cOED) approach for linear PDE-constrained Bayesian inverse problems. In particular, we consider optimal control problems with uncertain parameters that need to be estimated by…

Optimization and Control · Mathematics 2025-09-01 Madhusudan Madhavan , Alen Alexanderian , Arvind K. Saibaba , Bart van Bloemen Waanders , Rebekah D. White

Conventional Bayesian optimal experimental design seeks to maximize the expected information gain (EIG) on model parameters. However, the end goal of the experiment often is not to learn the model parameters, but to predict downstream…

Computation · Statistics 2024-08-20 Atlanta Chakraborty , Xun Huan , Tommie Catanach

We study the problem of selecting most informative subset of a large observation set to enable accurate estimation of unknown parameters. This problem arises in a variety of settings in machine learning and signal processing including…

Signal Processing · Electrical Eng. & Systems 2019-05-27 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

In this article, we discuss a novel greedy algorithm for the recovery of compressive sampled signals under noisy conditions. Most of the greedy recovery algorithms proposed in the literature require sparsity of the signal to be known or…

Information Theory · Computer Science 2014-12-18 V. Meena , G. Abhilash

Given a set of $n$ vectors in $\mathbb{R}^d$, the goal of the \emph{determinant maximization} problem is to pick $k$ vectors with the maximum volume. Determinant maximization is the MAP-inference task for determinantal point processes (DPP)…

Data Structures and Algorithms · Computer Science 2023-09-28 Siddharth Gollapudi , Sepideh Mahabadi , Varun Sivashankar

Bayesian optimal experimental design (OED) seeks to conduct the most informative experiment under budget constraints to update the prior knowledge of a system to its posterior from the experimental data in a Bayesian framework. Such…

Machine Learning · Computer Science 2024-02-29 Rafael Orozco , Felix J. Herrmann , Peng Chen

We analyze the orthogonal greedy algorithm when applied to dictionaries $\mathbb{D}$ whose convex hull has small entropy. We show that if the metric entropy of the convex hull of $\mathbb{D}$ decays at a rate of $O(n^{-\frac{1}{2}-\alpha})$…

Statistics Theory · Mathematics 2022-01-25 Jonathan W. Siegel , Jinchao Xu

Active learning is increasingly adopted for expensive multi-objective combinatorial optimization problems, but it involves a challenging subset selection problem, optimizing the batch acquisition score that quantifies the goodness of a…

Machine Learning · Computer Science 2024-06-24 Deokjae Lee , Hyun Oh Song , Kyunghyun Cho

We consider infinite-dimensional Bayesian linear inverse problems governed by time-dependent partial differential equations (PDEs) and develop a mathematical and computational framework for optimal design of mobile sensor paths in this…

Optimization and Control · Mathematics 2026-01-22 J. Nicholas Neuberger , Alen Alexanderian , Bart van Bloemen Waanders , Ahmed Attia