English
Related papers

Related papers: Effect of Objective Function on Data-Driven Greedy…

200 papers

We consider goal-oriented optimal design of experiments for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we seek sensor placements that minimize the posterior…

Numerical Analysis · Mathematics 2024-11-13 J. Nicholas Neuberger , Alen Alexanderian , Bart van Bloemen Waanders

The realisation of sensing modalities based on the principles of compressed sensing is often hindered by discrepancies between the mathematical model of its sensing operator, which is necessary during signal recovery, and its actual…

Information Theory · Computer Science 2018-02-21 Valerio Cambareri , Amirafshar Moshtaghpour , Laurent Jacques

Compressive sensing relies on the sparse prior imposed on the signal of interest to solve the ill-posed recovery problem in an under-determined linear system. The objective function used to enforce the sparse prior information should be…

Information Theory · Computer Science 2020-02-25 Shuai Huang , Trac D. Tran

To provide a novel tool for the investigation of the energy landscape of the Edwards-Anderson spin-glass model we introduce an algorithm that allows an efficient execution of a greedy optimization based on data from a previously performed…

Disordered Systems and Neural Networks · Physics 2023-12-01 Stefan Schnabel , Wolfhard Janke

Greedy algorithms for minimizing L0-norm of sparse decomposition have profound application impact on many signal processing problems. In the sparse coding setup, given the observations $\mathrm{y}$ and the redundant dictionary…

Numerical Analysis · Computer Science 2015-02-13 Yuanyi Xue , Yao Wang

We study the problem of distributed state estimation in a network of sensing units that can exchange their measurements but the rate of communication between the units is constrained. The units collect noisy, possibly only partial…

Signal Processing · Electrical Eng. & Systems 2018-07-23 Abolfazl Hashemi , Osman Fatih Kilic , Haris Vikalo

We study the fundamental problem of selecting optimal features for model construction. This problem is computationally challenging on large datasets, even with the use of greedy algorithm variants. To address this challenge, we extend the…

Motivated by modern applications such as computerized adaptive testing, sequential rank aggregation, and heterogeneous data source selection, we study the problem of active sequential estimation, which involves adaptively selecting…

Statistics Theory · Mathematics 2024-02-14 Xiaoou Li , Hongru Zhao

We study optimal sensor placement for Bayesian state estimation problems in which sensors vary in cost and fidelity, resulting in a budget-constrained multifidelity optimal experimental design problem. Sensor placement optimality is…

Numerical Analysis · Mathematics 2026-02-10 Gabriela Ramon , Geena Sarnoski , Vasishta Tumuluri , Hugo Díaz , Arvind K. Saibaba

We consider infinite-dimensional linear Gaussian Bayesian inverse problems with uncorrelated sensor data, and focus on the problem of finding sensor placements that maximize the expected information gain (EIG). This study is motivated by…

Optimization and Control · Mathematics 2026-02-11 Alen Alexanderian , Steven Maio

A $k$-submodular function is a generalization of the submodular set function. Many practical applications can be modeled as maximizing a $k$-submodular function, such as multi-cooperative games, sensor placement with $k$ type sensors,…

Combinatorics · Mathematics 2023-12-13 Hongyang Zhang , Wenchang Luo

The greedy algorithm for monotone submodular function maximization subject to cardinality constraint is guaranteed to approximate the optimal solution to within a $1-1/e$ factor. Although it is well known that this guarantee is essentially…

Data Structures and Algorithms · Computer Science 2022-02-15 Aviad Rubinstein , Junyao Zhao

Greedy optimization methods such as Matching Pursuit (MP) and Frank-Wolfe (FW) algorithms regained popularity in recent years due to their simplicity, effectiveness and theoretical guarantees. MP and FW address optimization over the linear…

Machine Learning · Computer Science 2017-11-21 Francesco Locatello , Michael Tschannen , Gunnar Rätsch , Martin Jaggi

This paper defines weak-$\alpha$-supermodularity for set functions. Many optimization objectives in machine learning and data mining seek to minimize such functions under cardinality constrains. We prove that such problems benefit from a…

Data Structures and Algorithms · Computer Science 2015-02-24 Christos Boutsidis , Edo Liberty , Maxim Sviridenko

Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test…

Optimization and Control · Mathematics 2021-11-22 Md Saiful Islam , Md Sarowar Morshed , Md. Noor-E-Alam

The purpose of this article is to examine the greedy adaptive measurement policy in the context of a linear Guassian measurement model with an optimization criterion based on information gain. In the special case of sequential scalar…

Information Theory · Computer Science 2012-08-20 Entao Liu , Edwin K. P. Chong , Louis L. Scharf

We consider parametrized linear-quadratic optimal control problems and provide their online-efficient solutions by combining greedy reduced basis methods and machine learning algorithms. To this end, we first extend the greedy control…

Optimization and Control · Mathematics 2023-07-31 Hendrik Kleikamp , Martin Lazar , Cesare Molinari

In this paper, we propose a new framework for designing fast parallel algorithms for fundamental statistical subset selection tasks that include feature selection and experimental design. Such tasks are known to be weakly submodular and are…

Machine Learning · Computer Science 2021-04-02 Sharon Qian , Yaron Singer

A deterministic approximation algorithm is presented for the maximization of non-monotone submodular functions over a ground set of size $n$ subject to cardinality constraint $k$; the algorithm is based upon the idea of interlacing two…

Data Structures and Algorithms · Computer Science 2019-10-28 Alan Kuhnle

We address the problem of optimal experimental design (OED) for Bayesian nonlinear inverse problems governed by PDEs. The goal is to find a placement of sensors, at which experimental data are collected, so as to minimize the uncertainty in…

Optimization and Control · Mathematics 2015-11-04 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas