English
Related papers

Related papers: An Expectation-Maximization Algorithm for the Frac…

200 papers

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

Data Structures and Algorithms · Computer Science 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

Selecting the best regularization parameter in inverse problems is a classical and yet challenging problem. Recently, data-driven approaches have become popular to tackle this challenge. These approaches are appealing since they do require…

Statistics Theory · Mathematics 2025-10-22 Jonathan Chirinos Rodriguez , Ernesto De Vito , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

Not all approximations arise from information systems. The problem of fitting approximations, subjected to some rules (and related data), to information systems in a rough scheme of things is known as the \emph{inverse problem}. The inverse…

Logic · Mathematics 2017-04-19 A. Mani

We consider the problem of sampling from a posterior distribution arising in Bayesian inverse problems in science, engineering, and imaging. Our method belongs to the family of independence Metropolis-Hastings (IMH) sampling algorithms,…

Machine Learning · Computer Science 2026-05-19 Youguang Chen , George Biros

We introduce two data completion algorithms for the limited-aperture problems in inverse acoustic scattering. Both completion algorithms are independent of the topological and physical properties of the unknown scatterers. The main idea is…

Analysis of PDEs · Mathematics 2022-09-07 Fangfang Dou , Xiaodong Liu , Shixu Meng , Bo Zhang

Particle filters are a group of algorithms to solve inverse problems through statistical Bayesian methods when the model does not comply with the linear and Gaussian hypothesis. Particle filters are used in domains like data assimilation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Sebastian Friedemann , Kai Keller , Yen-Sen Lu , Bruno Raffin , Leonardo Bautista Gomez

Maximum Likelihood Estimation (MLE) is the bread and butter of system inference for stochastic systems. In some generality, MLE will converge to the correct model in the infinite data limit. In the context of physical approaches to system…

Machine Learning · Statistics 2020-03-11 Junghyo Jo , Danh-Tai Hoang , Vipul Periwal

Distributed estimation in the context of sensor networks is considered, where distributed agents are given a set of sensor measurements, and are tasked with estimating a target variable. A subset of sensors are assumed to be faulty. The…

Signal Processing · Electrical Eng. & Systems 2022-12-26 Marian Temprana Alonso , Farhad Shirani , S. Sitharama Iyengar

When attempting to recover functions from observational data, one naturally seeks to do so in an optimal manner with respect to some modeling assumption. With a focus put on the worst-case setting, this is the standard goal of Optimal…

Optimization and Control · Mathematics 2020-04-02 Mahmood Ettehad , Simon Foucart

We generalize the fractional packing framework of Garg and Koenemann to the case of linear fractional packing problems over polyhedral cones. More precisely, we provide approximation algorithms for problems of the form $\max\{c^T x : Ax…

Data Structures and Algorithms · Computer Science 2016-12-19 Michael Holzhauser , Sven O. Krumke

For multiparametric mixed-integer convex programming problems such as those encountered in hybrid model predictive control, we propose an algorithm for generating a feasible partition of a subset of the parameter space. The result is a…

Optimization and Control · Mathematics 2019-03-01 Danylo Malyuta , Behcet Acikmese , Martin Cacan , David S. Bayard

A spectrally sparse signal of order $r$ is a mixture of $r$ damped or undamped complex sinusoids. This paper investigates the problem of reconstructing spectrally sparse signals from a random subset of $n$ regular time domain samples, which…

Information Theory · Computer Science 2016-06-07 Jian-Feng Cai , Tianming Wang , Ke Wei

This paper focuses on scattered data fitting problems on spheres. We study the approximation performance of a class of weighted spectral filter algorithms, including Tikhonov regularization, Landaweber iteration, spectral cut-off, and…

Numerical Analysis · Mathematics 2024-10-24 Shao-Bo Lin

We study the Inexact Restoration framework with random models for minimizing functions whose evaluation is subject to errors. We propose a constrained formulation that includes well-known stochastic problems and an algorithm applicable when…

Optimization and Control · Mathematics 2026-02-24 Benedetta Morini , Simone Rebegoldi

To help understand the underlying mechanisms of neural networks (NNs), several groups have, in recent years, studied the number of linear regions $\ell$ of piecewise linear functions generated by deep neural networks (DNN). In particular,…

Machine Learning · Computer Science 2019-05-28 Nadav Dym , Barak Sober , Ingrid Daubechies

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi

In this paper we examine a number of models that generate random fractals. The models are studied using the tools of computational complexity theory from the perspective of parallel computation. Diffusion limited aggregation and several…

Condensed Matter · Physics 2009-10-28 J. Machta , R. Greenlaw

The choice of the parameter value for regularized inverse problems is critical to the results and remains a topic of interest. This article explores a criterion for selecting a good parameter value by maximizing the probability of the data,…

Numerical Analysis · Mathematics 2020-02-11 Toby Sanders , Rodrigo B. Platte , Robert D. Skeel

The main features of the statistical approach to inverse problems are described on the example of a linear model with additive noise. The approach does not use any Bayesian hypothesis regarding an unknown object; instead, the standard…

Methodology · Statistics 2017-05-05 V. Yu. Terebizh

A common network inference problem, arising from real-world data constraints, is how to infer a dynamic network from its time-aggregated adjacency matrix and time-varying marginals (i.e., row and column sums). Prior approaches to this…

Machine Learning · Statistics 2024-08-21 Serina Chang , Frederic Koehler , Zhaonan Qu , Jure Leskovec , Johan Ugander