English
Related papers

Related papers: A parallel sampling algorithm for inverse problems…

200 papers

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

Ill-posed inverse problems are ubiquitous in applications. Under- standing of algorithms for their solution has been greatly enhanced by a deep understanding of the linear inverse problem. In the applied communities ensemble-based filtering…

Statistics Theory · Mathematics 2015-12-08 Marco A. Iglesias , Kui Lin , Shuai Lu , Andrew M. Stuart

A determinantal point process (DPP) on a collection of $M$ items is a model, parameterized by a symmetric kernel matrix, that assigns a probability to every subset of those items. Recent work shows that removing the kernel symmetry…

Machine Learning · Computer Science 2022-04-21 Insu Han , Mike Gartrell , Jennifer Gillenwater , Elvis Dohmatob , Amin Karbasi

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

Nonnegative (linear) least square problems are a fundamental class of problems that is well-studied in statistical learning and for which solvers have been implemented in many of the standard programming languages used within the machine…

Optimization and Control · Mathematics 2022-03-09 Jelena Diakonikolas , Chenghui Li , Swati Padmanabhan , Chaobing Song

All inverse problems rely on data to recover unknown parameters, yet not all data are equally informative. This raises the central question of data selection. A distinctive challenge in PDE-based inverse problems is their inherently…

Numerical Analysis · Mathematics 2026-01-16 Kathrin Hellmuth , Ruhui Jin , Qin Li , Stephen J. Wright

This article considers a linear model in a high dimensional data scenario. We propose a process which uses multiple loss functions both to select relevant predictors and to estimate parameters, and study its asymptotic properties. Variable…

Methodology · Statistics 2020-07-01 Guorong Dai , Ursula U. Müller

Probabilistic forecasting of multivariate time series is essential for various downstream tasks. Most existing approaches rely on the sequences being uniformly spaced and aligned across all variables. However, real-world multivariate time…

Machine Learning · Computer Science 2025-02-18 Yijun Li , Cheuk Hang Leung , Qi Wu

Correlation clustering is a central topic in unsupervised learning, with many applications in ML and data mining. In correlation clustering, one receives as input a signed graph and the goal is to partition it to minimize the number of…

Data Structures and Algorithms · Computer Science 2021-06-17 Vincent Cohen-Addad , Silvio Lattanzi , Slobodan Mitrović , Ashkan Norouzi-Fard , Nikos Parotsidis , Jakub Tarnawski

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

Machine Learning · Statistics 2024-05-28 Sharmila Karumuri , Ilias Bilionis

The montecarlo method, which is quite commonly used to solve maximum entropy problems in statistical physics, can actually be used to solve inverse problems in a much wider context. The probability distribution which maximizes entropy can…

Statistical Mechanics · Physics 2007-05-23 Jan Naudts

Extracting information from nonlinear measurements is a fundamental challenge in data analysis. In this work, we consider separable inverse problems, where the data are modeled as a linear combination of functions that depend nonlinearly on…

Signal Processing · Electrical Eng. & Systems 2020-07-07 Brett Bernstein , Sheng Liu , Chrysa Papadaniil , Carlos Fernandez-Granda

In "Unlabeled Sensing", one observes a set of linear measurements of an underlying signal with incomplete or missing information about their ordering, which can be modeled in terms of an unknown permutation. Previous work on the case of a…

Information Theory · Computer Science 2020-07-14 Hang Zhang , Martin Slawski , Ping Li

In the first part of this work, we develop a novel scheme for solving nonparametric regression problems. That is the approximation of possibly low regular and noised functions from the knowledge of their approximate values given at some…

Statistics Theory · Mathematics 2021-10-27 Asma Ben Saber , Abderrazek Karoui

Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients…

Machine Learning · Statistics 2017-12-29 Clément Elvira , Pierre Chainais , Nicolas Dobigeon

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

Computation · Statistics 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

Filtering and parameter estimation under partial information for multiscale problems is studied in this paper. After proving mean square convergence of the nonlinear filter to a filter of reduced dimension, we establish that the conditional…

Probability · Mathematics 2014-09-09 Andrew Papanicolaou , Konstantinos Spiliopoulos

Markov Chain Monte Carlo (MCMC) sampling from a posterior distribution corresponding to a massive data set can be computationally prohibitive since producing one sample requires a number of operations that is linear in the data size. In…

Machine Learning · Statistics 2017-07-03 Reihaneh Entezari , Radu V. Craiu , Jeffrey S. Rosenthal

A generic algorithm for the extraction of probabilistic (Bayesian) information about model parameters from data is presented. The algorithm propagates an ensemble of particles in the product space of model parameters and outputs. Each…

Computation · Statistics 2015-09-18 Carlo Albert

We study the problem of distributed adaptive estimation over networks where nodes cooperate to estimate physical parameters that can vary over both space and time domains. We use a set of basis functions to characterize the space-varying…

Systems and Control · Computer Science 2015-07-22 Reza Abdolee , Benoit Champagne , Ali H. Sayed