English
Related papers

Related papers: Manifold Sampling via Entropy Maximization

200 papers

The purpose of this note is to show how the method of maximum entropy in the mean (MEM) may be used to improve parametric estimation when the measurements are corrupted by large level of noise. The method is developed in the context on a…

Machine Learning · Computer Science 2021-08-23 Henryk Gzyl , Enrique ter Horst

Consider the task of sampling and reconstructing a bandlimited spatial field in $\Re^2$ using moving sensors that take measurements along their path. It is inexpensive to increase the sampling rate along the paths of the sensors but more…

Information Theory · Computer Science 2012-11-02 Jayakrishnan Unnikrishnan , Martin Vetterli

We introduce MESSY estimation, a Maximum-Entropy based Stochastic and Symbolic densitY estimation method. The proposed approach recovers probability density functions symbolically from samples using moments of a Gradient flow in which the…

Machine Learning · Computer Science 2024-02-13 Tony Tohme , Mohsen Sadr , Kamal Youcef-Toumi , Nicolas G. Hadjiconstantinou

Data-driven optimization of sampling patterns in MRI has recently received a significant attention.Following recent observations on the combinatorial number of minimizers in off-the-grid optimization, we propose a framework to globally…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Alban Gossard , Frédéric de Gournay , Pierre Weiss

Spectral compressed sensing involves reconstructing a spectral-sparse signal from a subset of uniformly spaced samples, with applications in radar imaging and wireless channel estimation. By fully exploiting the signal structures, this…

Optimization and Control · Mathematics 2025-11-25 Wenlong Wang , Wen Huang , Zai Yang

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the…

Accelerator Physics · Physics 2025-08-18 Austin Hoover

Minimum-entropy coupling (MEC) -- the process of finding a joint distribution with minimum entropy for given marginals -- has applications in areas such as causality and steganography. However, existing algorithms are either computationally…

Information Theory · Computer Science 2024-05-31 Samuel Sokota , Dylan Sam , Christian Schroeder de Witt , Spencer Compton , Jakob Foerster , J. Zico Kolter

The maximum-entropy sampling problem is a fundamental and challenging combinatorial-optimization problem, with application in spatial statistics. It asks to find a maximum-determinant order-$s$ principal submatrix of an order-$n$ covariance…

Optimization and Control · Mathematics 2020-02-03 Zhongzhu Chen , Marcia Fampa , Amélie Lambert , Jon Lee

Wavelet functions allow the sparse and efficient representation of a signal at different scales. Recently the application of wavelets to the denoising of maps of cosmic microwave background (CMB) fluctuations has been proposed. The…

Astrophysics · Physics 2009-11-07 Klaus Maisinger , M. P. Hobson , A. N. Lasenby

Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without…

Methodology · Statistics 2018-09-25 Leo L Duan , Alexander L Young , Akihiko Nishimura , David B Dunson

The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, the standard form of the MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited…

Statistical Mechanics · Physics 2022-03-30 Pablo A. Morales , Fernando E. Rosas

Statistical model checking avoids the exponential growth of states associated with probabilistic model checking by estimating properties from multiple executions of a system and by giving results within confidence bounds. Rare properties…

Performance · Computer Science 2012-01-26 Cyrille Jégourel , Axel Legay , Sean Sedwards

This letter considers optimizing user association in a heterogeneous network via utility maximization, which is a combinatorial optimization problem due to integer constraints. Different from existing solutions based on convex optimization,…

Information Theory · Computer Science 2018-06-12 Xietian Huang , Wei Xu , Guo Xie , Shi Jin , Xiaohu You

Survey sampling plays an important role in the efficient allocation and management of resources. The essence of survey sampling lies in acquiring a sample of data points from a population and subsequently using this sample to estimate the…

Methodology · Statistics 2024-01-29 Jonne Pohjankukka , Sakari Tuominen , Jukka Heikkonen

Compressive sampling has become a widely used approach to construct polynomial chaos surrogates when the number of available simulation samples is limited. Originally, these expensive simulation samples would be obtained at random locations…

Computation · Statistics 2018-07-04 Negin Alemazkoor , Hadi Meidani

Bayesian inference in deep neural networks is challenging due to the high-dimensional, strongly multi-modal parameter posterior density landscape. Markov chain Monte Carlo approaches asymptotically recover the true posterior but are…

In this paper, we tackle the resolution of chance-constrained problems reformulated via Sample Average Approximation. The resulting data-driven deterministic reformulation takes the form of a large-scale mixed-integer program cursed with…

Optimization and Control · Mathematics 2023-06-27 Álvaro Porras , Concepción Domínguez , Juan M. Morales , Salvador Pineda

We study the problem of probability distribution matching and sampling on near-term quantum computers, aiming to construct parameterized circuits that generate samples from a target distribution while minimizing resource overhead. This task…

Quantum Physics · Physics 2026-05-26 Nicholas S. DiBrita , Jason Han , Krishna Bhatia , Younghyun Cho , Hengrui Luo , Tirthak Patel

Efficient sampling from constraint manifolds, and thereby generating a diverse set of solutions for feasibility problems, is a fundamental challenge. We consider the case where a problem is factored, that is, the underlying nonlinear…

Robotics · Computer Science 2021-03-30 Joaquim Ortiz-Haro , Valentin N. Hartmann , Ozgur S. Oguz , Marc Toussaint

Many machine learning applications require operating on a spatially distributed dataset. Despite technological advances, privacy considerations and communication constraints may prevent gathering the entire dataset in a central unit. In…

Machine Learning · Statistics 2024-01-30 Alexandros E. Tzikas , Licio Romao , Mert Pilanci , Alessandro Abate , Mykel J. Kochenderfer
‹ Prev 1 3 4 5 6 7 10 Next ›