English
Related papers

Related papers: Projection Pursuit through $\Phi$-Divergence Minim…

200 papers

Recently, there has been a large amount of work towards fooling deep-learning-based classifiers, particularly for images, via adversarial inputs that are visually similar to the benign examples. However, researchers usually use Lp-norm…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Pengrui Quan , Ruiming Guo , Mani Srivastava

We propose a method for sampling from Gibbs distributions of the form $\pi(x)\propto\exp(-U(x))$ by considering a family $(\pi^{t})_t$ of approximations of the target density which is such that $\pi^{t}$ exhibits favorable properties for…

Optimization and Control · Mathematics 2025-10-10 Andreas Habring , Alexander Falk , Martin Zach , Thomas Pock

Bayesian methods are appealing in their flexibility in modeling complex data and ability in capturing uncertainty in parameters. However, when Bayes' rule does not result in tractable closed-form, most approximate inference algorithms lack…

Machine Learning · Computer Science 2016-05-09 Bo Dai , Niao He , Hanjun Dai , Le Song

Motivated by the orthogonal series density estimation in $L^2([0,1],\mu)$, in this project we consider a new class of functions that we call the approximate sparsity class. This new class is characterized by the rate of decay of the…

Econometrics · Economics 2025-08-14 Lucas Z. Zhang

Associating distinct groups of objects (clusters) with contiguous regions of high probability density (high-density clusters), is central to many statistical and machine learning approaches to the classification of unlabelled data. We…

Machine Learning · Statistics 2016-09-29 Nicos G. Pavlidis , David P. Hofmeyr , Sotiris K. Tasoulis

Many recent works have shown that adversarial examples that fool classifiers can be found by minimally perturbing a normal input. Recent theoretical results, starting with Gilmer et al. (2018b), show that if the inputs are drawn from a…

Machine Learning · Computer Science 2019-10-29 Saeed Mahloujifar , Xiao Zhang , Mohammad Mahmoody , David Evans

In this paper we investigate the problem of recovering the source term in an elliptic system from a measurement of the state on a part of the boundary. For the particular interest in reconstructing probably discontinuous sources, we use the…

Numerical Analysis · Mathematics 2020-01-08 Michael Hinze , Tran Nhan Tam Quyen

We develop a maximum relative entropy formalism to generate optimal approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a…

Statistical Mechanics · Physics 2008-10-17 Chih-Yuan Tseng , Ariel Caticha

Effective non-parametric density estimation is a key challenge in high-dimensional multivariate data analysis. In this paper,we propose a novel approach that builds upon tensor factorization tools. Any multivariate density can be…

Machine Learning · Statistics 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

We propose a scalable track-before-detect (TBD) tracking method based on a Poisson/multi-Bernoulli model. To limit computational complexity, we approximate the exact multi-Bernoulli mixture posterior probability density function (pdf) by a…

Signal Processing · Electrical Eng. & Systems 2021-09-06 Thomas Kropfreiter , Jason L. Williams , Florian Meyer

We propose a novel particle filter for convolutional-correlation visual trackers. Our method uses correlation response maps to estimate likelihood distributions and employs these likelihoods as proposal densities to sample particles.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Reza Jalil Mozhdehi , Henry Medeiros

Approximation theory is concerned with the ability to approximate functions by simpler and more easily calculated functions. The first question we ask in approximation theory concerns the {\it possibility of approximation}. Is the given…

Classical Analysis and ODEs · Mathematics 2007-05-23 Allan Pinkus

We introduce a lightweight, flexible and end-to-end trainable probability density model parameterized by a constrained Fourier basis. We assess its performance at approximating a range of multi-modal 1D densities, which are generally…

Machine Learning · Computer Science 2024-02-26 Alfredo De la Fuente , Saurabh Singh , Johannes Ballé

Entropy measures of probability distributions are widely used measures in ecology, biology, genetics, and in other fields, to quantify species diversity of a community. Unfortunately, entropy-based diversity indices, or diversity indices…

Populations and Evolution · Quantitative Biology 2014-08-14 Karim T. Abou-Moustafa

We study the approximability of instances of the minimum entropy set cover problem, parameterized by the average frequency of a random element in the covering sets. We analyze an algorithm combining a greedy approach with another one biased…

Data Structures and Algorithms · Computer Science 2012-08-01 Cosmin Bonchis , Gabriel Istrate

Density-based mode-seeking methods generate a \emph{density-ascending dependency} from low-density points towards higher-density neighbors. Current mode-seeking methods identify modes by breaking some dependency connections, but relying…

Machine Learning · Computer Science 2026-01-13 Haowen Ma , Zhiguo Long , Hua Meng

Density estimation is a fundamental technique employed in various fields to model and to understand the underlying distribution of data. The primary objective of density estimation is to estimate the probability density function of a random…

Machine Learning · Statistics 2024-02-20 Cristiano Tamborrino , Antonella Falini , Francesca Mazzia

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

Recent research has shown a weak convergence - convergence in distribution - of particle filtering methods under certain assumptions. However, some applications of particle filtering methods, such as radiation source localization problems,…

Signal Processing · Electrical Eng. & Systems 2020-04-21 Jared Cook , Ralph C. Smith , Camila Ramirez , Nageswara S. V. Rao

In this paper, we study a method to sample from a target distribution $\pi$ over $\mathbb{R}^d$ having a positive density with respect to the Lebesgue measure, known up to a normalisation factor. This method is based on the Euler…

Statistics Theory · Mathematics 2016-12-20 Alain Durmus , Eric Moulines