English
Related papers

Related papers: Distributed Mean-Field Density Estimation for Larg…

200 papers

Given i.i.d samples from some unknown continuous density on hyper-rectangle $[0, 1]^d$, we attempt to learn a piecewise constant function that approximates this underlying density non-parametrically. Our density estimate is defined on a…

Machine Learning · Statistics 2015-09-24 Kun Yang , Hao Su , Wing Hung Wang

Mean field approximation is a powerful technique to study the performance of large stochastic systems represented as $n$ interacting objects. Applications include load balancing models, epidemic spreading, cache replacement policies, or…

Performance · Computer Science 2021-11-03 Sebastian Allmeier , Nicolas Gast

The density ratio is an important metric for evaluating the relative likelihood of two probability distributions, with extensive applications in statistics and machine learning. However, existing estimation theories for density ratios often…

Machine Learning · Statistics 2025-04-03 Shuntuo Xu , Zhou Yu , Jian Huang

An algorithm to improve performance parameter for unsupervised decision forest clustering and density estimation is presented. Specifically, a dual assignment parameter is introduced as a density estimator by combining Random Forest and…

Computer Vision and Pattern Recognition · Computer Science 2015-07-19 Hayder Albehadili , Naz Islam

We introduce the rigorous limit process connecting finite dimensional sparse optimal control problems with ODE constraints, modeling parsimonious interventions on the dynamics of a moving population divided into leaders and followers, to an…

Optimization and Control · Mathematics 2015-06-18 Massimo Fornasier , Benedetto Piccoli , Francesco Rossi

Unsupervised anomaly detection stands as an important problem in machine learning, with applications in financial fraud prevention, network security and medical diagnostics. Existing unsupervised anomaly detection algorithms rarely perform…

Machine Learning · Computer Science 2026-02-04 Pritam Kar , Rahul Bordoloi , Olaf Wolkenhauer , Saptarshi Bej

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $\Omega$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function.…

Machine Learning · Statistics 2018-03-13 Dangna Li , Kun Yang , Wing Hung Wong

In the present paper we introduce new optimization algorithms for the task of density ratio estimation. More precisely, we consider extending the well-known KMM method using the construction of a suitable loss function, in order to…

Machine Learning · Computer Science 2023-09-15 Cristian Daniel Alecsa

The problem of distributed estimation of a parametric physical field is stated as a maximum likelihood estimation problem. Sensor observations are distorted by additive white Gaussian noise. Prior to data transmission, each sensor quantizes…

Information Theory · Computer Science 2012-09-21 Natalia A. Schmid , Marwan Alkhweldi , Matthew C. Valenti

Kernel density estimation is a popular method for estimating unseen probability distributions. However, the convergence of these classical estimators to the true density slows down in high dimensions. Moreover, they do not define meaningful…

Statistics Theory · Mathematics 2025-05-30 Jack Kendrick

We propose a PDE-based accelerated gradient algorithm for optimal feedback controls of McKean-Vlasov dynamics that involve mean-field interactions both in the state and action. The method exploits a forward-backward splitting approach and…

Optimization and Control · Mathematics 2024-05-03 Christoph Reisinger , Wolfgang Stockinger , Yufei Zhang

Conditional density estimation (CDE) is a fundamental task in machine learning that aims to model the full conditional law $\mathbb{P}(\mathbf{y} \mid \mathbf{x})$, beyond mere point prediction (e.g., mean, mode). A core challenge is…

Machine Learning · Computer Science 2026-03-27 Chenglong Song , Mazharul Islam , Lin Wang , Bing Chen , Bo Yang

We study the density estimation problem with observations generated by certain dynamical systems that admit a unique underlying invariant Lebesgue density. Observations drawn from dynamical systems are not independent and moreover, usual…

Machine Learning · Statistics 2016-07-14 Hanyuan Hang , Ingo Steinwart , Yunlong Feng , Johan A. K. Suykens

Fueled by applications in sensor networks, these years have witnessed a surge of interest in distributed estimation and filtering. A new approach is hereby proposed for the Distributed Kalman Filter (DKF) by integrating a local covariance…

Systems and Control · Computer Science 2017-03-17 Ye Yuan , Ling Shi , Jun Liu , Zhiyong Chen , Hai-Tao Zhang , Jorge Goncalves

In Onur et al. ["Cooperative density estimation in random wireless ad hoc networks," IEEE Commun. Lett., vol. 16, no. 3, 269 pp. 331-333, Mar. 2012], two novel density estimation (DE) approaches in wireless random networks were introduced…

Information Theory · Computer Science 2018-07-09 Yongchang Hu

This paper studies a generally applicable, sensitive, and intuitive error metric for the assessment of robotic swarm density controller performance. Inspired by vortex blob numerical methods, it overcomes the shortcomings of a common…

Optimization and Control · Mathematics 2018-09-18 Brendon G. Anderson , Eva Loeser , Marissa Gee , Fei Ren , Swagata Biswas , Olga Turanova , Matt Haberland , Andrea L. Bertozzi

The covariate shift is a challenging problem in supervised learning that results from the discrepancy between the training and test distributions. An effective approach which recently drew a considerable attention in the research community…

Machine Learning · Computer Science 2013-11-27 Yun-Qian Miao , Ahmed K. Farahat , Mohamed S. Kamel

Doubly selective (DS) channel estimation in largescale multiple-input multiple-output (MIMO) systems is a challenging problem due to the requirement of unaffordable pilot overheads and prohibitive complexity. In this paper, we propose a…

Information Theory · Computer Science 2015-11-10 Bo Gong , Qibo Qin , Xiang Ren , Lin Gui , Hanwen Luo , Wen Chen

Stochastic diffusion is the noisy and uncertain process through which dynamics like epidemics, or agents like animal species, disperse over a larger area. Understanding these processes is becoming increasingly important as we attempt to…

The estimation of a density profile from experimental data points is a challenging problem, usually tackled by plotting a histogram. Prior assumptions on the nature of the density, from its smoothness to the specification of its form, allow…

Methodology · Statistics 2015-03-13 Alberto Bernacchia , Simone Pigolotti