English
Related papers

Related papers: Nonparametric Density Estimation under Distributio…

200 papers

In this paper, we study the Bernstein polynomial model for estimating the multivariate distribution functions and densities with bounded support. As a mixture model of multivariate beta distributions, the maximum (approximate) likelihood…

Methodology · Statistics 2019-01-23 Tao Wang , Zhong Guan

Method of parameterizing and smoothing the unknown underling distributions using Bernstein polynomials is proposed, verified and investigated. Any distribution with bounded and smooth enough density can be approximated by the proposed…

Methodology · Statistics 2015-06-23 Zhong Guan

The problem of quickest detection of a change in the distribution of a $n\times p$ random matrix based on a sequence of observations having a single unknown change point is considered. The forms of the pre- and post-change distributions of…

Statistics Theory · Mathematics 2015-06-23 Taposh Banerjee , Hamed Firouzi , Alfred O. Hero

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and…

Data Analysis, Statistics and Probability · Physics 2018-08-15 Philipp Batz , Andreas Ruttor , Manfred Opper

We present a new analysis of the problem of learning with drifting distributions in the batch setting using the notion of discrepancy. We prove learning bounds based on the Rademacher complexity of the hypothesis set and the discrepancy of…

Machine Learning · Computer Science 2012-08-28 Mehryar Mohri , Andres Munoz Medina

This paper proposes new parametric model adequacy tests for possibly nonlinear and nonstationary time series models with noncontinuous data distribution, which is often the case in applied work. In particular, we consider the correct…

Statistics Theory · Mathematics 2021-08-10 Igor Kheifets , Carlos Velasco

We study the problem of diffusion-based network learning of a nonlinear phenomenon, $m$, from local agents' measurements collected in a noisy environment. For a decentralized network and information spreading merely between directly…

Machine Learning · Statistics 2023-05-08 Paweł Wachel , Krzysztof Kowalczyk , Cristian R. Rojas

We consider a multi-period stochastic control problem where the multivariate driving stochastic factor of the system has known marginal distributions but uncertain dependence structure. To solve the problem, we propose to implement the…

Optimization and Control · Mathematics 2022-09-13 Erhan Bayraktar , Tao Chen

Accurate state and uncertainty estimation is imperative for mobile robots and self driving vehicles to achieve safe navigation in pedestrian rich environments. A critical component of state and uncertainty estimation for robot navigation is…

Robotics · Computer Science 2021-04-08 Kapil D. Katyal , I-Jeng Wang , Gregory D. Hager

We study online conformal prediction for non-stationary data streams subject to unknown distribution drift. While most prior work studied this problem under adversarial settings and/or assessed performance in terms of gaps of time-averaged…

Statistics Theory · Mathematics 2026-03-06 Jiadong Liang , Zhimei Ren , Yuxin Chen

In this paper, we study first the problem of nonparametric estimation of the stationary density $f$ of a discrete-time Markov chain $(X_i)$. We consider a collection of projection estimators on finite dimensional linear spaces. We select an…

Statistics Theory · Mathematics 2008-01-09 Claire Lacour

In this paper, we study the nonparametric maximum likelihood estimator for an event time distribution function at a point in the current status model with observation times supported on a grid of potentially unknown sparsity and with…

Statistics Theory · Mathematics 2012-05-29 Runlong Tang , Moulinath Banerjee , Michael R. Kosorok

The application of Stochastic Differential Equations (SDEs) to the analysis of temporal data has attracted increasing attention, due to their ability to describe complex dynamics with physically interpretable equations. In this paper, we…

Machine Learning · Statistics 2017-08-09 Constantino A. García , Abraham Otero , Paulo Félix , Jesús Presedo , David G. Márquez

We study evolution equations of drift-diffusion type when various parameters are random. Motivated by applications in pedestrian dynamics, we focus on the case when the total mass is, due to boundary or reaction terms, not conserved. After…

Probability · Mathematics 2021-07-28 Greta Marino , Jan-Frederik Pietschmann , Alois Pichler

We consider the problem of parameter estimation in the case of observation of the trajectory of diffusion process. We suppose that the drift coefficient has a singularity of cusp-type and the unknown parameter corresponds to the position of…

Statistics Theory · Mathematics 2018-06-19 Yury A. Kutoyants

We research adaptive maximum likelihood-type estimation for an ergodic diffusion process where the observation is contaminated by noise. This methodology leads to the asymptotic independence of the estimators for the variance of observation…

Statistics Theory · Mathematics 2017-12-05 Shogo H. Nakakita , Masayuki Uchida

Neural networks are traditionally trained under the assumption that data come from a stationary distribution. However, settings which violate this assumption are becoming more popular; examples include supervised learning under…

Machine Learning · Computer Science 2024-11-11 Alexandre Galashov , Michalis K. Titsias , András György , Clare Lyle , Razvan Pascanu , Yee Whye Teh , Maneesh Sahani

We investigate the nonparametric, composite hypothesis testing problem for arbitrary unknown distributions in the asymptotic regime where both the sample size and the number of hypotheses grow exponentially large. Such asymptotic analysis…

Information Theory · Computer Science 2019-01-30 Qunwei Li , Tiexing Wang , Donald J. Bucci , Yingbin Liang , Biao Chen , Pramod K. Varshney

Mathematical models for complex systems are often accompanied with uncertainties. The goal of this paper is to extract a stochastic differential equation governing model with observation on stationary probability distributions. We develop a…

Dynamical Systems · Mathematics 2023-04-05 Xiaoli Chen , Hui Wang , Jinqiao Duan

Drift in machine learning refers to the phenomenon where the statistical properties of data or context, in which the model operates, change over time leading to a decrease in its performance. Therefore, maintaining a constant monitoring…

Computation and Language · Computer Science 2023-09-08 Saeed Khaki , Akhouri Abhinav Aditya , Zohar Karnin , Lan Ma , Olivia Pan , Samarth Marudheri Chandrashekar