English
Related papers

Related papers: Minimax adaptive estimation of nonparametric hidde…

200 papers

We build penalized least-squares estimators using the slope heuristic and resampling penalties. We prove oracle inequalities for the selected estimator with leading constant asymptotically equal to 1. We compare the practical performances…

Statistics Theory · Mathematics 2015-03-13 Matthieu Lerasle

We address the problem of estimating a random vector X from two sets of measurements Y and Z, such that the estimator is linear in Y. We show that the partially linear minimum mean squared error (PLMMSE) estimator does not require knowing…

Information Theory · Computer Science 2015-05-27 Tomer Michaeli , Daniel Sigalov , Yonina C. Eldar

This work studies an experimental design problem where {the values of a predictor variable, denoted by $x$}, are to be determined with the goal of estimating a function $m(x)$, which is observed with noise. A linear model is fitted to…

Statistics Theory · Mathematics 2023-05-03 David Azriel

We study the problem of estimating an unknown deterministic signal that is observed through an unknown deterministic data matrix under additive noise. In particular, we present a minimax optimization framework to the least squares problems,…

Systems and Control · Computer Science 2014-04-28 N. Denizcan Vanli , Mehmet A. Donmez , Suleyman S. Kozat

The objective of this article is to study the asymptotic behavior of a new particle filtering approach in the context of hidden Markov models (HMMs). In particular, we develop an algorithm where the latent-state sequence is segmented into…

Statistics Theory · Mathematics 2014-09-16 Hock Peng Chan , Chiang Wee Heng , Ajay Jasra

We consider nonparametric regression under covariate shift, where we observe samples from both the target distribution and a related but distinct source distribution. We introduce a novel object, the transfer function, and show that…

Statistics Theory · Mathematics 2026-03-09 Petr Zamolodtchikov

This paper proposes a distributed alternating mixed discrete-continuous (DAMDC) algorithm to approach the oracle algorithm based on the diffusion strategy for parameter and spectrum estimation over sensor networks. A least mean squares…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-12 R. C. de Lamare

In this paper, we investigate the state estimation problem over multiple Markovian packet drop channels. In this problem setup, a remote estimator receives measurement data transmitted from multiple sensors over individual channels. By the…

Systems and Control · Electrical Eng. & Systems 2021-03-08 Jiapeng Xu , Guoxiang Gu , Vijay Gupta , Yang Tang

We consider parameter estimation in finite hidden state space Markov models with time-dependent inhomogeneous noise, where the inhomogeneity vanishes sufficiently fast. Based on the concept of asymptotic mean stationary processes we prove…

Statistics Theory · Mathematics 2018-10-02 Manuel Diehn , Axel Munk , Daniel Rudolf

We consider the nonparametric estimation problem of time-dependent multivariate functions observed in a presence of additive cylindrical Gaussian white noise of a small intensity. We derive minimax lower bounds for the $L^2$-risk in the…

Statistics Theory · Mathematics 2012-11-02 Jérémie Bigot , Theofanis Sapatinas

Mixed-effect models are widely used for the analysis of correlated data such as longitudinal data and repeated measures. In this article, we study an approach to the nonparametric estimation of mixed-effect models. We consider models with…

Statistics Theory · Mathematics 2007-06-13 Chong Gu , Ping Ma

In adaptive data analysis, the user makes a sequence of queries on the data, where at each step the choice of query may depend on the results in previous steps. The releases are often randomized in order to reduce overfitting for such…

Machine Learning · Statistics 2016-02-16 Yu-Xiang Wang , Jing Lei , Stephen E. Fienberg

The nonparametric volatility estimation problem of a scalar diffusion process observed at equidistant time points is addressed. Using the spectral representation of the volatility in terms of the invariant density and an eigenpair of the…

Applications · Statistics 2016-04-01 Jakub Chorowski

Given a matrix the seriation problem consists in permuting its rows in such way that all its columns have the same shape, for example, they are monotone increasing. We propose a statistical approach to this problem where the matrix of…

Statistics Theory · Mathematics 2016-08-02 Nicolas Flammarion , Cheng Mao , Philippe Rigollet

Given observations from a circular random variable contaminated by an additive measurement error, we consider the problem of minimax optimal goodness-of-fit testing in a non-asymptotic framework. We propose direct and indirect testing…

Statistics Theory · Mathematics 2020-07-14 Sandra Schluttenhofer , Jan Johannes

This paper studies a distributed state estimation problem for both continuous- and discrete-time linear systems. A simply structured distributed estimator (comprising interconnected local estimators) is first described for estimating the…

Systems and Control · Electrical Eng. & Systems 2023-10-30 Lili Wang , Ji Liu , Brian B. O. Anderson , A. Stephen Morse

In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. Recently, many flexible machine learning methods have been developed for instrumental variable estimation. However, these methods have at least one…

Machine Learning · Statistics 2023-02-13 Andrew Bennett , Nathan Kallus , Xiaojie Mao , Whitney Newey , Vasilis Syrgkanis , Masatoshi Uehara

Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to…

Numerical Analysis · Mathematics 2018-08-20 Alexander Grimm , Christopher Beattie , Zlatko Drmač , Serkan Gugercin

We derive asymptotic properties of penalized estimators for singular models for which identifiability may break and the true parameter values can lie on the boundary of the parameter space. Selection consistency of the estimators is also…

Statistics Theory · Mathematics 2023-01-24 Junichiro Yoshida , Nakahiro Yoshida

In this paper we investigate the performance of a variety of estimation techniques for the scale and shape parameter of the Lomax distribution. These methods include traditional methods such as the maximum likelihood estimator and the…

Methodology · Statistics 2022-07-14 Thobeka Nombebe , James Allison , Leonard Santana , Jaco Visagie