English
Related papers

Related papers: Finite sample deviation and variance bounds for fi…

200 papers

We define and analyse a least-squares finite element method for a first-order reformulation of the obstacle problem. Moreover, we derive variational inequalities that are based on similar but non-symmetric bilinear forms. A priori error…

Numerical Analysis · Mathematics 2018-01-30 Thomas Führer

In this paper, we derive the limit distribution of the least squares estimator for an AR(1) model with a non-zero intercept and a possible infinite variance. It turns out that the estimator has a quite different limit for the cases of…

Statistics Theory · Mathematics 2018-03-01 Qing Liu , Xiaohui Liu

In this paper, we introduce a new first-order mixture integer-valued threshold autoregressive process, based on the binomial and negative binomial thinning operators. Basic probabilistic and statistical properties of this model are…

Applications · Statistics 2023-09-06 Danshu Sheng , Dehui Wang , Liuquan Sun

Approximate inference in dynamic systems is the problem of estimating the state of the system given a sequence of actions and partial observations. High precision estimation is fundamental in many applications like diagnosis, natural…

Artificial Intelligence · Computer Science 2012-06-18 Hannaneh Hajishirzi , Eyal Amir

Adaptive Markov chains are an important class of Monte Carlo methods for sampling from probability distributions. The time evolution of adaptive algorithms depends on past samples, and thus these algorithms are non-Markovian. Although there…

Probability · Mathematics 2014-10-02 Natesh S. Pillai , Aaron Smith

We study the statistical properties of the least squares estimator in unimodal sequence estimation. Although closely related to isotonic regression, unimodal regression has not been as extensively studied. We show that the unimodal least…

Statistics Theory · Mathematics 2017-05-10 Sabyasachi Chatterjee , John Lafferty

We consider the problem of estimating the parameters of a linear univariate autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze…

Information Theory · Computer Science 2017-04-05 Abbas Kazemipour , Sina Miran , Piya Pal , Behtash Babadi , Min Wu

In this paper we consider high dimension models based on dependent observations defined through autoregressive processes. For such models we develop an adaptive efficient estimation method via the robust sequential model selection…

Statistics Theory · Mathematics 2021-04-19 Ouerdia Arkoun , Jean-Yves Brua , Serguei Pergamenshchikov

We provide non-asymptotic bounds for first and higher order inclusion probabilities of the rejective sampling model with various size parameters. Further we derive bounds in the semi-definite ordering for matrices that collect (conditional)…

Probability · Mathematics 2022-12-20 Simon Ruetz , Karin Schnass

We simultaneously estimate the four parameters of a subcritical Heston process. We do not restrict ourself to the case where the stochastic volatility process never reaches zero. In order to avoid the use of unmanageable stopping times and…

Probability · Mathematics 2018-09-05 Marie du Roy de Chaumaray

We provide an upper bound as a random variable for the functions of estimators in high dimensions. This upper bound may help establish the rate of convergence of functions in high dimensions. The upper bound random variable may converge…

Econometrics · Economics 2020-08-07 Mehmet Caner , Xu Han

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

This paper studies empirical risk minimization (ERM) problems for large-scale datasets and incorporates the idea of adaptive sample size methods to improve the guaranteed convergence bounds for first-order stochastic and deterministic…

Machine Learning · Computer Science 2017-09-05 Aryan Mokhtari , Alejandro Ribeiro

We study the problem of parameter estimation for discretely observed stochastic differential equations driven by small fractional noise. Under some conditions, we obtain strong consistency and rate of convergence of the least square…

Statistics Theory · Mathematics 2022-01-24 S. Nakajima , S. Nakamura , Y. Shimizu

We study the performance of a wide class of convex optimization-based estimators for recovering a signal from corrupted one-bit measurements in high-dimensions. Our general result predicts sharply the performance of such estimators in the…

Statistics Theory · Mathematics 2020-01-27 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

We consider stationary autoregressive processes with coefficients restricted to an ellipsoid, which includes autoregressive processes with absolutely summable coefficients. We provide consistency results under different norms for the…

Machine Learning · Statistics 2017-06-09 Alessio Sancetta

For the identification of switched systems with a measured switching signal, this work aims to analyze the effect of switching strategies on the estimation error. The data for identification is assumed to be collected from globally…

Systems and Control · Electrical Eng. & Systems 2022-07-26 Shengling Shi , Othmane Mazhar , Bart De Schutter

We propose leave-out estimators of quadratic forms designed for the study of linear models with unrestricted heteroscedasticity. Applications include analysis of variance and tests of linear restrictions in models with many regressors. An…

Econometrics · Economics 2019-08-28 Patrick Kline , Raffaele Saggio , Mikkel Sølvsten

In this paper we present a novel approach towards variance reduction for discretised diffusion processes. The proposed approach involves specially constructed control variates and allows for a significant reduction in the variance for the…

Probability · Mathematics 2017-09-19 Denis Belomestny , Stefan Häfner , Tigran Nagapetyan , Mikhail Urusov

The present manuscript is concerned with component-wise estimation of the positive power of ordered restricted standard deviation of two normal populations with certain restrictions on the means. We propose several improved estimators under…

Statistics Theory · Mathematics 2025-08-26 Somnath Mondal , Lakshmi Kanta Patra